Provided is a capsule medical device guidance system capable of allowing a user to easily perform a guidance operation on a capsule medical device while observing an image displayed in a desired direction. A capsule medical device guidance system (1) guides a capsule endoscope (10) in which an imaging unit is fixedly arranged therein. The capsule medical device guidance system (1) includes: a magnetic field generation unit (26) configured to generate a magnetic field for guiding the capsule endoscope; a display unit (23) including a screen on which an image based on an image signal generated by the imaging unit is displayed; a first operation input unit (24) configured to input guidance instruction information for the capsule endoscope; a second operation input unit (25) configured to input instruction information for changing a direction of the image on the screen; a guidance controller (271) configured to perform guidance control of the capsule endoscope; and a display controller (272) configured to control the direction of the image displayed on the screen. The guidance controller (271) performs control so that a relation between a direction of a change in a visual field of the image displayed on the screen and an operation input on the first operation input unit (24) is constant regardless of the direction of the image.