A capsule endoscope (10) including a permanent magnet provided inside the capsule endoscope (10), the capsule endoscope (10) being configured to be introduced into a subject, a guiding magnetic field generating device (30) provided outside the subject, an operation input unit (43) configured to input an operation signal for changing a position or a posture of the capsule endoscope (10), and a guiding magnetic field controller (471) configured to: control the guiding magnetic field generating device (30), based on the operation signal input from the operation input unit (43) to change a magnetic field to change the position or the posture of the capsule endoscope (10)； obtain control information indicating a control state for the guiding magnetic field generating device (30) before starting or when starting operation on the operation input unit (43)； and control the guiding magnetic field generating device (30) by using the control information after the operation is finished are provided. According to this, a capsule medical device guidance system capable of improving responsiveness of the capsule medical device to the operation input is provided.
