An object of the present invention is to perform initialization of the image rotation angle of an image taken by a capsule medical device magnetically guided with high accuracy. A capsule guiding system (1) according to the present invention includes a capsule endoscope (2) including an imaging device that takes an in-vivo image of a subject and a magnet with a magnetization direction that is relatively fixed with respect to the imaging device a magnetic guiding device (4) that applies a magnetic field to the magnet and magnetically guides the capsule endoscope (2) a display unit (62) that displays the in-vivo image of the subject taken, using the imaging device, by the capsule endoscope (2) and a control unit (64). The control unit (64) controls the magnetic guiding device (4) to apply a magnetic field in a reference direction to the magnet, initializes the rotation angle of the image taken by the imaging device when the magnet is magnetized in the reference direction following the magnetic field in the reference direction, performs rotation correction on subsequent in-vivo images referring to the image, and causes the display unit (62) to display the in-vivo images on which the rotation correction is performed.