A capsule guiding system includes a capsule medical device having an imaging device that takes an in-vivo image of a subject and a magnet with a magnetization direction that is relatively fixed with respect to the imaging device a magnetic guiding device that applies a magnetic field to the magnet in the subject and guides the capsule medical device a display unit that displays the in-vivo image of the subject and a control unit that causes the magnetic guiding device to apply a magnetic field in a reference direction to the magnet, initializes a rotation angle of an image taken by the imaging device when the magnetization direction of the magnet is oriented to the reference direction following the magnetic field in the reference direction, performs, referring to the image, rotation correction on subsequent in-vivo images, and causes the display unit to sequentially display the corrected in-vivo images.