A system for guiding a capsule medical device is provided with a capsule medical device, a magnetic guidance device, and an image display device. The capsule medical device is provided with an imaging unit and a permanent magnet having a known magnetization direction relatively fixed with respect to an upward/downward direction of an imaging surface, and has a center of gravity deviated from a geometric center of the capsule casing in a direction parallel to a plane parallel to a magnetization direction and an imaging direction and different from the magnetization direction, and maintains a specific state in which the magnetization direction and the imaging direction are parallel to a vertical plane in liquid introduced into the subject. The image display device displays the in-vivo image by conforming a direction of intersection line of the imaging surface and the vertical plane to an upward and downward direction of a display screen.