A system (1 31 41 51 61 71 81 91) for guiding capsule medical device includes a capsule medical device (2 82 92) that includes a capsule casing (20) capable of being introduced into a subject (100) and including therein an imaging unit (21, 22) for imaging an in-vivo image of the subject (100) and a permanent magnet (26, 97) to be magnetized in a direction relatively fixed with respect to an upward and downward direction of an imaging surface of the imaging unit(21, 22), the capsule medical device (2 82 92) having a center of gravity (29, 29A) deviated from a geometric center (28) of the capsule casing (20) toward a direction different from a magnetization direction (D1) of the permanent magnetic (26), wherein a plane parallel to the imaging surface of the imaging unit (21, 22) and a plane parallel to the magnetization direction (D1) of the permanent magnet (26) and a deviation direction of the center of gravity (29, 29A) with respect to the geometric center (28) form an intersection line a magnetic guidance device (3 83 93) that applies a magnetic field to the permanent magnet (26 97) to magnetically guide the capsule medical device (2 82 92) and an image display device (10 33 43 53 63) that displays the in-vivo image such that a direction of the intersection line conforms to an upward and downward direction of a display screen (12).