A capsule endoscope system includes: a capsule endoscope configured to be introduced into a subject and having a magnetic field response unit configured to respond to a magnetic field and having an imaging unit configured to image an object; a magnetic field generating unit configured to generate the magnetic field to guide the capsule endoscope; an input unit configured to input commands for changing at least one of a position and a posture of the capsule endoscope; a setting unit configured to set a reference distance between the imaging unit and the object; a detection unit configured to detect a distance between the object and the imaging unit; and a magnetic field controller configured to control the magnetic field generating unit to generate the magnetic field based on the distance and the commands while a difference between the distance and the reference distance is maintained within a certain range.