A capsule endoscope system includes: a capsule endoscope configured to generate images by imaging a subject through irradiation of the subject with illumination light; and a processor including hardware, the processor being configured to determine, based on an image to be determined or associated information associated with the image to be determined, whether or not the image to be determined is suitable for control of operation of the capsule endoscope, the image being one of the images generated.