A scanning endoscope apparatus (1) includes a light source section (2) that emits illumination light, an optical fiber (3) that irradiates the illumination light from a distal end to a subject with directivity, a drive element (7) and a scanning drive section (8) that perform scanning by the distal end of the optical fiber (3), a first light detection section (11) that detects light with the same directivity as the distal end of the optical fiber (3), a second light detection section (12) that detects light from an entire scanning range of the distal end of the optical fiber (3), and an image processing section (15) that adds a detection result by the first light detection section (11) and a detection result by the second light detection section (12), and calculates from which direction the addition result indicates the result of detection of the light based on information on the direction of the distal end of the optical fiber (3) from the scanning drive section (8) and configures an image.