A scanning endoscope apparatus includes: a light source section that emits illuminating light; an optical fiber that guides and applies the illuminating light from a distal end, the illuminating light having directionality; a drive element and a scanning drive section that scan the distal end of the optical fiber; a light detecting section that detects light from a subject; a shutter and an intermittent light output control section that controls a light application period and an interruption period for the illuminating light; an extrinsic light component removal section that outputs a result of an average value of a plurality of light detection results obtained in the interruption period being subtracted from each of a plurality of light detection results obtained in the light application period; and an image processing section that forms image information for display, based on the result outputted by the extrinsic light component removal section.