A subject observation system includes primary light sources (5, 6), a wavelength converting section (12), an image acquiring section (3), a mode input section (13), and a light source section (2). The wavelength converting section (12) converts wavelengths of plural primary light of different wavelengths emitted from the primary light sources, respectively. The light source section (2) successively lights the primary light sources to successively irradiate the observation target with the plural illuminating light from an aperture of a same position, when a special light observation mode to emphasize and display a specific observation target in the observation target is input into the mode input section. The image acquiring section (3) acquires the images every time the observation target is irradiated with respective illuminating light, and generates a special light observation image of the observation target based on the images.