[Object] To improve the quality of an acquired image by detecting each piece of color information of red (R), green (G), and blue (B) components to effectively utilize the dynamic range of the image sensor while using a single-plate image sensor.[Solution] Provided is a light source control device including: a light source control unit configured to cause a plurality of narrowband light sources including at least a red light source, a green light source, and a blue light source to emit light on a time division basis; and a light quantity setting unit configured to set an output of each of the narrowband light sources on the basis of image information that is frame-sequentially detected by a monochrome single-plate image sensor configured to capture a reflected image of a subject illuminated with light emitted from the narrowband light source.