A light source device for endoscope includes: an irradiation portion capable of radiating excitation light; a rotating body provided on an optical axis of the excitation light and configured to rotate with a rotating shaft as a center; a phosphor arranged in an irradiation area of the excitation light, and configured to generate fluorescence by being irradiated with the excitation light; a light quantity control portion configured to control irradiation intensity or irradiation time of the excitation light; and a rotation control portion configured to rotate the rotating body at a predetermined speed when the excitation light is radiated with a first irradiation intensity or time and rotate the rotating body faster than the predetermined speed when reducing the irradiation intensity or the irradiation time of the excitation light is reduced in the irradiation intensity or time vis-a-vis the first ones.