The present disclosure relates to a light source control device, a light source control method, a program, and a surgical system that enable observation with a more appropriate exposure state. The light source control device includes a reflection direction estimation unit which estimates a reflection direction of irradiation light reflected on a surface of a subject and a control unit which controls a direction of a light source for emitting the irradiation light on the basis of the estimated reflection direction of the irradiation light. Then, on the basis of the reflection direction, the control unit performs control so that illuminance of the subject viewed from a direction in which the subject is observed becomes uniform or so that specular reflection to the direction in which the subject is observed is suppressed. The present technology is applied to, for example, a surgical system used for endoscopic surgery.
