In a light source device including a light source unit (2) including primary light sources (5a to 5c, 6a to 6c, and 7a to 7c), an illumination unit (3) including light converting members (11a to 11c, 12a to 12c, and 13a to 13c) which convert primary light emitted from the primary light sources to secondary light and emits the secondary light to the outside, and a connection portion (4) which removably connects the light source unit and the illumination unit, the connection portion includes a first light port (17) to a tenth light port (26) configured to transfer and receive energy between the light source unit and the illumination unit, and the first to tenth light ports are grouped into two first hierarchical port groups (a first group (27A) and a second group (27B)) by physical properties of the energy to be transferred and received by the ports.