User-friendly control device and endoscope system are provided. A control device 6 includes an acquisition unit 661 which acquires identification information including switch information indicating the number of switches provided on an endoscope 2 and function information indicating at least any one of a function which the endoscope 2 may execute and a function which the endoscope 2 cannot execute from the endoscope 2, a setting information recording unit 641 which records setting information in which a predetermined function is assigned to each switch of the endoscope 2 connected to the control device 6, and a setting unit 662 which generates function setting information in which the function to be executed is assigned to be set according to a signal output from each of a plurality of switches of the endoscope 2 connected to the control device 6 based on the identification information acquired by the acquisition unit 661 and the setting information recorded by the setting information recording unit 641.