[Object] To effectively eliminate an effect of smoke that is generated by cauterization of a tissue. [Solving Means] Provided is a control apparatus including a control unit configured to control smoke removal processing on an image of a living body taken during surgery and actual smoke evacuation of smoke in the living body, in which the control unit allows execution of at least the smoke removal processing on the basis of a fact that the smoke has been detected. Also provided is a control system including: an endoscope configured to take an image of a living body during surgery; a control apparatus configured to control smoke removal processing on the image of the living body and actual smoke evacuation of smoke in the living body; and a smoke evacuation apparatus configured to execute the actual smoke evacuation of the smoke on a basis of control by the control apparatus, in which the control apparatus executes at least the smoke removal processing on a basis of a fact that the smoke has been detected.