A surgical system uses a surgical tool as a control input. A tracking unit tracks a motion of the surgical tool, and a processing unit for processes the motion of the surgical tool to obtain a temporal spatial information of the surgical tool. The control unit further comprises a control input unit with a number of control commands. The control input unit associates the temporal spatial information of the surgical tool with a corresponding control command.