A system for permitting a medical practitioner to interact with medical information, the system including: a sensing unit for detecting a position of a reference object used to interact with the sensing unit； at least one control unit for determining a gesture performed by the medical practitioner, identifying a command relative to the medical information that corresponds to the gesture, and executing the command in order to display the medical information； generating a graphical user interface including a virtual representation of the reference object and at least one virtual icon and/or a virtual representation of the sensing unit, with each of the at least one virtual icon corresponding to one of a respective mode of operation, a respective user notification, and a respective system setting option； and displaying the GUI along with the medical information.
