A kind of system for allowing a practitioner and medical information to interact, including system: be used for a sense unit with a position of the reference object of sense unit interaction for detect one At least one control unit are as follows: the gesture for determining one by practitioner to carry out An instruction dependency is identified to the medical information for corresponding to gesture and in order to show that medical information executes order Generating a graphical user interface includes a virtual representation of reference object and at least one virtual icon and/or a virtual representation of sense unit, corresponding at least one virtual icon of each of one of operation, an a pair of respective mode for applying family notice and peer machine Resource selection Show the GUI with medical information