There is described a system and a method for assisting a user manipulating an objectduring a surgery, the method comprising: tracking the object in a sterile fieldin which surgery is being performed at a location using a tracking device whichgenerates tracking data； processing the tracking data using a processing devicelocated outside the sterile field to generate position and orientation informationrelated to the object； and sending the position and orientation informationrelated to the object to a displaying device positioned in the sterile field adjacentto the location at which the surgery is being performed, for display to the user.
