The present invention involves a surgical site monitoring system and associated method of use employing vectorized 3D-tracking markers attached to a single vectorized fiducial reference and to a surgical site imaging sensor. A tracker obtains image information about both tracking markers and uses either the markings on or shapes of the tracking markers to determine from the image information the 3D locations and orientations of the imaging sensor and of the fiducial reference fixed to the surgical site. A scan taken of the surgical site prior to a surgical procedure with the fiducial reference attached allows live images of the surgery site to be sourced from the imaging sensor and to be overlaid in real time on a 3D model of the surgical site.