A system and method for image registration includes tracking (508) a scanner probe in a position along a skin surface of a patient. Image planes corresponding to the position are acquired (510). A three-dimensional volume of a region of interest is reconstructed (512) from the image planes. A search of an image volume is initialized (514) to determine candidate images to register the image volume with the three-dimensional volume by employing pose information of the scanner probe during image plane acquisition, and physical constraints of a pose of the scanner probe. The image volume is registered (522) with the three-dimensional volume.