An apparatus and method for generating a fused scan image from a plurality of anatomical scan images of a patient. A tracking system is used to track the physical position and orientation of a scanner transducer, such as an ultrasound probe, which is used to obtain the anatomical scan images. The tracking system may also be used to track markers positioned on the patient for tracking anatomical movement of the patient. An image-processing based fusion is applied to the plurality of anatomical scan images based on the tracked position and orientation of the scanner transducer and the tracked patient anatomical movement to generate a fused scan image. The anatomical movement may comprise respiratory movement of the patient. An electrocardiogram (ECG) signal from the patient may be used to time synchronize tracking information generated by the tracking system with the plurality of anatomical scan images.
