The present disclosure is directed to a planning and navigation method. The planning and navigation method includes obtaining a plurality of images, rendering the plurality of images in three dimensions, automatically segmenting the plurality of images to demarcate a target area, and automatically determining a treatment plan based on the target area. The planning and navigation system also includes obtaining an ultrasound image of a scan plane including the target and obtaining a fiducial image of a fiducial pattern disposed on an ultrasound device using an image capture device on a surgical device. The obtained fiducial image is corrected for lens distortion and a correspondence between the fiducial image and a model image is found. After which a camera pose is a position of the surgical device is transformed to model coordinates. Then the ultrasound image and a virtual image of the surgical device is displayed based on the model coordinates to allow a surgeon to navigate the surgical device to the target using the displayed ultrasound image and the virtual image and treating the target based on the treatment plan.
