An apparatus and method for localization of an internal organ of a subject to provide assistance during surgery, includes capture of a sequence of video frames of one or more internal organs in a body of a subject by insertion of an image capture device in a body of the subject. The apparatus further includes circuitry that computes appearance data of an internal organ of interest in a test video frame selected from the captured sequence of video frames. Orientation data of the internal organ of interest is determined within the body of the subject based on a known orientation of the image capture device and a maximum correlation of the test video frame with a specified anatomical template for the internal organ of interest. Supplemental information is generated to localize at least a portion of the internal organ of interest of the subject in the surgery.