A method for enhancing a three-dimensional (3D) reconstruction of an object comprises obtaining a signal indicative of a static 3D reconstruction of an object disposed in a tracking space, co-registering the 3D reconstruction to the 3D tracking space, collecting enhancement data from a tracked tool disposed in the 3D tracking space, and adding real-time features of the object to the static 3D reconstruction using the enhancement data. A system for enhancing data obtained by a medical system includes an electronic control unit configured to receive a first signal for a static 3D reconstruction of an organ, co-register the static 3D reconstruction to a 3D tracking space for a tracked tool, receive a second signal for enhancement data generated by the tracked tool operating within a region of interest of the organ, and add real-time features of the area of interest to the static 3D reconstruction using the enhancement data.