The present disclosure relates to systems, methods, and tools for tool tracking using image-derived data from one or more tool-located references features. In some embodiments, an associated medical system includes a tool having a distal end that is insertable into a patient body, a stereo image capture device insertable into the patient body so that the stereo image capture device captures a stereo image of at least a portion of the a two-dimensional marker at least partially surrounding a portion of the tool, and a processor coupled to the image capture device and configured to determine a pose of the tool by processing the stereo image. Associated methods and tools are also provided.
