A method for tracking vessels in image data includes receiving a plurality of image frames and annotating a target vessel in the plurality of image frames. A plurality of tracking targets associated with the target vessel is selected based on a first image frame included in the plurality of image frames. For each respective image frame, a set of tracking points are determined according to a tracking algorithm which includes: selecting a plurality of landmark hypothesis points for each tracking target in the respective frame based on a comparison with a previous image frame, constructing a directed acyclic graph from the plurality of landmark hypothesis points, and solving the directed acyclic graph to yield a plurality of optimal landmarks for the respective image frame.
