Robust calcification tracking is provided in fluoroscopic imagery. A patient with an inserted catheter is scanned over time. A processor detects the catheter in the patient from the scanned image data. The processor tracks the movement of the catheter. The processor also detects a structure represented in the data. The structure is detected as a function of movement with a catheter. The processor tracks the movement of the structure using sampling based on a previous location of the structure in the patient. The processor may output an image of the structure.