Reference data relating to a portion of a patient anatomy during patient motion can be acquired from a magnetic resonance imaging system (MRI) to develop a patient motion library. During a time of interest, tracking data is acquired that can be related to the reference data. Partial volumetric data is acquired during the time of interest and at approximately the same time as the acquisition of the tracking data. A volumetric image of patient anatomy that represents a particular motion state can be constructed from the acquired partial volumetric data and acquired tracking data.