A spatio-temporal image of an object is reconstructed based on captured data characterizing the object. The spatio-temporal image comprises a plurality of spatial images in respective time intervals, and at least a given one of the spatial images in one of the time intervals is reconstructed using not only captured data from a frame associated with that time interval but also captured data associated with one or more additional frames associated with other time intervals. The spatio-temporal image may be reconstructed by iteratively obtaining a solution to a minimization or maximization problem in a sparse domain and transforming the solution to an image domain. The transformation between the sparse domain and the image domain may utilize a spatio-temporal transformation implemented using a plurality of basis functions, one or more of which may be determined at least in part based on secondary information associated with the imaged object.