What is disclosed is a system and method for compensating for motion induced artifacts in physiological signals extracted from a video of a subject being monitored for a physiological function in a non-contact, remote sensing environment. The present method identifies a center frequency from a physiological signal obtained from processing a prior video segment. Since a moment to moment change in pulse frequency from one video segment to a next is not very large, signals obtained from sequential video segments can be repeatedly processed and an adaptive band-pass filter repeatedly re-configured and used to filter a next video segment, and so on. Using the teachings disclosed herein, a motion-compensated continuous cardiac signal can be obtained for the subject for continuous monitoring of the subject's cardiac function via video imaging. The teachings hereof provide an effective means for compensating for movement by the subject during video acquisition. Various embodiments are disclosed.