An image processing apparatus for processing a moving image of a subject includes an input unit which accepts an input of a moving image of the subject, an analysis unit which analyzes a phase of a motion of the subject based ON a frame image of the moving image, a determination unit which determines whether or not feature amount information of a frame image in phase with the analyzed phase is stored in a storage unit and a feature amount setting unit which sets the feature amount information in a frame image to be processed when it is determined based ON the determination result of the determination unit that the feature amount information of the frame image in phase with the analyzed phase is stored in the storage unit and an image processing unit which executes image processing for the frame image to be processed according to the feature amount information.
