An image processing device includes an acquiring unit configured to acquire a medical video image obtained by imaging of lungs, a holding unit configured to hold a lung field motion model, the lung field motion model simulating lung field motion, and a processing unit configured to process the medical video image by using the lung field motion model.