An image processing device includes a processor including hardware. The processor is configured to: detect an area not suitable for an observation inside each image included in an image group in which images are acquired in time sequence calculate an importance of the image for each of the images included in the image group based on the area not suitable for the observation inside the image integrate the importance in order of time sequence and determine whether the integrated value exceeds a threshold value.