An image processing device includes an image acquisition section (305) that acquires a captured image that includes an image of the object, a distance information acquisition section (340) that acquires distance information based on the distance from an imaging section (200) to the object when the imaging section (200) captured the captured image, an in-focus determination section (370) that determines whether or not the object is in focus within a pixel or an area within the captured image based on the distance information, a classification section (310) that performs a classification process that classifies the structure of the object, and controls the target of the classification process corresponding to the results of the determination as to whether or not the object is in focus within the pixel or the area, and an enhancement processing section (330) that performs an enhancement process on the captured image based on the results of the classification process.