An endoscope image processing device includes an image acquisition section, a distance information acquisition section, a concavity-convexity determination section that performs a concavity-convexity determination process that determines a concavity-convexity part of an object that agrees with characteristics specified by known characteristic information based on distance information and the known characteristic information that represents known characteristics relating to a structure of the object, a mucous membrane determination section that determines a mucous membrane area within the captured image, and an enhancement processing section that performs an enhancement process on the mucous membrane area based on information about the concavity-convexity part determined by the concavity-convexity determination process. The concavity-convexity determination section excludes a structure that is more global than a local concavity-convexity structure having a desired size from the distance information based on the known characteristic information to extract the local concavity-convexity structure having the desired size as the concavity-convexity part.