An endoscope system is provided in which blood vessels (pits) are extracted from an image captured by an endoscope to perform pattern matching with vascular patterns (pit patterns) associated with the cancer invasion depth and operations such as enhanced display of blood vessels, suggestion of preferred imaging conditions and display for diagnosis support are performed based on the matching result. The endoscope system enables even a less-experienced doctor to correctly diagnose the cancer invasion depth.