Main parts of an endoscope system of the present invention include a medical observation apparatus, a medical image processing apparatus, and a monitor. A CPU 22 of the medical image processing apparatus is constituted by function units including a three-dimensional model estimating unit 22a, a detection target area setting unit 22b, a shape feature value calculating unit 22c, a three-dimensional shape detecting unit 22d, a threshold determining unit 22e, and a polyp determining unit 22f. Such a configuration enables to execute a process appropriately adapted to an observation state of a targeted two-dimensional image and to improve the detection accuracy in the detection of a lesion with locally elevated shape as compared to the past.
