An image processing apparatus includes: a contour extracting unit configured to extract a plurality of contour pixels from an image acquired by capturing an inside of a lumen of a living body a feature data calculating unit configured to calculate feature data based on pixel values of the plurality of contour pixels and positional relationship among the plurality of contour pixels and an abnormal portion detecting unit configured to detect an abnormal portion in the lumen based on the feature data.