An image processing apparatus includes: a surface shape estimation unit configured to estimate a surface shape of a target that appears in an intraluminal image of a living body； an imaging viewpoint changing unit configured to change an imaging viewpoint with respect to the surface shape from an imaging viewpoint used for estimation； and an image generation unit configured to generate a virtual image of the target for a case of imaging the target from the changed imaging viewpoint.
