An image processing apparatus includes: a measurement data acquiring unit that acquires data obtained by using an imaging apparatus to capture an image formed by an electromagnetic wave transmitted through an object, as measurement data of the object an image generating unit that generates a first image and a second image that represent information on different physical quantities, from the measurement data a filter characteristics determining unit that determines, based on the first image, filter characteristics to be set when an anisotropic filter is applied, for each position in the image and a filtering unit that applies the anisotropic filter to the second image while varying the filter characteristics of the anisotropic filter for each position in the image in accordance with the filter characteristics determined based on the first image.