An evaluation method of evaluating a color irregularity site (a blemish) includes a color irregularity site detection step (step S102) of detecting a plurality of color irregularity sites respectively from a first skin image and a second skin image different from the first skin image, a gravity center position calculation step (step S108) of calculating gravity center positional coordinates of the color irregularity sites respectively for the first skin image and the second skin image, and a matching process step (step S110) of matching the plurality of color irregularity sites included in the first skin image with the plurality of color irregularity sites included in the second skin image based on the calculated gravity center positional coordinates of the color irregularity sites.