PROBLEM TO BE SOLVED: To provide a pupil detection device capable of precisely detecting a pupil with a small computational quantity.SOLUTION: The pupil detection device includes: an image acquisition part which acquires a first image including a pupil of a person being irradiated with infrared light from a light source arranged at a first position and a second image including the pupil of the person irradiated with infrared light from a light source arranged at a second position a difference value calculation part which calculates difference values between luminances of a plurality of image areas included in the first image and luminances of a plurality of image areas included in the second image and corresponding to the plurality of image areas of the first image a candidate area specification part which specifies a plurality of successive image areas whose calculated difference values are equal to or larger than a first threshold as a candidate area for the pupil a variance value calculation part which calculates a variance value indicative of how the respective image areas in the candidate area vary in luminance and a pupil detection part which detects the candidate area as the position of the pupil of the person when the variance value is equal to or less than a second threshold.