A gaze detection apparatus includes: an image capturing unit which generates an image representing both eyes of a user an eye detection unit which, for each of the eyes, detects an eye region containing the eye from the image a pupil detection unit which, for one of the eyes, detects a pupil region containing a pupil from the eye region an estimating unit which obtains, based on the pupil region detected for the one eye, an estimated shape of the pupil region on the image for the other one of the eyes a redetection unit which detects the pupil region by searching for a region having a shape that matches the estimated shape from within the eye region detected for the other eye and a gaze detection unit which detects the users gaze direction based on a position of the pupil region detected for each of the eyes.