Provided is a visual line estimating apparatus which can obtain a high accurate visual line estimating result with suppressed errors without delays even if the visual line measuring result includes the significant errors caused by the false detection of the pupil. The visual line estimating apparatus 200 comprises: an image inputting section 201 operable to take an image of a human； a visual line measurement section 202 operable to measure a direction of a visual line on the basis of the taken image； a visual line measuring result storing section 211 operable to store therein visual line measuring results previously measured, a representative value extracting section 212 operable to extract a previous representative value； and a visual line determining section 213 operable to judge whether or not a difference between the representative value and the visual line measuring result is lower than a predetermined threshold to determine a visual line estimating result from the representative value and the visual line measuring result.
