PROBLEM TO BE SOLVED: To provide a visual line detection device that detects a users visual direction, regardless of brightness in an ambient environment.SOLUTION: The visual line detection device 1 includes: a light source 2 that lights a users face an imaging part 3 that generates an image obtained by photographing the users face and a control part 6 that detects at least the pupil of one eye of the user from the image to find the size of the pupil, and detects the Purukinje image of the light source from the image and detects users visual direction, on the basis of a positional relationship between the users pupil and the Purukinje image, when the size of the pupil is equal to or more than a reference value, and on the other hand, detects the users visual direction on the basis of pupil gravity or a users face direction on the image, when the size of the pupil is less than the reference value.