A head-mounted display device with which a user can visually recognize a virtual image and an outside scene includes an image display unit configured to cause the user to visually recognize the virtual image, a detecting unit configured to cause the image display unit to form the virtual image for causing the user to visually recognize a mark on any standard coordinate on a three-dimensional space, calculate a gazing point coordinate on the three-dimensional space representing a gazing point of the user gazing at the mark, and detect a shift between the standard coordinate and the gazing point coordinate, and an augmented-reality processing unit configured to cause the image display unit to form the virtual image including a virtual object to be displayed with respect to a real object actually present in a real world, the virtual object being arranged using the detected shift.