A virtual object display system includes a plurality of head-mounted displays 1 each having a virtual object acquisition unit 22 that acquires a virtual object, a display information acquisition unit 23 that acquires display information used to display the virtual object, and a display control unit 24 that causes a display unit to display the virtual object on the basis of the display information, and enables switching between of first display control for causing the virtual object to be displayed on the basis of display information acquired by each of the plurality of head-mounted displays 1 and second display control for causing the virtual object having an identical orientation to an orientation of the virtual object displayed on the basis of display information acquired by another head-mounted display 1 to be displayed.