The present invention provides an apparatus operation device, an apparatus operation method, and an electronic apparatus system that enable a necessary operation to be easily performed by using a line of sight and a gesture and that reduce restrictions on the arrangement of an apparatus. In an endoscope system (10) according to an embodiment of the present invention, it is not necessary to touch an actual keyboard, mouse, or button to operate an endoscope apparatus (100), and thus it is not necessary to shift an instrument from one hand to the other hand or peel of/put on gloves in a medical setting. Accordingly, a necessary operation can be easily performed by using a line of sight and a gesture. In addition, it is not necessary to provide a keyboard, mouse, or button for operating the endoscope apparatus, and restrictions on the arrangement of the apparatus can be reduced. Furthermore, virtual objects corresponding to an apparatus to be operated and operation details are displayed in a pseudo manner, and thus the virtual object on which an operation is to be performed can be easily determined.
