An endoscope operation system includes an endoscope, a holding arm unit that supports the tip of the endoscope in such a manner that the tip of the endoscope can be moved in up/down, left/right, and front/back directions, and can be rotated on its own axis, a display unit that displays an image based on an image signal supplied from an image pickup unit of the endoscope, a gyroscopic sensor attached to the head of an operator, a gyroscopic sensor attached to the torso of the operator, and a control unit that controls the moving direction and the speed of the tip of the endoscope.