A biological object observation system includes an observation optical unit, a photodetector, a display unit, a detection unit, and a processor. The observation optical unit includes an optical system that guides a luminous flux from a biological object and a drive unit that drives the optical system. The photodetector receives optical information in accordance with the biological object. The display unit displays an observation image of the biological object generated on the basis of the optical information. The detection unit detects one of a position and a movement of an object in a display region of the displayed observation image. The processor controls the drive unit in accordance with the one of the position and the movement of the object that is detected.