An endoscope insertion observation apparatus includes a processor designed to perform functions including: detecting an insertion state of an insertion portion of an endoscope that is insertable into and extractable from a subject; determining whether or not the insertion portion has reached a second site in the subject from a first site in the subject and/or whether the insertion portion has reached the first site from the second site in the subject based on a detection result of the insertion state; and calculating a duration of movement of the insertion portion from the first site to the second site after determining that the insertion portion has reached the second site, or a duration of movement of the insertion portion from the second site to the first site after determining that the insertion portion has reached the first site.