An endoscope system includes: an image recording section that records three dimensional image information of a subject a luminal organ extracting section that extracts a predetermined luminal organ from the three dimensional image information a virtual endoscopic image generating section that generates a virtual endoscopic image which is endoscopically drawn from a predetermined viewpoint position with respect to information of the predetermined luminal organ an image pickup section that picks up an image of an inside of the predetermined luminal organ a position information obtaining section that obtains position information of a distal end of an insertion portion a distance comparing section that compares a distance from a feature region in the extracted predetermined luminal organ to the position of the distal end of the insertion portion with a set distance a variation amount detecting section that detects a variation amount of a feature part of a predetermined luminal organ in the picked-up endoscopic image and an information recording section that records information including the position of the distal end of the insertion portion and a virtual endoscopic image corresponding to the position based on a result of the comparison by the distance comparing section and a result of the detection by the variation amount detecting section.
