An endoscope system 1 has an insertion portion 4, a forward observation window 12 configured to acquire a forward-field-of-view image FV, a lateral observation window 13 configured to acquire a lateral-field-of-view image SV, an image pickup device 40 and a video processor 32. A positional displacement correcting portion 65 of the video processor 32 detects a positional relationship between a portion FVa where the forward-field-of-view image FV is formed and a portion SVa where the lateral-field-of-view image SV is formed, on the image pickup device 40, and generates displacement amount data. A boundary correcting portion 66 generates an image signal in which the forward-field-of-view image FV and the lateral-field-of-view image SV are arranged with an image center point CF provided in the portion FVa and an image center point CS provided in the portion SVa caused to correspond to each other, based on the displacement amount data.