An endoscope apparatus includes image pickup section that outputs a first picked-up image based on illuminating light of a first band, and a second picked-up image based on the illuminating light of a second band within a predetermined time period, brightness calculating section that calculates a first brightness by color conversion matrix processing using a first image pickup signal and a second image pickup signal based on illumination of the second band by first predetermined times, and calculates a second brightness by color conversion matrix processing using the first image pickup signal and a second image pickup signal based on illumination of the second band by times other than the first predetermined times, and synthesizing section that synthesizes the first and the second image pickup signals based on a ratio of a difference value of the first brightness and a target brightness, and the second brightness.
