PROBLEM TO BE SOLVED: To obtain an endoscope apparatus and an endoscope system capable of acquiring an image of a subject by using special light having a wavelength included in visible light band.SOLUTION: In a laser processing mode, a normal light source 136 emits normal light with an amount of light larger than an amount of light in normal light observation mode processing, and a special light source 102 generates a KTP laser beam and irradiates the KTP laser beam to an affected part. A CCD 111 performs imaging at a shutter speed shorter than during executing normal light observation mode processing, that is, in a short exposure period. A video processing circuit 114 uses pixel data outputted by a pixel with a red filter R attached thereto, and pixel data outputted by a pixel with a blue filter B attached thereto to calculate brightness information Yinf, red information Rinf, green information Ginf, and blue information Bin. Influence by the KTP laser beam is eliminated, and an appropriate image can be acquired.