An endoscope apparatus 1 comprises a light source unit 24 which emits light having different polarization characteristics in at least two wavelength bands, an illumination fiber 14 which has one end arranged at a distal end of an insertion portion 11 to be inserted into a subject, and guides the light from the light source unit 24, a driver unit 25 which causes the one end of the illumination fiber 14 to perform scanning, detection fibers 16a and 16b which are arranged at a distal end portion 12 and receives return light from the subject, and polarization filters 17a and 17b which are arranged between the subject and the detection fibers 16a and 16b, and polarizes the return light in desired polarization directions.