An image sensor includes: unit pixels arranged in a two-dimensional matrix form, each unit pixel having photoelectric converters for converting received light into imaging signals and filters having different transmission spectra and disposed on light receiving surfaces of the photoelectric converters. The image sensor is configured to: switch between signal processing units with respect to transfer destination of the imaging signals transferred from second transfer lines to a switching unit, based on types of the filters and output the imaging signals from a single row of the unit pixels to the sample-and-hold units, in a predetermined number of times during one horizontal scanning period by dividing the unit pixels into pixel units each time the imaging signals are output so as to output the imaging signals from the photoelectric converters having the light receiving surfaces on which the filters of different types are disposed in each pixel unit.