A signal processing apparatus includes a mapping unit configured to multiplex first to fourth pixel data with respect to areas of first to fourth signals of a data stream prescribed in a predetermined SDI (Serial Digital Interface) format, respectively. The first to fourth pixel data respectively correspond to first to fourth colors of video data in which pixels are arranged on a block basis with 2×2 pixels as the block, and the 2×2 pixels respectively correspond to the first to fourth colors.