A medical signal processing device for processing an image obtained by an imaging unit including a plurality of pixels, and generating a video signal for display, includes a Y gamma-correction unit that performs Y gamma-correction on a luminance signal for each pixel in the image obtained by the imaging unit.