The present technology relates to a surgical system and a surgical imaging device enabled to reduce latency. The surgical imaging device generates a surgical image by imaging the inside of a living body, a signal processing device performs predetermined signal processing on the surgical image, and a display device displays the surgical image on which the signal processing is performed. The imaging device generates the surgical image on the basis of scan information indicating a scan order of the surgical image. The present technology can be applied to, for example, an endoscopic surgical system.