An image process unit of a medical video recording and reproducing system generates video data of a subject on the basis of an image signal; a characteristic point information generation unit generates characteristic point information for a frame specified in the video data; a server records characteristic point information and video data in an associated manner; a reproduction control unit controls reproduction of a past video on the basis of video data read from the server; a synthesization unit generates synthesized image data obtained by synthesizing live video data from the image process unit and past video data from the reproduction control unit in such a manner that the live video and the past video are displayed simultaneously; and the reproduction control unit conducts control of pausing reproduction at a frame to which the characteristic point information of the past video data is added.