Systems and methods for generating surgical summary footage are disclosed. A system may include at least one processor configured to implement a method including accessing particular surgical footage containing a first group of frames associated with at least one intraoperative surgical event and a second group of frames not associated with surgical activity. The method may include accessing historical data based on historical surgical footage of prior surgical procedures, wherein the historical data includes information that distinguishes portions of surgical footage into frames associated with intraoperative surgical events and frames not associated with surgical activity. The method may include distinguishing in the particular surgical footage the first group from the second group based on the information and, upon request of a user, presenting to the user an aggregate of the first group of the particular surgical footage while omitting presentation to the user of the second group.