Systems and methods for estimating contact force on an anatomical structure during a surgical procedure are disclosed. A system may include at least one processor configured to receive, from at least one image sensor arranged to capture images of a surgical procedure, image data associated with a first event during the surgical procedure and determine, based on the image data, a predicted outcome associated with the surgical procedure. The processor may receive, from at least one image sensor arranged to capture images of a surgical procedure, image data associated with a second event during the surgical procedure and determine, based on the image data associated with the second event, a change in the predicted outcome, causing the predicted outcome to drop below a threshold. The processor may access a data structure of image-related data based on prior surgical procedures; identify a recommended remedial action; and output the recommended remedial action.