One example method for improving robotic surgical safety via video processing includes identifying, during a robotic surgical procedure, one or more surgical tools using one or more images of the surgical procedure captured by a camera, the robotic surgical procedure employing a robotic surgical device controlling the one or more identified surgical tools； predicting, for at least one of the one or more images, one or more loaded surgical tools that are controlled by the robotic surgical device and should be in a field of view of the camera； comparing the one or more identified surgical tools with the one or more loaded surgical tools； determining that at least one of the one or more loaded surgical tools does not match any of the one or more identified surgical tools； and causing the at least one loaded tool of the robotic surgical device to be disabled.
