Surgical robotic systems including a surgical robot, a sensor, and a surgical control computer are disclosed. To determine an actual or predicted collision of a robotic arm of the surgical robot with a patient, the sensor is configured to output a proximity signal indicating proximity of the robotic arm to a patient while the robotic arm is adjacent to the patient. A processor of the surgical control computer receives the proximity signal from the sensor and determines when the robotic arm has collided with the patient or is predicted to collide with the patient based on the received proximity signal. In response to determining such an actual or predicted collision, the processor performs a remedial action. By having surgical robotic systems perform remedial action(s) responsive to determining an actual or predicted collision, collisions between the robotic arm and the patient can be reduced and/or eliminated.