A system and method for detecting a man overboard incident on structures such as cruise vessels and oil rigs. The system includes at least two opposed imaging devices which record video streams of a detection cuboid within an overlapping region of view volumes for the imaging devices. The imaging devices are located at the lowest deck of the structure and monitor a fall that passes through the cuboid. Identified objects within the video streams are paired, their conformance is determined, and real world information such as size, trajectory, and location is determined.