A prohibited object detection system detects prohibited objects in a patient room. An image of an object detected in a room of a patient is initially collected. The system identifies reference points on the object, for example, points along the contours of the object. The system may compare the reference points to reference points of images associated with prohibited objects. The system then determines, based on the comparison, if the object is a prohibited object. One or more designated recipients may be alerted if the object is a prohibited object. The system may also register the object in a database of prohibited objects.