A device security management apparatus includes: a communication unit that communicates with a device, via a network within a building; a memory unit that memorizes biometric information for each of a plurality of operators; a biometric information acquisition unit that acquires biometric information from the device via the communication unit; a biometric authentication unit that compares the acquired biometric information with the memorized biometric information, to identify an operator corresponding to the acquired biometric information; and a device control unit that notifies the device of control information for bringing the device into an operable state in a case where the biometric authentication unit has identified the operator corresponding to the acquired biometric information, and notifies the device of control information for bringing the device into an inoperable state in a case where the biometric authentication unit has not identified the operator corresponding to the acquired biometric informat