A method of controlling an external apparatus includes: receiving an input command of a user and biometric information of the user from a device; determining a condition for controlling the external apparatus and operation of the external apparatus based on the received input command of the user and the received biometric information of the user; and providing a control command for controlling the operation of the external apparatus if the determined condition is satisfied.