An apparatus for gesture control and directional force on remote object based on smart wearable is provided. The apparatus includes a sensor configured to detect a user's gesture, a communication unit, and a controller configured to generate a command for a virtual leash based on the detected gesture, and to control the communication unit to transmit the command to a collar of a pet.