An ultrasound diagnosis apparatus and a method of operating the ultrasound diagnosis apparatus. The ultrasound diagnosis apparatus includes a probe for transmitting an ultrasound signal to an object and receiving a response signal from the object a detector for detecting a sensor signal including at least one of location information representing a three-dimensional location of the probe and orientation information representing an orientation of the probe on the object a storage unit for storing the sensor signal associated with the response signal and an image processor for forming an ultrasound image based on the received response signal, forming an image indicator based on the sensor signal stored in the storage unit, and forming a display image including the ultrasound image and the image indicator corresponding to the ultrasound image.