Automated image interpretation is provided with transducer position and/or orientation sensing. The current position of a transducer is used to determine the anatomy being imaged. Other reference information, such as (1) the previous position of the transducer and the known anatomy being imaged at that time or (2) a reference device at a known location, is used in the determination. The anatomy is determined based on position sensing or determined based on position sensing and other anatomy features, such as image analysis.