The disclosure relates to a hearing device comprising a housing (211, 212) configured to be worn at a wearing position at an ear of a user. The hearing device comprises an inertial sensor (1300) included in the housing (211, 212) and an orientation evaluator (1230) communicatively coupled to the inertial sensor (1301). The orientation evaluator (1230) is configured to provide orientation data indicative of a spatial orientation of the housing (211, 212) and/or the wearing position. The disclosure further relates to a method of operating the hearing device.To estimate the spatial orientation of the housing and/or the wearing position in a reliable way, a walking evaluator (1210) configured to provide walking data indicative of a walking activity of the user and an orientation calibrator (1220) configured to provide calibration data indicative of a deviation of the spatial orientation of the housing (211, 212) from a reference orientation is provided. The orientation calibrator (1220) is configured to provide the calibration data depending on the walking data, and the orientation evaluator (1230) is configured to provide the orientation data based on the calibration data.