A system may obtain a set of features characterizing a segment of inertial measurement unit (IMU) data generated by an IMU of an ear-wearable device. The system may apply a machine learning model (MLM) that takes the features characterizing the segment of the IMU data as input. The system may determine, based on output values produced by the MLM, whether a user of the ear-wearable device has potentially been subject to physical abuse. The system may then perform an action in response to determining that the user of the ear-wearable device has potentially been subject to physical abuse.