Data from sensors of a vehicle is captured along with data tracking a driver's gaze. The route traveled by the vehicle may also be captured. The driver's gaze is evaluated with respect to the sensor data to determine a feature the driver was focused on. A focus record is created for the feature. Focus records for many drivers may be aggregated to determine a frequency of observation of the feature. A machine learning model may be trained using the focus records to identify a region of interest for a given scenario in order to more quickly identify relevant hazards.