System and method that identify atypical behavior of a user. One embodiment of the system includes an eye tracker to perform tracking of a users gaze while viewing items, an inward-facing head-mounted thermal camera to take thermal measurements of a region of interest on the face (THROI) of the user, and a computer. The computer generates feature values based on THROI and the tracking, and utilizes a model to identify atypical behavior of the user based on the feature values. The model may be trained based on previous tracking and previous THROI of the user, taken while viewing other items.