The invention enables estimating gaze from a set of eye measurement points (050X) which are indicative of a gaze pattern of a user viewing a scene. Herein, use is made of the insight that gaze patterns of different users are similar for a same scene (010). The invention involves obtaining different sets of eye measurement points from different users viewing the same scene. The different sets of eye measurement points may be mapped to a common coordinate system, and thereby mutually calibrated, based on the assumption that geometrically similar topologies between the different sets of eye measurement points are to be mapped to similar coordinates in the common coordinate system as they represent a similar or same gaze pattern. A scene transformation for mapping the common coordinate system to a coordinate system associated with the scene can be calculated by matching eye measurement points from the common coordinate system to interest points (012) of the scene. The scene transformation is thereby calculated more accurately than individually calculated scene transformations, thereby providing a more accurate estimate of the gaze points.
