A dynamic eye tracking system to track movement of an eye including the steps of detecting if a neighbor exists about the eye over a predetermined amount of time (12) and forming a boundary for the neighbor (48). Eye candidates are tracked (52, 58, 60, 108, 134) and a determination is made if the eye candidates are beyond the boundary defined by the detected neighbor (68,80, 126).
