Systems and methods to improve performance, reliability and learning to enhance autonomy of vehicles are disclosed. Responses of subjects to non-events and outside events when operating vehicles under various conditions are scored partly based on vehicle location and an associated map. Scoring for non-events is based on performance and mental functioning on selected categories, while scoring for outside events is based on success and failure and mental functioning when responding to these events. Subjects are ranked and expert drivers identified depending on their raw or scaled scores, or a combination score, or a threshold score. Responses of expert drivers are then used as vehicle training data to enable or improve vehicle autonomy. Response data can include data from vehicle sensors, outside environment sensors and human sensors.