Systems and methods to improve performance, reliability, learning and safety and thereby enhance autonomy of vehicles. Human sensors are used to capture human eye movement, hearing, hand grip and contact area, and foot positions. Event signatures corresponding to human actions, reactions and responses are extracted form these sensor values and correlated to events, status and situations acquired using vehicle and outside environment sensors. These event signatures are then used to train vehicles to improve their autonomous capabilities. Human sensors are vehicle mounted or frame mounted. Signatures obtained from events are classified and stored.