Rana el Kaliouby,Viprali Bhatkar,Niels Haering,Youssef Kashef,Ahmed Adel Osman
申请号:
US16729730
公开号:
US20200134672A1
申请日:
2019.12.30
申请国别(地区):
US
年份:
2020
代理人:
摘要:
Video of one or more vehicle occupants is obtained and analyzed. Heart rate information is determined from the video. The heart rate information is used in cognitive state analysis. The heart rate information and resulting cognitive state analysis are correlated to stimuli, such as digital media, which is consumed or with which a vehicle occupant interacts. The heart rate information is used to infer cognitive states. The inferred cognitive states are used to output a mood measurement. The cognitive states are used to modify the behavior of a vehicle. The vehicle is an autonomous or semi-autonomous vehicle. Training is employed in the analysis. Machine learning is engaged to facilitate the training. Near-infrared image processing is used to obtain the video. The analysis is augmented by audio information obtained from the vehicle occupant.