The present invention relates to a system and method for monitoring and predicting the mental health of a person. Data is collected from multiple sensors including a camera and microphone. Additional sensors can be added to improve the robustness of the system such as heart rate sensors and respiration sensors. The data can be collected in phases that provide contextual awareness to the system. An algorithm can synchronize the data collected in the different phases and the data can be analyzed individually and collectively. Historical data can be included in the analysis to evaluate and predict the mental condition of a person.