A health care assisting device includes: an image acquisition part that acquires a plurality of images in which a target person is photographed in time series； an expression recognizer that recognizes a feature of an expression of the target person from the plurality of images acquired by the image acquisition part； a storage in which expression recognition results of the plural images are stores as time-series data； a health state estimator that detects a feature associated with a temporal change of the expression of the target person from the time-series data stored in the storage, and estimates a mental health state of the target person based on the detected feature； and an output part that outputs information on the mental health state of the target person based on an estimation result of the health state estimator.
