A system for automatically assessing an infant includes a computer. The computer is configured to assess an infants appearance and generate an appearance score based on the appearance assessment, assess the infants pulse and generate a pulse score based on the pulse assessment, assess the infants reaction to a stimulus and generate a grimace score based on the assessment of the infants reaction to the stimulus, assess the infants activity, and generate an activity score based on the activity assessment, and assess the infants respiration and generate a respiration score based on the respiration assessment. The computer is also configured to generate a composite infant assessment based on the appearance score, the pulse score, the grimace score, the activity score and the respiration score.