A calorie estimation apparatus and method that analyze a users skin spectrum to determine calories of food and drink that the user has ingested are provided. The calorie estimation apparatus includes a spectrum measurer configured to measure a skin spectrum of a user and a processor configured to determine a noise of the measured skin spectrum, and estimate calories consumed by the user based on the determined noise.