PROBLEM TO BE SOLVED: To provide a swallowing sound data collection system and swallowing sound data collection method for enabling swallow evaluation by efficiently collecting swallowing sound during natural daily life.SOLUTION: There are provided a swallowing sound data collection system which includes a processing device for extracting real swallowing sound data by removing noise included in swallowing sound data output from a swallowing sound microphone 20 attached to a neck to collect swallowing sound, using nostril sound data output from a nostril sound microphone 10 attached to the vicinity of a nasal part to collect nostril sound, and a swallowing sound data collection method. The processing device detects a respiration stop period from the nostril sound data and extracts swallowing sound data whose timing is the same as that of the respiration stop period, as the real swallowing sound data.