A sound source separating device provided with a first microphone for inputting a first audio, a second microphone for inputting a second audio, a first crosstalk canceller for removing a first crosstalk inputted to the first microphone by the second audio, and a second crosstalk canceller for removing a second crosstalk inputted to the second microphone by the first audio. The first crosstalk canceller estimates and calculates a first interference signal indicating the degree of the first crosstalk using the audio signal from which the second crosstalk has been removed from the audio signal of the second microphone and removes the calculated first interference signal from the audio signal of the first microphone. The second crosstalk canceller estimates and calculates a second interference signal indicating the degree of the second crosstalk using the audio signal from which the first crosstalk has been removed from the audio signal of the first microphone and removes the calculated second interference signa
