A respiratory signal processing apparatus includes a pulse-based component detection unit configured to detect a pulse-based component from a first signal acquired from a living being, and a pulse-based component removal unit configured to remove the detected pulse-based component from a second signal acquired from the living being, the second signal including respiratory sounds.