Systems and methods for tracking heart sounds are disclosed. The system can include a heart sound (HS) receiver circuit configured to receive HS information, and a HS analyzer circuit coupled to the HS receiver circuit. The HS analyzer circuit can determine a HS timing parameter of a specified HS component. The HS component includes at least a portion of one of S1 S2, S3, or S4 heart sound. The HS analyzer circuit can include first and second feature detector circuits each configured to respectively detect first and second one or more candidate features. The HS analyzer circuit can also include a feature selection circuit that can produce an inter-categorical metric, and determine first and second selected features using at least the inter-categorical metric. A HS recognition circuit can determine the timing parameter of the HS component using the first and second selected features.