There is provided a hearing assistance system comprising an auditory prosthesis device for neural stimulation of a patient's hearing at one of the patient's ears and a hearing aid for acoustic stimulation of the patient's hearing at the same one or the other one of the patient's ears. The system includes at least one microphone for capturing an input audio signal from ambient sound; and a fundamental frequency estimation unit for estimating the fundamental frequency and at least part of its harmonics at least for voiced segments of the input audio signal and for supplying a corresponding output signal.