A system including a communication module, a processor and a medical device configured to sense cardiac signals and detect cardiac rhythm episodes is configured to retrieve stored episode data accumulated by the medical device and generate truthed episode classifications from the retrieved episode data. The processor is configured to perform a detection simulation for detecting and classifying cardiac rhythm episodes included in the retrieved episode data to obtain simulated episode classifications. Sensitivity and specificity data is generated in response to the detection simulation, and recommended detection parameter settings are identified in response to the sensitivity and specificity data.
