A system and method for monitoring telephone calls to detect fraudulent activity and take corrective action is described. The system receives a first group of telephone calls having associated voice characteristics and analyzes the first group of telephone calls to identify and store a first set of distributions of voice characteristics that are indicative of normal activity, fraudulent activity, or indeterminate activity. The system receives a second group of telephone calls to be analyzed. The system analyzes the second group of telephone calls to identify a second set of distributions of voice characteristics associated with the second group of telephone calls. The system then compares the second set of distributions of voice characteristics to the stored first set of distributions of voice characteristics to assess a probability that one or more telephone calls in the second group of telephone calls represents normal, fraudulent, or indeterminate activity. If the assessed probability of fraudulent activit