An ultrasound system for performing cancer grade mapping includes an ultrasound imaging device (10) that acquires ultrasound imaging data. An electronic data processing device (30) is programmed to generate an ultrasound image (34) from the ultrasound imaging data, and to generate a cancer grade map (42) by (i) extracting sets of local features from the ultrasound imaging data that represent map pixels of the cancer grade map and (ii) classifying the sets of local features using a cancer grading classifier (46) to generate cancer grades for the map pixels of the cancer grade map. A display component (20) displays the cancer grade map, for example overlaid on the ultrasound image as a color-coded cancer grade map overlay. The cancer grading classifier is learned from a training data set (64) comprising sets of local features extracted from ultrasound imaging data at biopsy locations and labeled with histopathology cancer grades.
