A system and method of computer aided analysis of medical images and detectionof malignant lesions is described. Medical images obtained from multiple modalitiesare analyzed. Morphological features as well as temporal, i.e., kinetics features,are combined to compute a consolidated assessment of a possible lesion detectedin the medical images. The system includes at least one kinetics module, whichis capable of extracting kinetics features from a time sequence of MRI imagesor MRS data taken after administering a contrast enhancement agent to a patient.The consolidated assessment is presented to a user for confirmation or modification.