Systems and methods are provided for evaluating an eye of a patient. A first imager interface receives a first image of at least a portion of the eye generated via a first imaging modality, and a second imager interface receives a second image of at least a portion of the eye generated via a second imaging modality. A first feature extractor extracts a first set of numerical features from the first image, with one feature representing a spatial extent of one of a tissue layer, a tissue structure, and a pathological feature. A second feature extractor extracts a second set of numerical features from the second image, with one feature representing one of a number and a location of vascular irregularities within the eye. A pattern recognition component evaluates the first plurality of features and the second plurality of features to assign a clinical parameter to the eye.