A method and apparatus for utilizing mammogram images for verification, including obtaining one or more mammogram image of a patient determining a first set of breast characteristics from the one or more mammogram image, wherein the first set of breast characteristics include breast landmark, breast tissue density, tissue pattern and breast finding comparing the first set of breast characteristics with a second set of breast characteristics to yield a comparison, wherein the second set of breast characteristics is from one or more previous mammogram image identified as potentially belonging to the patient using an identification not related to content of a mammogram image and determining based on the comparison whether the one or more previous mammogram image belongs to the patient.
