A system and method for generating high resolution (HR) images from low resolution (LR) images or data by selectively choosing neighbors and the tissue types of the neighbors when estimating the image intensity of a voxel with the values of the neighbors. The system and method may interpolate LR images of a first contrast with the help of the high resolution HR images of a second contrast using the anatomical structures in both sets of images.
