In a method and an apparatus to visualize nuclear medicine data from different modalities in a single image, image data sets acquired with different modalities are aligned with a data set representing corresponding anatomical data. The image data in each data set are segmented into separate regions, representing respective structures of interest, with reference to a segmentation derived from anatomical data. For each region, a corresponding segment of image data is selected from a selected image data set. The selected segments of the image data set are combined to generate a multi-fused image of the regions, by applying spatially dependent look-up tables to the multiple image data sets, thereby to determine whether each data set is hidden or displayed in each region.