For liver modeling from medical scan data, multiple modalities of imaging are used. By using multiple modalities of imaging in combination with generative modeling, a more comprehensive and informed assessment may be performed. The generative modeling may allow feedback of effects of proposed therapy on function of the liver. This feedback is used to update the liver function information based on the imaging. Based on the computerized modeling with information from various imaging modes, an output based on more comprehensive information and patient personalized modeling and feedback may be provided to assist the physician.