Systems and methods of integrating a virtual prosthesis with a tissue model are presented. Tissue characteristics and prosthesis characteristics can be leveraged to construct observable tissue models that present a model of mutual deformation, especially a time-varying mutual deformation, of a tissue and a possible prosthesis. The mutual deformation indicates how the tissue and prosthesis impact each other over time, possibly on a voxel-by-voxel basis based on deformable registration techniques.