A system and method for generating a 3D model of patient anatomy, including for example, a bone, soft tissue, or the like. A system may include a thermal image camera to generate a thermal image, an x-ray device to capture an x-ray image of a bone of a patient, and a processor coupled to memory. The processor may perform operations including generating a thermal map of the patient anatomy from the thermal image, and generate a 3D bone model of the bone from the x-ray image. A machine learning technique may be used to generate a 3D model of the patient anatomy including for example, the bone, soft tissue, or the like. The 3D model may be output for display.
