A surgery assistance system including: a physically suitable jig to be attached to a predetermined attached portion of a body on which surgery is to be performed; and a surgery assistance device which displays an augmented reality image. The physical suitable jig includes: a site fitting unit that can be fitted with the predetermined attached portion; and an image-recognizing unit including features that can be image-recognized to display the augmented reality image with the surgery assistance device.