An intervertebral device for spacing apart vertebral members comprises a plurality of stackable shims including at least a first shim and a second shim. The first shim includes a first body with a first portion of a male-female connector, and a removable guide that is affixed to the first body and extends along at least a portion of the first body. The second shim includes a second body with a second portion of the male-female connector. A longitudinal passage extends through the second body and is sized to receive the guide on the first body. The second shim is moveable relative to the first shim with the guide disposed in the passage between a disengaged position and an engaged position. In the engaged position, the first shim is stacked on the second shim.