A bone harvesting device has a probe and a sleeve for surrounding the probe. The probe has a shaft and a handle coupled to an end of the shaft. The sleeve is a cylindrical shaft that slidably receives the probe. A second handle is coupled to the shaft. In use, the probe and sleeve are driven through tissue until the probe contacts a bone harvest site. The probe is then removed and the sleeve is pounded into the bone to harvest a bone graft. The probe may be hollow and have fenestrations so that it may also be used to harvest bone marrow.