A bone anchoring device for anchoring in a bone comprises a hollow shaft having an outer surface including a first portion and a threadless second portion, the second portion having a larger outer diameter and a shorter axial length than the first portion and a barb carrier having at least two barb elements. The shaft and the barb carrier can be moved relative to each other in such a manner that in a first configuration the barb elements of the barb carrier project beyond an outer surface of the shaft by a distance d1, and in such a manner that in a second configuration the barb elements of the barb carrier project beyond the outer surface of the shaft along the second portion of the shaft by a distance of d2, wherein d2>d1.