A bone anchoring device is provided comprising an anchoring element (1 20) comprising a shank (2 21) to be anchored in a bone or a vertebra a connection element (9) for connecting at least two anchoring elements, the connection element being made of an elastic material a receiving part (3 25) being connected to the shank for receiving the connection element and connecting the connection element to the shank a seat (8 38) for the connection element the seat being provided in the receiving part a locking element (10) being engageable with the receiving part for fixation of the connection element in the seat wherein at least the portion of the connection element (9) which is received in the recess has a substantially smooth surface and wherein the locking element (10) has an engagement structure (12) which contacts the surface of the connection element in such a way that a form-fit connection is provided.