A bone anchoring device is provided comprising a bone anchoring section (6, 21) for anchoring in a bone or a vertebrae, a receiving part (7, 24) for receiving a connection element (3), a connection element (3) which is at least partly made of a flexible material, a fixation element (5) for fixing the connection element (3) in the receiving part (7, 24), and wherein a sleeve (4) is provided around the connection element (3) in the receiving part.