A polyaxial bone anchoring device is provided including an anchoring element (1) hav ing a shank (2) for anchoring in the bone and a head (3),a receiving part (5, 5) for receiving the head of the bone anchoring element and for receiving a rod (100), the receiving part includingan upper member (8, 8) with a top end (81) and a bottom end (82), a central axis(C) extending through the top end and the bottom end, a head receiving portion (84) with a passage (85) at the bottom end (82) for introducing the head and a channel (86)for receiving the rod at the top end (81)a lower member (10, 10) having a top end (101) and a bottom end (102) and a passage (103, 104) extending from the top end to the bottom end, the lower member being connectable to the upper member from the bottom end (82) of the upper memberwherein at least one clamping member (20, 200) is provided at or near the bottom end (82) of the upper member and wherein the clamping member (20, 200) is configured to reduce the diameter of the passage (85) of the head receiving portion (84) of the upper member (8, 8) when the lower member is connected to the upper member such as to hold the head (3) when the head is inserted in the head receiving portion (84).