An anchoring device for anchoring a rod in a bone or a vertebra and for use with at least two rods having a different diameter is provided, the anchoring device (120) having a shaft (222) and a head (425) for connection to one of said rods (10), said head (425) being connected to said shaft (222) and having a recess (531) with a base (1140) and two substantially vertically enxtending legs (6,7 32,33 38,39) defining a channel for receiving the rod in said channel, and a fixation element (5270) for clamping said rod (10) in said channel, wherein said fixation element and said base each have a contact surface (11405373) contacting said rod, the contact surfaces being shaped so as to be able to clamp any of the different rods.