A rod insertion device for inserting a rod into a bone anchor is provided, the rod insertion device comprisingan shaft (1) having a first end (1a) and a second end (1b) and a shaft axis (S),a rod holding member (2) connected to the first end of the shaft (1) and configured to pivot relative to the shaft around a pivot axis (P), the rod holding member being further configured to receive a portion (101) of a rod (100) therein, wherein the rod holding member comprises at least two recesses (25a, 25b) that are provided in an outer surface (2b) of the rod holding member and that are separate from each other in a circumferential direction about the pivot axisa handle (3) provided at the second end of the shafta locking member (4) that is configured to engage the rod holding member to lock an inserted rod in the rod holding membera detent member (5) that is configured to selectively engage the at least two recesses of the rod holding member to latch a pivot position of the rod holding member relative to the shaft.