A rod insertion device for inserting a rod into a bone anchor includes a shaft having a first end, a second end, and a shaft axis a rod holding member connected to the first end of the shaft and configured to pivot relative to the shaft about a pivot axis and to receive a portion of a rod therein, the rod holding member comprising at least two recesses in an outer surface of the rod holding member and separated from each other along a circumferential direction about the pivot axis a handle at the second end of the shaft a locking member configured to lock an inserted rod in the rod holding member and a detent member configured to selectively engage the rod holding member to latch a pivot position of the rod holding member relative to the shaft.