A cable retaining insert is configured to be used with a plate member of a bone plate assembly. The cable retaining insert includes a top side and an opposite bottom side, a first portion and a second portion. The first portion is adjacent to the bottom side and includes an engagement structure configured to engage a corresponding engagement structure in the plate member. The second portion is adjacent to the top side and includes at least one cable retaining aperture configured to retain a cable to the plate member. The first portion of the cable retaining insert has a recess at the bottom side for accommodating at least a portion of a head of a bone anchor. Furthermore, a bone plate assembly including a plate member and such a cable retaining insert is provided.