A needle delivery device 10 comprises a device body 12 that has an opening 14 formed on a delivery surface 16 of the device body 12. The needle delivery device 10 also includes a drive mechanism 28 which is configured to, in use, drive a needle 20, at least a portion of which is flexible, along a needle path 30 towards the opening 14. The needle path 30 changes direction as it reaches the opening 14. Furthermore, the needle delivery device 10 may include a rigid support member 32 that is fixedly secured to the device body 12 at the opening 14. The rigid support member 32 may be configured to guide the needle 20 as it leaves the opening 14 so as to prevent buckling of the needle 20. A vial 40 of fluid may be included, said vial moving in tandem with the needle. The guide member may comprise a roller or pulley.