An adapter to be pressed into the neck of a bottle to receive a syringe for accessing the bottle contents by a syringe. The adapter has a distal end that extends into the bottle and a normally closed valve located at that distal end to prevent the contents from leaking out of the bottle if the bottle is inverted. An upper flange of the adapter seats against the top of the bottle and is recessed into the top of the bottle to prevent easy access to pry the adapter out of the bottle. A cap is also disclosed that is adapted to be pressed into the neck of a bottle. The cap has an upper lid that is hinged to a lower body to allow the upper hinge to move between a closed position sealing the bottle and an open position where the bottle is accessible by a syringe.