A holding apparatus system for releasably holding injectable fluid bottles, comprising a pair of elongate elements for releasably gripping a neck portion of a bottle, and a retaining structure for permitting the elongate elements to be moved between a closed position configured to grip the neck portion of the bottle and an open position configured to release the neck portion of the bottle from being gripped by the elongate elements. In other embodiments, the elongate elements each have a first end and a second end, and the first ends of the elongate elements being relatively closer together than the second ends of the elongate elements so that the elongate elements diverge toward the second ends. A method of dispensing an injectable substance from a bottle using a bottle holder apparatus is also disclosed.