Disclosed is a container, such as a vial or syringe, for storing and/or administering a vaccine composition. The container contains a vaccine composition comprising a Hepatitis B antigen adsorbed on an aluminium adjuvant. The container has inner surfaces coated with polymerized silicone, to reduce desorption of the antigen from the adjuvant. The container is closed by a device acting as a stopper, wherein the surface of the device which is in contact with the composition is coated with a fluoropolymer. A use of a such a container for storing a vaccine composition which comprises Hepatitus B antigen adsorbed on an aluminium adjuvant is also disclosed.