Solid and semi-solid formulations are used for supralingual administration of vaccines to animals. The formulations, which comprise antigens dispersed in a solid or semi-solid matrix, or paste, are delivered via supralingual applicators. The supralingual applicators are designed so as to position the antigen-containing matrix directly on the dorsal surface of the tongue during vaccine delivery. Upon exposure to saliva and to suckling and/or licking action of the tongue, the matrix dissolves and releases antigens to the tongue. In some embodiments, the antigens are viruses, for example, attenuated viruses that are capable of infecting cells of the tongue, e.g. canine parvoviruses which infect basal tongue cells. The supralingual applicators are especially useful for the delivery of vaccines to newborn animals.