Suppository compositions are provided combining a pharmaceutically acceptable matrix material that is solid outside of the human body and in a dry environment, but which melts at body temperature; and apple cider vinegar and one or more species of probiotic bacteria dispersed within the matrix material; wherein the matrix material contains a mixture of fatty acids that are solid at room temperature. Methods for supplementing and nourishing the microbiome of the rectum of a male or female and the microbiome of the vagina of a female are also disclosed. Oral dosage forms of the compositions of the present invention are also provided.