Dietary supplements comprising one or more probiotic bacteria or probiotic yeast in an oil with calcium phosphate added are provided. The calcium phosphate substantially reduces clumping and/or settling of the probiotic in oil. Other additives, such as anti-oxidants and taste enhancers, may be added to the compositions.