The present application relates to a rinse-off composition comprising an oil phase and an aqueous surfactant matrix, wherein one or more active agents are dissolved in one or more non-polar, water-immiscible solvents, and the oil phase is dispersed in the aqueous surfactant matrix. The present application also relates to methods of delivering the active agent(s) to a subject in need thereof topically, for example to the skin, the hair, and scalp. The present application also relates to use of the rinse-off compositions to treat and/or prevent topical conditions such as dermatitis and psoriasis. In some embodiments, the rinse-off compositions of the present application are shampoo compositions.