A method of forming an ocular delivery device includes exposing a solid, shaped cellulose polymer to a solution including an active pharmaceutical ingredient (API) and a solvent capable of solubilizing the API, wherein the polymer absorbs at least a portion of the solution, including the API and solvent. The method may further include removing at least a portion of the absorbed solvent from the polymer by allowing the absorbed solvent to evaporate from the polymer or by drying the polymer. A variety of cellulose polymers may be used, including hydroxypropyl cellulose. A variety of APIs may be used, including Cyclosporine, Tobramycin and Vancomycin. Ocular delivery devices prepared by the methods may be used to treat a variety of eye disorders.