Compositions comprising urea containing fertilizer (e.g., urea fertilizers or urea formaldehyde reaction product fertilizers such as urea-formaldehyde fertilizer or methylene urea fertilizers) and rice hulls, as well as methods of making and using such compositions are provided. In one aspect, the invention relates to compositions comprising rice hulls and a urea containing fertilizer. These compositions show, among other things, less crystal formation and less clumping when stored over time, and reduced loss of usable product (e.g., herbicide), as compared to a urea containing fertilizer not comprising rice hulls.