A system (26) for monitoring a residue coverage (82) on a surface (14) of an agricultural field (12) includes a controller configured to receive a signal indicative of the residue coverage on the surface (14) of the agricultural field (12) from a sensor. The controller is also configured to determine the residue coverage (82) on the surface (14) of the agricultural field (12) based on the signal, in which the residue coverage (82) includes a percentage of the agricultural field (12) that is covered by residue. In addition, the controller is configured to output a control signal (92) indicative of a set of settings to a residue control system (44) based on the residue coverage (82).