In one aspect, a system for adjusting operating parameters of an agricultural harvester based on estimated crop volume values may include an image capture device configured to capture one or more images of the crop materials standing within the field prior to the crop materials being harvested by a harvester. The system may also include a controller communicatively coupled to the image capture device. The controller may be configured to estimate a crop volume value associated with a quantity of the crop materials transferred through the harvester based on the one or more images captured by the image capture device. Additionally, the controller may be further configured to initiate a control action associated with adjusting an operating parameter of the harvester based on a magnitude of the estimated crop volume value.