In one aspect, a system for operating an agricultural harvester may include a sensor assembly configured to detect a parameter indicative of an operating line of the harvester. The system may also include a controller configured to monitor the operating line of the harvester based on measurement signals received from the sensor assembly when the harvester is operated in a first operating mode. The controller may also be configured to determine a differential between the operating line and a predetermined guidance line of the harvester. Furthermore, the controller may be configured to update a stored correction value based on the determined differential. Additionally, when the harvester is switched from the first operating mode to a second operating mode, the controller may be configured to adjust a location of the predetermined guidance line based on the stored correction value.