An agricultural vehicle includes a chassis and a header system carried by the chassis. The header system includes a frame; a cutter carried by the frame; a cutter sensor associated with the cutter which outputs a cutter height signal; a gauge wheel carried by the frame behind the cutter; a wheel sensor associated with the gauge wheel which outputs a wheel position signal; an actuator system including actuators which can adjust a height and/or a tilt angle of the frame; and a controller electrically coupled to the cutter height sensor, the wheel sensor and the actuator system. The controller is configured to: receive the cutter height signal; receive the wheel position signal; compare the cutter height signal and the wheel position signal to determine a terrain irregularity is present; and activate one or more actuators to adjust the frame in response to determining the terrain irregularity is present.