Methods and systems for controlling earth moving equipment are described. In some embodiments, a stream of images may be captured using at least one imaging system. At least one state of soil may be determined in real time relative to the earth moving equipment based on the captured stream of images. At least one aspect of the earth moving equipment's operation may then be controlled based on the determined at least one state of the soil.