A ground surface information analysis system for analyzing a ground surface using images includes the units 5 of: acquiring two-dimensional image data including information about the regions of materials on a ground surface at plural times; acquiring three-dimensional image data including the configuration information of the ground surface at the plural times; specifying the respective 10 regions of plural types of materials using the acquired two-dimensional image data; generating time-series multi spectrum three-dimensional image data from the respective specified regions of the materials and the configurations specified by the acquired three-dimensional image data as 15 combinations of the plural times and the plural types of materials, where the regions and the configurations correspond to the respective times included in the plural times; and calculating the variation amounts of the respective materials on the basis of plural time data 20 pieces included in the generated time-series multi spectrum three-