A device (1) for removing waste from a surface, for example from a floor of an animal shed, comprises a supporting frame (2) which is displaceable across the surface and comprises collecting strips (18) for pushing together waste, and a rotating body (8) which is connected to the supporting frame in a direction of rotation so as to be rotatable about a first rotation axis (11) which is substantially horizontal and directed forwards. The rotating body can be driven by a motor (4). Several shovel scoops (9) for scooping up waste from the surface are attached to the rotating body in the circumferential direction and a distance apart. The shovel scoops, during rotation of the rotating body, move along a path which runs at least partly along the surface between the collecting strips. The shovel scoops each comprise an open end (10) which is directed substantially in the direction of rotation of the rotating body. Furthermore, walls (20) may be provided which provide counterpressure during filling of the shovel scoops.