The object of the present invention is to provide a method of manufacturing solid milk having better water solubility and keeping suitable hardness even when the powdered milk, which is hard to mold, with low free fat is used. Solid milk has been manufactured by using powdered milk having small particle diameter which was passed through a sieve in order to obtain homogeneous solid milk. The present invention is based on the knowledge that solid milk having suitable hardness and water solubility can be obtained by using powdered milk having large particle diameter which have not been used for manufacturing the solid milk because it has been sieved.