A worker management apparatus includes: a work performance information generation unit generating work performance information representing a performance state of work by a worker; an acquisition unit acquiring physical information representing a physical condition relating to the worker; an estimation unit estimating an influence of the physical condition upon the performance state, based on the work performance information, the physical information, and information representing a characteristic of the worker; and an improvement measure generation unit generating improvement measure information representing a measure to improve the performance state relating to the worker, according to an estimation result by the estimation unit, thereby presenting a suitable measure to improve the work performance of the worker by managing with high precision the work performance state and physical condition relating to the worker.