This invention provides a hair dye composition which is easy to stain and fade, comprising pigment, oxidant, reductant, and water, wherein the pigment is Millettia Dielsiana extract, Eclipta prostrata extract, or a combination thereof, extracted from plants like Millettia Dielsiana, Eclipta prostrate, etc. to obtain plant pigment to replace the aminophenol ingredient in ordinary hair dye while reducing the use amount of p-phenylenediamine. Therefore, the use of aniline and phenol compounds can be significantly reduced to obtain a hair dye composition which has low irritation and good color fastness and is easy to stain and fade.