The present invention provides a taste improvement agent that can be obtained from extraction residues of coffee by using a simple and easy method and can impart comprehensive taste to a drink or food a food or drink containing the taste improvement agent and a method of improving the taste of a food or drink. The present invention relates to a taste improvement agent for a food or drink, which is obtained from an extraction residue of a coffee.