Aspects of the invention relate to beverage compositions, including, for example, concentrated and ready-to-drink beverages, sweetened with rebaudioside D and further including at least one tea extract in an unrecognizable amount sufficient to reduce the off-note taste of the non-nutritive sweetener. In certain embodiments, the tea extract comprises one or more extracts of tea selected from the group consisting of: black tea, oolong tea, green tea, white tea, herbal tea, and citrus tea.