A new and distinct variety of Buddleja plant named ‘Miss Violet’ substantially as illustrated and described, characterized by its compact stature, dense and semi-upright growth habit, oblong-elliptic leaf shape, violet flower color, distorted male flower parts (anthers) resulting in male sterility, and female structures that show reduced function, resulting in reduced seed formation.