An electrical plug in fragrance dispenser can include a removable decorative sheath. The dispenser can be configured so that, when the sheath is attached, an electrical outlet is completely covered. In this way, the dispenser will have the appearance of a more permanent decorative light fixture. The dispenser can also be configured to plug into two outlets of an electrical receptacle thereby increasing the stability of the dispenser when attached to the wall or other surface. The dispenser may also include an outlet so that the receptacle can still be used when the dispenser is secured overtop the receptacle.