A fragrance container with a container body provided with a bottom bracket permeable to interior air of the container near a bottom opening. A top cover having a shutter within an interior of the container body near a top opening with a fragrance substance contained in the container body between the bottom bracket and the top cover. An outer peripheral portion of the container body near the bottom opening is covered with an indexing collar for adjusting the degree of opening of an intake port of the container body. A fragrance diffuser includes an air pump, a fragrance container retainer connected to the air pump, and at least one fragrance container received in the retainer. The fragrance containers communicate with each other, wherein each of the fragrance containers contains the same type of fragrance substance with the same smell or a different type of fragrance substance with a different smell.