A modular wick holder includes a first wick holder assembly and a second wick holder assembly joined together. The first and second wick holder assemblies are disposed symmetrical to each other. The first wick holder assembly includes a first projection, and the second wick holder assembly includes a second projection opposite and corresponding to the first projection. The first and second projections delimit a space therebetween. When the modular wick holder combines with a wick, the wick is securely held by the space. At least one adjusting member inserts through the first and second wick holder assemblies and is operable to move the first and second projections closer and to have the space include a reduced size.