An optical pumping magnetometer measures a magnetic field of a measurement object using optical pumping. The optical pumping magnetometer includes a nonmagnetic cell in which at least an alkali metal is enclosed and which has optical transparency and heat resistance, a laser beam irradiation unit which radiates a laser beam to the cell and optically pumps at least the alkali metal, a detecting unit which receives a transmission laser beam transmitted through the cell and detects a detection signal related to the magnetic field, and a high frequency voltage applying unit which applies a high frequency voltage to a pair of application units provided on the cell and heats the cell by dielectric heating.