A clear image of a target to be measured is obtained by suppressing influence of a reflected beam from the surface of the target or a measurement target holding unit. A laser beam emitted from a light source is split into a signal beam, reference beam, and control beam. The signal beam is focused onto the target with an objective lens, so the target is irradiated with the signal beam. The amount of defocus of the control beam is controlled with a defocus control unit, and the phase of the control beam is controlled with a phase control unit. A signal beam reflected or scattered by the target is combined with the control beam to generate a controlled signal beam, and the controlled signal beam is combined with the reference beam. A plurality of interference beams with different phases are generated with interference optics, and phase diversity detection is performed.