An optical image measurement device comprises: a light source configured to emit a low-coherence light an interference-light generator configured to generate an interference light, by splitting the low-coherence light into a signal light and a reference light, and superimposing the signal light passed through a measurement object and the reference light passed through a reference object a changer configured to change a difference in optical path length a detector configured to detect the interference light an image forming part configured to form an image of the measurement object within a predetermined frame based on the result of the detection an analyzer configured to analyze the image, and specify a position of the image within the frame and a controller configured to control the changer based on the specified position to change the difference so that an image newly formed is placed in a predetermined position within the frame.