A three-dimensional shape measurement device of the present invention, includes an imaging unit sequentially outputting a captured predetermined two-dimensional image (hereinafter, referred to as a first two-dimensional image), while outputting another two-dimensional image (hereinafter, referred to as a second two-dimensional image) with a setting different from that of the captured first two-dimensional image, according to an output instruction. An output instruction generation unit generates the output instruction on the basis of a shape defect rate in viewing a three-dimensional model from the perspective of having captured the first two-dimensional image, the three-dimensional model being based on the second two-dimensional image outputted by the imaging unit, and a storage unit stores the second two-dimensional image outputted by the imaging unit.