PROBLEM TO BE SOLVED: To generate depth estimation data for performing 2D/3D conversion in which a sense of incongruity is reduced, and a failure is not conspicuous.SOLUTION: In a depth estimation data generation device for generating depth estimation data from a non-stereoscopic image which is not given depth information explicitly or implicitly like a stereo image, a temporary depth estimation data generation part generates temporary depth estimation data on the basis of an input non-stereoscopic image, and a determination part determines whether or not the non-stereoscopic image is an image photographed by a camera, and a second addition part adjusts the gain of the temporary depth estimation data on the basis of the determination result of the determination part, and generates depth estimation data.