A stereoscopic image shooting and display system has a left-right pair of image pickup sections having a left-right pair of optical systems with a parallax, and an image processing section which performs predetermined image processing on left and right images picked up through the left-right pair of image pickup sections and parallactically different from each other, and which outputs the processed images to a display section to display the images as a stereoscopic image. When a region corresponding to a region difficult for an observer to observe is detected, the image pickup sections or the image processing section is controlled so that the region becomes easy-to-observe state.