A method and an apparatus for providing panoramic image data by reconstructing frame images captured by a panoramic imaging apparatus, are disclosed. In reconstruction of images with multiple image layers, sizes of images reconstructed with an image layer or images to be used for a reconstruction are scaled. An image is selected by analyzing sharpness. A panoramic image is provided by combining selected image. According to the present invention, parts having unclear focal planes may be completely removed in a panoramic image and it is possible to provide an image including only with focused regions.
