PROBLEM TO BE SOLVED: To provide a processing method which distinguishes numerical information obtained from images to correspond to the kind of measuring instruments or physical data.SOLUTION: The image data processing method includes: (500) storing a caught image data in a memory (114) (518) extracting numerical information from the image data (520) extracting a shape feature from the image data selecting a shape feature similar to the extracted shape feature from among a plurality of shape features which are stored in the memory and relate to the displays of a plurality of physical data measuring instruments deciding the kind of a physical data measuring instrument to correspond to the selected shape feature deciding a measurement data represented by the numerical information based on the decided kind and (522, 524) storing the measurement data in the memory so as to correspond to the decided kind.