Provided is a method and system of processing a multi-energy X-ray image. Through the method and system, a plurality of target images may be acquired using an X-ray detector enabling an energy separation to be performed in a predetermined time interval, with respect to a target where a contrast agent is applied, and a signal processing may be performed on the acquired target images, thereby detecting and reading benign/malignant lesions or masses.