The present model provides an inspection and judgment system that combines optical and thermal images, including: an optical receiving unit, which receives optical image information of a field; a thermal energy receiving unit, which receives thermal image information of the field; The optical image information is processed to capture optical image features, the thermal image information is processed according to the second model to capture thermal image features, and the optical image feature and the thermal image feature are combined according to the third model to obtain Coupling characteristics, and obtaining the possibility of different situations in the field, and obtaining the most likely inspection and judgment result; and a display unit to display the inspection and judgment result.本新型提供一種結合光學影像與熱影像的檢查判斷系統,包括:光學接收單元,接收一場域的光學影像資訊; 熱能接收單元,接收該場域的熱影像資訊; 運算單元,根據第一模型對該光學影像資訊進行處理以擷取光學影像特徵,根據第二模型對該熱影像資訊進行處理以擷取熱影像特徵,根據第三模型對該光學影像特徵與該熱影像特徵進行合併處理以取得耦合特徵,並得出該場域不同情況之可能性,且得到最有可能的檢查判斷結果;以及 顯示單元,顯示該檢查判斷結果。