An interactive training and testing apparatus is provided, including: a first three-dimensional imaging device, capturing an environmental information of a virtual scene； a gesture detector, detecting a first operating gesture to generate a first control signal corresponding to the first operating gesture； a database, storing at least one training script and at least one test script； a processor, connecting with the first three-dimensional imaging device, the gesture detector and the database, and loading the environmental information, the processor choosing one of the at least one training script and the at least one test script to display the virtual scene and a plurality of virtual targets which are in the virtual scene on the first three-dimensional imaging device, and the processor is controllable the at least one virtual targets according to the first control signal and the at least one virtual targets generating an interaction feedback.本發明關於一種互動式訓練及檢測裝置，其包括一第一立體影像裝置，其擷取一虛擬場景之一環境資訊；一手勢辨識器，其感測一第一操作手勢而產生一相對應之第一控制訊號；一資料庫，其儲存至少一訓練腳本資料及至少一檢定腳本資料；一處理器，其連接該第一立體影像裝置、該手勢辨識器及該資料庫，讀取該環境資訊並依據選擇該至少一訓練腳本資料或該至少一檢定腳本資料，使該第一立體影像裝置顯示該虛擬場景及複數建立於該虛擬場景中之虛擬目標，該處理器根據該第一控制訊號控制至少一該虛擬目標並產生一互動結果。
