許多過去的相關研究表明，身體動作可以促進學習者的學習過程。我們開始考慮將肢體反應教學法和技術相結合，以提高他們的英文能力。在這項研究中，我們開發了一個基於Microsoft Kinect 的系統，並整合五個識別機制，包括身體運動辨識、語音辨識、臉部辨識、方向辨識和物體辨識，這種機制有助於學習者通過動作和姿勢來理解英文單字的含義。我們在系統中設計兩個主要模塊，一個是學習模塊，另一個是動覺辨識機制。 實驗組採用雙人合作模式，另一方面，對照組採用單人模式。在實驗組中，學習者必須相互合作，為了使學習者更容易合作和討論，因此我們以面對面的方式進行活動。在硬體部署框架中，每位學習者都有一台電腦、KinectV2、螢幕和耳機。此外，我們使用資料庫儲存學習者的學習行為，建構伺服器用於數據傳輸，以便學習者可以在活動中進行合作和互動，結果表明，該系統可以提高學習者在英語寫作、發音和詞彙記憶方面的表現，並且我們發現兩人合作的使用優於個人。;A number of past-related studies have revealed that physical movements could facilitate the learner’s learning process. We came to think of combining Total Physical Response and technology to enhance their English ability. In this research, we developed a system based on Microsoft Kinect and integrated five components, physical movement recognition, speech recognition, emotion recognition, direction recognition, and object recognition. This mechanism helps the learners go through the meaning of vocabularies through physical movements. We designed two main modules in our system. One is the learning module, and another is kinesthetic recognition mechanism. For the experimental group, a two-person cooperation mode is adopted, on the other hand, a single play mode is adopted for the control group. In the experimental group, learners cooperate with each other to help. In order to make it easier for learners to cooperate and discuss. we conducted the activities in a face-to-face manner. In the hardware deployment framework, each learner has one computer、KinectV2、screen and headset. In addition, we use the database to store the learner′s learning behavior and construct a server for data transfer so that learners can cooperate and interact in the activities. The results show that the system can improve the learner′s performance in English writing,pronunciation and the memorization of vocabulary.
