應用虛擬實境為言語復健工具;Application of virtual reality as a tool in speech rehabilitation

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Electrical Engineering > Electronic Thesis & Dissertation > Item 987654321/90028

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/90028

Title:	應用虛擬實境為言語復健工具;Application of virtual reality as a tool in speech rehabilitation
Authors:	陳仕哲;Chen, Shih-Che
Contributors:	電機工程學系
Keywords:	虛擬實境;語音識別;言語復健;Virtual Reality;Speech Recognition;Speech Rehabilitation
Date:	2022-08-22
Issue Date:	2022-10-04 12:08:29 (UTC+8)
Publisher:	國立中央大學
Abstract:	大部分言語復健治療都需要治療師透過工具及特別設計的課程去引導病患進行訓練，以增進他們的語言能力，但這往往需要大量的時間以及人力，在科技進步且勞動力不足的現今，利用科技來取代人力成為各領域的目標，因此本論文便使用虛擬實境技術讓使用者得到更有效且有趣的復健治療，並且將對象設定為自閉症及失語症患者，開發出一套基於虛擬實境的言語復健系統。本系統是一個能讓治療師自由編輯情境內容的言語復健工具，並且系統中提供了三個建構好且不同難度的情境可供參考及使用，系統中已經建構好了12個虛擬人物以及13個不同的場景提供治療師選擇，情境內可以設置最多20句的虛擬人物台詞，並且可以根據治療師的需求在有需要的句子加入關鍵字反饋，自由設定多組關鍵字去判斷使用者的回話是否正確，透過與虛擬人物對話的方式讓使用者提升語言能力，境結束後也有各項系統的評估，包含了花費時間、反饋次數、回答字數、跳過次數等等，能夠讓使用者及治療師知道使用者在該情境中的表現，旁邊的文字稿也能提供檢視，讓治療師能夠完整得知情境中的所有對話內容。為了評估本系統的使用效果，本實驗讓20名受測者(17男3女平均23.9歲，無語障正常人)實際體驗了三個難度不同的情境，並在體驗結束後填寫遊戲體驗量表，從結果可以看到簡單情境的平均花費時間為69.3秒，普通情境為69.7秒，困難情境則為80.2秒，受測者所花費的時間都比預想的還多，因此在系統評估成績的配分標準可以做些微調，此外增加更多元的關鍵字能讓系統更加完善，在遊戲體驗量表的結果也可以看到，前五個項目都拿到4.5以上的分數，負面情緒也只有1.25分，代表受測者對於本系統的滿意度是相當高，並且他們認為本系統的使用很容易上手且體驗起來非常有趣。 ;Most speech rehabilitation therapy requires therapists to train patients through tools and specially designed courses to improve their language skills, but it often requires a lot of time and manpower. With the advancement of technology and the shortage of labor force, the use of technology to replace manpower has become the goal of various career fields. Therefore, this paper uses virtual reality technology to make users get more effective and interesting rehabilitation treatment. We set the subjects as autism and aphasia patients, and develop a speech rehabilitation system based on virtual reality. This system is a speech rehabilitation tool that allows therapists to freely edit the content of the situation, and the system provides three well-constructed situations with different levels of difficulty for reference and use. 12 virtual characters and 13 different scenes have been constructed in the system for therapists to choose from, and therapists can set up to 20 sentences of virtual characters speech in the custom situation. The system can add keyword feedback to the sentence according to the needs of the therapist, and therapists can freely set multiple sets of keywords to evaluate whether users′ replies are correct. The way of talking with virtual characters makes users improve their language skills. After the situation is over, there are various evaluations from the system, including the time spent, the number of feedback, the number of words answered, the number of skips, etc. These allow users and therapists to know how did users perform in the situation. The results screen has a transcript for viewing, allowing therapists to understand all the conversations in the situation. In order to evaluate the effect of this system, this experiment let 20 subjects (17 males and 3 females with an average age of 23.9 years, normal people without speech impairment) actually experience three situations with different difficulty and fill in the game experience questionnaire after the experience. From the results, we can see that the average time spent in simple situation is 69.3 seconds, the average time spent in normal situation is 69.7 seconds, and the average time spent in difficult situation is 80.2 seconds. The subjects spent more time than expected, so the distribution standard of the system assessment scores can be fine-tuned. In addition, adding more diverse keywords can make the system more complete. It can also be seen from the results of the game experience questionnaire that the first five items all scored above 4.5, and the negative emotion item was only 1.25. It means that the subjects are quite satisfied with the system, and the subjects thought the system is easy to use and very fun to experience.
Appears in Collections:	[Graduate Institute of Electrical Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	29	View/Open

社群 sharing

Loading...