English  |  正體中文  |  简体中文  |  全文筆數/總筆數 : 96218/96218 (100%)
造訪人次 : 93572030      線上人數 : 195
RC Version 7.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.
搜尋範圍 查詢小技巧:
  • 您可在西文檢索詞彙前後加上"雙引號",以獲取較精準的檢索結果
  • 若欲以作者姓名搜尋,建議至進階搜尋限定作者欄位,可獲得較完整資料
  • 進階搜尋


    請使用永久網址來引用或連結此文件: https://ir.lib.ncu.edu.tw/handle/987654321/111147


    題名: 輕量化時序建模之可部署即時手勢辨識;Deployable Real-Time Hand Gesture Recognition Using Lightweight Temporal Modeling
    作者: 林光榮;HALIM, DICKY PRAYOGA
    貢獻者: 資訊工程學系
    關鍵詞: event camera;hand gesture recognition;human-computer interaction;real-time inference
    日期: 2026-08-20
    上傳時間: 2026-10-20 17:00:21 (UTC+8)
    出版者: 國立中央大學
    摘要: 手勢辨識是自然人機互動中的重要技術,能讓使用者在不依賴滑鼠或鍵盤等實體輸入裝置的情況下傳達指令。然而,許多以傳統影像相機為基礎的手勢辨識系統容易受到動態模糊、光照變化、背景冗餘資訊以及較高運算成本的影響,因此在即時與資源受限硬體上的實際部署仍受到限制。

    本論文提出一套使用事件相機與輕量化時間建模的端到端即時手勢辨識流程。系統首先將非同步事件資料轉換為以極性為基礎的影像表示,接著以步長為 3 的方式進行時間取樣,並將 30 張取樣後的事件影像組成一個輸入片段,約涵蓋 2.97 秒的動作時間脈絡。模型輸出包含四個類別:石頭、布、剪刀與其他。本文評估三種輕量化時間模型變體,並加入空間--時間基準模型作為補充比較。訓練後的模型透過最佳化推論後端部署,並在不同一般硬體平台上以中央處理器與圖形處理器執行環境進行測試。

    最終未見測試資料集包含 672 個片段,涵蓋一般室內辦公光源與低光源兩種環境。最佳模型達到 99.26% 的辨識準確率與 99.27% 的巨集 F1 分數。在較高效能硬體上,圖形處理器加速使所有評估之時間模型變體皆能滿足 495 毫秒的即時門檻;而在較低功耗硬體上,最小模型變體則具有最實際的延遲表現。實驗結果顯示,當模型複雜度、推論後端與硬體能力一併納入考量時,事件相機手勢辨識系統能同時達成高辨識率與實際即時部署能力。;Hand gesture recognition is an important component of natural Human-Computer Interaction because it enables users to communicate commands without physical input devices. However, many RGB-based systems are affected by motion blur, illumination variation, background redundancy, and high computational cost, which can limit real-time deployment on resource-constrained hardware.

    This thesis proposes an end-to-end real-time hand gesture recognition pipeline using an event camera and lightweight temporal modeling. Asynchronous event streams are converted into polarity-based frame representations, temporally sampled with a stride of 3, and grouped into 30-frame clips representing approximately 2.97 seconds of motion context. The clips are classified into four classes: rock, paper, scissors, and others. Three lightweight temporal model variants were evaluated, and supplementary spatial-temporal baselines were included for comparison. The trained models were deployed using an optimized runtime backend with CPU and GPU execution on different commodity hardware platforms.

    The final unseen test set contained 672 clips recorded under office-lighting and low-light conditions. The best model achieved 99.26% accuracy and 99.27% macro F1-score. GPU acceleration enabled all evaluated temporal variants to satisfy the 495 ms real-time threshold on stronger hardware, while the smallest variant provided the most practical latency profile on lower-power hardware. These results show that event-camera-based gesture recognition can achieve high accuracy and practical real-time deployability when model complexity, runtime backend, and hardware capability are considered together.
    顯示於類別:[資訊工程研究所] 博碩士論文

    文件中的檔案:

    檔案 描述 大小格式瀏覽次數
    index.html0KbHTML8檢視/開啟


    在NCUIR中所有的資料項目都受到原著作權保護.

    社群 sharing

    ::: Copyright National Central University. | 國立中央大學圖書館版權所有 | 收藏本站 | 設為首頁 | 最佳瀏覽畫面: 1024*768 | 建站日期:8-24-2009 :::
    DSpace Software Copyright © 2002-2004  MIT &  Hewlett-Packard  /   Enhanced by   NTU Library IR team Copyright ©   - 隱私權政策聲明