人機互動的領域在現代被廣泛地運用，在這篇論文中我們設計一個虛擬樂器，主要是使用微軟公司的KINECT感應器，能夠偵測人體的骨架來操作音樂，KINECT本身有限制人體面對KINECT的角度而導致側面無法被偵測，本論文使用骨架當作點雲，並使用三台KINECT來對齊骨架而達到側面也可以被偵測。在樂器中我們使用一顆球作為介面，介面中的球有12個表面並可以彈奏單音或和弦，為了達到12的表面都可以被彈奏，我們使用ICP演算法來對齊三台KINECT讓KINECT側面可以被偵測到，來達到使用者可以盡情的彈奏樂器而不會受到正面彈奏的限制。在介面的部份我們使用OpenGL來做為繪圖的基礎，論文中會介紹基礎的三維觀念和OpenGL基礎，並理解如何創造一顆虛擬球體且放入人體的骨架當作樂器，並介紹MIDI相關的知識與如何使用MIDI來彈奏音樂，最後實驗的部分會顯示出骨架對其的準確度與顯示骨架對齊的圖示。;Human Computer Interaction is wildly used in our life, in this paper we design a virtual instrument by the Microsoft Kinect sensor. Kinect sensor can detect human body by representing a skeleton, and the program use the skeleton to control the music signal. Kinect has human body angle limits, if user’s side face to Kinect then Kinect cannot detect skeleton, this paper uses skeletons as point cloud and calibrate three Kinect to achieve side face detection. In our instrument we use a sphere for interface, inside the sphere has twelve blocks and the user can play a single note or chords. In order to play all of the blocks, we use the ICP algorithm to calibrate three Kinect and the users can the play instrument without side face limits. At program interface we use OpenGL for rendering the objects, and we will introduce the basic three dimensional concepts and OpenGL concept, explains how to put the skeleton inside the sphere and introduce MIDI concept to use MIDI for playing music. Finally the experiment result shows the accuracy of the skeleton in calibration and show the status of skeleton in figures.
