應用Kinect之人體多姿態辨識; Human's posture recognition by using Kinect

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Electrical Engineering > Electronic Thesis & Dissertation > Item 987654321/48425

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/48425

Title:	應用Kinect之人體多姿態辨識;Human's posture recognition by using Kinect
Authors:	黃識夫;Shih-fu Huang
Contributors:	電機工程研究所
Keywords:	人體姿態辨識;Kinect;Posture recognition;Kinect
Date:	2011-07-01
Issue Date:	2012-01-05 14:54:28 (UTC+8)
Abstract:	本論文的研究目的為應用裝設於房間內的 Kinect 感測器擷取目標人體，辨識五種人體姿態，並應用水平投影量、星狀骨骼化、類神經網路、相似特徵處理的技術，來加以辨識五種人體姿態，站姿、坐姿、彎腰、跪姿以及躺姿。當Kinect 抓取到人體影像後，藉由深度資訊的改變，把人體形狀輪廓從背景中分離出來。接著使用水平投影量來辨識姿態是否為跪姿；如不為跪姿，則使用星狀骨骼化計算出五組由人體重心點至輪廓特徵點的特徵向量。五組的特徵向量與深度資訊為 Learning Vector Quantization (LVQ) [20]類神經網路的輸入，以訓練姿態辨識的權重值；接著LVQ網路的輸出可辨識站姿、正向坐姿、非正向坐姿、彎腰以及躺姿。對於站姿與非正向坐姿，將會經過相似特徵處理程序，藉由水平與垂直投影量，濾除手部干擾，計算出人體長寬比再加以辨識，以提高辨識率。姿態辨識系統在不同的室內環境下，對於不同體型、距離 Kinect 遠近不同的人體，都可達到即時且穩定的姿態辨識。因此辨識系統可實際應用在居家看護與遊憩環境照顧。 The objective of this study is to recognize human’s five postures which are captured from the set of Kinect. By using horizontal projection, star skeleton, neural network, and similar feature process techniques, five human’s postures, which contain standing, sitting, bending, keeling and lying, are recognized. After Kinect captures the picture of a human, a silhouette contour of the human is segmented from the background based on the difference of depth data between the human’s body and background. Then the horizontal projection is utilized to identify whether the posture is keeling or not. If it is not a kneeling posture, a star skeleton is used to calculate five maximum distances from the feature points to the centroid of the human body. The five branches of the star skeleton and depth data are the inputs to train the network of Learning Vector Quantization (LVQ). Subsequently, the outputs of the LVQ are utilized to recognize the five postures including standing, forward sitting, non-forward sitting, bending, and lying. The standing and non-forward sitting postures are processed by the similar feature process based on the horizontal and vertical projection. The hand-shaking disturbance is filtered to calculate the length and breadth ratio of human so as to improve the ratio of posture recognition. The posture recognition system can not only be applied to different indoor environments and different distances between Kinect and human, but also achieve the goal of real-time and stable posture recognition for different human physiques. Therefore, the system can be practically applied to home nursing and amusement place care.
Appears in Collections:	[Graduate Institute of Electrical Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	1099	View/Open

社群 sharing

Loading...