| 摘要: | 本論文旨在設計一個基於深度學習的網路架構來進行3D醫療護具的再構建與變形，分別針對三種不同的病症構建出其相應的3D醫療護具，手的部分為媽媽手及腕隧道，腳的部分為鞋墊。現階段製作3D醫療護具的方式為針對每位病患不同大小的手、腳手動進行繪製，相當耗費時間及人力，因此本文透過深度學習的方式訓練一個AutoEncoder自編碼網路，讓網路自動構建出符合輸入資料尺寸的3D醫療護具，節省中間人工繪製的時間，達到精準且有效率製作3D醫療護具的目的。
本文以自身手、腳的3D掃描資料當作訓練資料，然後以人工的方式繪製訓練資料相應的3D醫療護具當作訓練ground truth，接著對資料進行表面平均採點的動作，讓訓練資料及訓練ground truth皆以點雲資料的形式輸入到自編碼網路中進行訓練，網路在編碼及解碼的過程中會學習中間層latent code的主要特徵，隨著網路訓練次數的增加，解碼器再構建出來的結果會越來越接近ground truth，網路訓練完成後會保留該訓練權重，接著我們縮放及旋轉自身手、腳的3D掃描資料當作測試資料，然後一樣以點雲資料的形式輸入到已經訓練好的自編碼網路中，網路會使用訓練好的權重對測試資料進行3D醫療護具再構建與變形的動作，網路輸出即為符合該測試資料尺寸的點雲形式的3D醫療護具，為了評估網路再構建的輸出結果好壞，我們使用MMD-CD及JSD兩種驗證指標對其進行驗證，最後將點雲形式的3D醫療護具還原成面的形式再透過3D列印機將網路再構建的3D醫療護具打印出來。
;The purpose of this dissertation is to design a network architecture based on deep learning to reconstruct and deform the 3D medical protector. There are three different types of protector to target the de Quervain Syndrome, carpal tunnel syndrome for hands and insoles for correcting feet, respectively. Usually, traditional methods in protector production are that designers draw the protectors manually, which spend a lot of time. Hence, we train an AutoEncoder network to make the 3D medical protector be reconstructed automatically and satisfy the size of the input data. The costs of time and labor can be reduced; meanwhile, the goal with effectivity and accuracy can be achieved finally for producing the 3D medical protector.
Firstly, we use 3D scanner to collect the data of my hands and feet as training data, after then, the corresponding protector is built manually and it will be regarded as the training ground truth in this study. The points of the training data and ground truth are sampled uniformly, and then, inputting them to the AutoEncoder deep net architecture. The network will learn the main features of latent code during the encoding and decoding processes. As the training steps increase, the results of the decoder reconstruction will be closer and closer to the ground truth. When the training is completed, the trained weights will be saved. In addition, we zoomed and rotated the 3D scan data of my hands and feet as verification data, then, the verification data is inputted to the trained AutoEncoder network as well. The network will reconstruct the 3D medical protector which can satisfy the size of verification data. To quantitatively evaluate performances of the experimental results, we apply MMD-CD and JSD verification metric to verify. Consequently, the suitable 3D medical protector is printed by 3D printer. |
