以對比學習輔助之影像去模糊;Contrastive Learning Aided Image Deblurring

NCUIR > College of Electrical Engineering & Computer Science > Graduate Institute of Communication Engineering > Electronic Thesis & Dissertation > Item 987654321/89649

Please use this identifier to cite or link to this item: http://ir.lib.ncu.edu.tw/handle/987654321/89649

Title:	以對比學習輔助之影像去模糊;Contrastive Learning Aided Image Deblurring
Authors:	詹豐鎧;Jan, Feng-Kai
Contributors:	通訊工程學系
Keywords:	影像去模糊;對比學習;對比損失函數;漸進式負樣本生成器;推論時間;image deblurring;contrastive learning;contrastive loss;progressive negative samples generator;inference time
Date:	2022-07-15
Issue Date:	2022-10-04 11:50:53 (UTC+8)
Publisher:	國立中央大學
Abstract:	近年來，基於深度學習(deep learning)之圖像處理任務是百花齊放，其中，影像品質的好壞，會影響電腦視覺應用的效能，而有效且快速的影像去模糊方案，除了能改善影像觀賞品質，還能結合其他影像處理任務之模型或應用於邊緣裝置。目前的影像去模糊模型，在訓練網路時，幾乎只採用去模糊影像與清晰影像的資訊計算損失，以更新網路參數，然而，影像去模糊是一項不適定性(ill-posed)的任務，故如何妥善利用模糊的資訊，以減少網路輸出的解空間，為一項提升輸出影像品質的關鍵。因此，本論文提出以對比學習(contrastive learning)輔助之影像去模糊方案，首先，利用清晰影像與去模糊影像的資訊做為正樣本以及錨點的資訊，並為了改善以往使用對比學習輔助影像回復的模型，在不更動樣本的情形下，可能讓對比學習無法繼續訓練的問題，將模糊影像透過所提之漸進式負樣本生成器產生負樣本，根據訓練的時期(epoch)區間，逐步提升負樣本的清晰度以增加其多樣性，最後使用所提之對比損失，輔助去模糊網路的參數更新。實驗結果顯示，本論文所提方案在GoPro資料集的表現上，能在相同的計算複雜度以及網路參數下，相較於MIMO-UNet提升峰值訊噪比(peak signal-to-noise ratio, PSNR) 0.12 dB。;Deep learning based image processing tasks are flourishing in recent years. Since the quality of an image affects the performance of computer vision applications. An effective and fast image deblurring scheme not only can improve the viewing experience but also can be combined with models from other image processing tasks on edge devices. The existing image deblurring models almost only uses the information of the deblurred image and the sharp image to calculate the loss to update the network at the training stage. In particular, image deblurring is an ill-posed task, so the proper usage of the blurred information to reduce the solution space of the network is key to improving the quality of the output image. Thus, this thesis proposes a contrastive learning aided image deblurring scheme. Firstly, clear images and deblurred images are taken as positive samples and anchor, respectively. It aims to improve the previous contrastive learning aided image restoration models that cannot continue to be trained without changing the samples. Secondly, the proposed scheme generates the negative samples by the proposed progressive negative samples generator. It gradually improves the sharpness of negative samples to increase their diversity over epochs at the training stage. Thirdly, the proposed contrastive loss is used to assist in the parameter update of the deblurring network. Experimental results on GoPro dataset show that the proposed scheme can improve the peak signal-to-noise ratio (PSNR) of MIMO-UNet by 0.12 dB for the same computational complexity and network parameters.
Appears in Collections:	[Graduate Institute of Communication Engineering] Electronic Thesis & Dissertation

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	73	View/Open

社群 sharing

Loading...