Combining Deep Image Prior and Second-Order Generalized Total Variance for Image Inpainting

• Published in: Mathematics (Basel) 2023-07, Vol.11 (14), p.3201
• Main Authors: You, Shaopei, Xu, Jianlou, Fan, Yajing, Guo, Yuying, Wang, Xiaodong
• Format: Article
• Language: English
• Subjects: Algorithms; alternating direction method; Analysis; Computer vision; Deep learning; depth image prior; Food science; Image contrast; image inpainting; Image restoration; Machine vision; Neural networks; Optimization; second-order total generalized variational; Semantics; Signal to noise ratio; Teaching methods
• ISSN: 2227-7390; 2227-7390
• DOI: 10.3390/math11143201

Image inpainting is a crucial task in computer vision that aims to restore missing and occluded parts of damaged images. Deep-learning-based image inpainting methods have gained popularity in recent research. One such method is the deep image prior, which is unsupervised and does not require a large number of training samples. However, the deep image prior method often encounters overfitting problems, resulting in blurred image edges. In contrast, the second-order total generalized variation can effectively protect the image edge information. In this paper, we propose a novel image restoration model that combines the strengths of both the deep image prior and the second-order total generalized variation. Our model aims to better preserve the edges of the image structure. To effectively solve the optimization problem, we employ the augmented Lagrangian method and the alternating direction method of the multiplier. Numerical experiments show that the proposed method can repair images more effectively, retain more image details, and achieve higher performance than some recent methods in terms of peak signal-to-noise ratio and structural similarity.