Reference Image Guided Super-Resolution via Progressive Channel Attention Networks

In recent years, the convolutional neural networks (CNNs) for single image super-resolution (SISR) are becoming more and more complex, and it is more challenging to improve the SISR performance. In contrast, the reference image guided super-resolution (RefSR) is an effective strategy to boost the SR...

Full description

Saved in:
Bibliographic Details
Published in:Journal of computer science and technology 2020-05, Vol.35 (3), p.551-563
Main Authors: Yue, Huan-Jing, Shen, Sheng, Yang, Jing-Yu, Hu, Hao-Feng, Chen, Yan-Fang
Format: Article
Language:English
Subjects:
Artificial Intelligence
Artificial neural networks
Computer Science
Data Structures and Information Theory
Deep learning
Image contrast
Image resolution
Information Systems Applications (incl.Internet)
Methods
Neural networks
Regular Paper
Signal to noise ratio
Software Engineering
Theory of Computation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, the convolutional neural networks (CNNs) for single image super-resolution (SISR) are becoming more and more complex, and it is more challenging to improve the SISR performance. In contrast, the reference image guided super-resolution (RefSR) is an effective strategy to boost the SR (super-resolution) performance. In RefSR, the introduced high-resolution (HR) references can facilitate the high-frequency residual prediction process. According to the best of our knowledge, the existing CNN-based RefSR methods treat the features from the references and the low-resolution (LR) input equally by simply concatenating them together. However, the HR references and the LR inputs contribute differently to the final SR results. Therefore, we propose a progressive channel attention network (PCANet) for RefSR. There are two technical contributions in this paper. First, we propose a novel channel attention module (CAM), which estimates the channel weighting parameter by weightedly averaging the spatial features instead of using global averaging. Second, considering that the residual prediction process can be improved when the LR input is enriched with more details, we perform super-resolution progressively, which can take advantage of the reference images in multi-scales. Extensive quantitative and qualitative evaluations on three benchmark datasets, which represent three typical scenarios for RefSR, demonstrate that our method is superior to the state-of-the-art SISR and RefSR methods in terms of PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural Similarity).
ISSN:1000-9000
1860-4749
DOI:10.1007/s11390-020-0270-3