ATFaceGAN: Single Face Semantic Aware Image Restoration and Recognition From Atmospheric Turbulence

Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and r...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on biometrics, behavior, and identity science behavior, and identity science, 2021-04, Vol.3 (2), p.240-251
Main Authors: Lau, Chun Pong, Castillo, Carlos D., Chellappa, Rama
Format: Article
Language:English
Subjects:
Algorithms
Atmospheric turbulence
Deformation
Degradation
Face recognition
face verification
Faces
generative adversarial networks
Image degradation
Image reconstruction
Image restoration
Object recognition
Strain
Training
turbulence mitigation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Degradation due to atmospheric turbulence is common while capturing images at long ranges. To mitigate the degradation due to turbulence which includes deformation and blur, we propose a generative single frame restoration algorithm which disentangles the blur and deformation due to turbulence and reconstructs a restored image. The disentanglement is achieved by decomposing the distortion due to turbulence into blur and deformation components using a deblur generator and a deformation correction generator, respectively. Two paths of restoration are implemented to regularize the disentanglement and generate two restored images from a given degraded image. A fusion function combines the features of the restored images to reconstruct a sharp image with rich details. Adversarial and perceptual losses are added to reconstruct a sharp image and suppress the artifacts respectively. Extensive experiments demonstrate the effectiveness of the proposed restoration algorithm, which achieves satisfactory performance for face restoration and face recognition tasks.
ISSN:2637-6407
2637-6407
DOI:10.1109/TBIOM.2021.3058316