Thermal Face Generation Using StyleGAN

This article proposes the use of generative adversarial networks (GANs) via StyleGAN2 to create high-quality synthetic thermal images and obtain training data to build thermal face recognition models using deep learning. We employed different variants of StyleGAN2, incorporating the new improved ver...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2021, Vol.9, p.80511-80523
Main Authors: Hermosilla, Gabriel, Tapia, Diego-Ignacio Henriquez, Allende-Cid, Hector, Castro, Gonzalo Farias, Vera, Esteban
Format: Article
Language:English
Subjects:
Data models
Deep learning
Eyewear
Face recognition
Federal legislation
Generative adversarial networks
Generators
Image classification
Image manipulation
Image quality
Machine learning
Object recognition
StyleGAN2
thermal face recognition
Training
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This article proposes the use of generative adversarial networks (GANs) via StyleGAN2 to create high-quality synthetic thermal images and obtain training data to build thermal face recognition models using deep learning. We employed different variants of StyleGAN2, incorporating the new improved version of StyleGAN that uses adaptive discriminator augmentation (ADA). In addition, three different thermal databases from the literature were employed to train a thermal face detector based on YOLOv3 and to train StyleGAN2 and its variants, evaluating different metrics. The synthetic thermal database was built using GANSpace to manipulate the intermediate latent space w of StyleGAN2 and obtain images with different characteristics, such as eyeglasses, rotation, beards, etc. We carried out the training of 6 pretrained deep learning models for face recognition to validate the use of our synthetic thermal database, obtaining 99.98% accuracy for classifying synthetic thermal face images.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2021.3085423