Two birds with one stone: Transforming and generating facial images with iterative GAN

Generating high fidelity identity-preserving faces with different facial attributes has a wide range of applications. Although a number of generative models have been developed to tackle this problem, there is still much room for further improvement. In particular, the current solutions usually igno...

Full description

Saved in:
Bibliographic Details
Published in:Neurocomputing (Amsterdam) 2020-07, Vol.396, p.278-290
Main Authors: Ma, Dan, Liu, Bin, Kang, Zhao, Zhou, Jiayu, Zhu, Jianke, Xu, Zenglin
Format: Article
Language:English
Subjects:
GAN
Image generation
Image transformation
Perceptual loss
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Generating high fidelity identity-preserving faces with different facial attributes has a wide range of applications. Although a number of generative models have been developed to tackle this problem, there is still much room for further improvement. In particular, the current solutions usually ignore the perceptual information of images, which we argue that it benefits the output of a high-quality image while preserving the identity information, especially in facial attributes learning area. To this end, we propose to train GAN iteratively via regularizing the min-max process with an integrated loss, which includes not only the per-pixel loss but also the perceptual loss. In contrast to the existing methods only deal with either image generation or transformation, our proposed iterative architecture can achieve both of them. Experiments on the multi-label facial dataset CelebA demonstrate that the proposed model has excellent performance on recognizing multiple attributes, generating a high-quality image, and transforming image with controllable attributes.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2018.10.093