Feature Weighted Cycle Generative Adversarial Network with Facial Landmark Recognition and Perceptual Color Distance for Enhanced Face Animation Generation

• Published in: Electronics (Basel) 2024-12, Vol.13 (23), p.4761
• Main Authors: Lo, Shih-Lun, Cheng, Hsu-Yung, Yu, Chih-Chang
• Format: Article
• Language: English
• Subjects: Analysis; Animation; Anime; Anime (Animation); Color; Datasets; Deep learning; Generative adversarial networks; Human performance; Image quality; Social networks; Visual perception
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics13234761

We propose an anime style transfer model to generate anime faces from human face images. We improve the model by modifying the normalization function to obtain more feature information. To make the face feature position of the anime face similar to the human face, we propose facial landmark loss to calculate the error between the generated image and the real human face image. To avoid obvious color deviation in the generated images, we introduced perceptual color loss into the loss function. In addition, due to the lack of reasonable metrics to evaluate the quality of the animated images, we propose the use of Fréchet anime inception distance to calculate the distance between the distribution of the generated animated images and the real animated images in high-dimensional space, so as to understand the quality of the generated animated images. In the user survey, up to 74.46% of users think that the image produced by the proposed method is the best compared with other models. Also, the proposed method reaches a score of 126.05 for Fréchet anime inception distance. Our model performs the best in both user studies and FAID, showing that we have achieved better performance in human visual perception and model distribution. According to the experimental results and user feedback, our proposed method can generate results with better quality compared to existing methods.