Data Augmentation-based Novel Deep Learning Method for Deepfaked Images Detection

• Published in: ACM transactions on multimedia computing communications and applications 2024-11, Vol.20 (11), p.1-15, Article 339
• Main Authors: Iqbal, Farkhund, Abbasi, Ahmed, Javed, Abdul Rehman, Almadhor, Ahmad, Jalil, Zunera, Anwar, Sajid, Rida, Imad
• Format: Article
• Language: English
• Subjects: Computer Science; Computing methodologies; Object detection
• ISSN: 1551-6857; 1551-6865
• DOI: 10.1145/3592615

Recent advances in artificial intelligence have led to deepfake images, enabling users to replace a real face with a genuine one. deepfake images have recently been used to malign public figures, politicians, and even average citizens. deepfake but realistic images have been used to stir political dissatisfaction, blackmail, propagate false news, and even carry out bogus terrorist attacks. Thus, identifying real images from fakes has got more challenging. To avoid these issues, this study employs transfer learning and data augmentation technique to classify deepfake images. For experimentation, 190,335 RGB-resolution deepfake and real images and image augmentation methods are used to prepare the dataset. The experiments use the deep learning models: convolutional neural network (CNN), Inception V3, visual geometry group (VGG19), and VGG16 with a transfer learning approach. Essential evaluation metrics (accuracy, precision, recall, F1-score, confusion matrix, and AUC-ROC curve score) are used to test the efficacy of the proposed approach. Results revealed that the proposed approach achieves an accuracy, recall, F1-score and AUC-ROC score of 90% and 91% precision, with our fine-tuned VGG16 model outperforming other DL models in recognizing real and deepfakes.