Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics

• Published in: Journal of imaging 2021-03, Vol.7 (3), p.59
• Main Authors: Rodriguez-Ortega, Yohanna, Ballesteros, Dora M., Renza, Diego
• Format: Article
• Language: English
• Subjects: computer vision; copy-move forgery detection; deep learning; fake image; transfer learning; VGG
• ISSN: 2313-433X; 2313-433X
• DOI: 10.3390/jimaging7030059

With the exponential growth of high-quality fake images in social networks and media, it is necessary to develop recognition algorithms for this type of content. One of the most common types of image and video editing consists of duplicating areas of the image, known as the copy-move technique. Traditional image processing approaches manually look for patterns related to the duplicated content, limiting their use in mass data classification. In contrast, approaches based on deep learning have shown better performance and promising results, but they present generalization problems with a high dependence on training data and the need for appropriate selection of hyperparameters. To overcome this, we propose two approaches that use deep learning, a model by a custom architecture and a model by transfer learning. In each case, the impact of the depth of the network is analyzed in terms of precision (P), recall (R) and F1 score. Additionally, the problem of generalization is addressed with images from eight different open access datasets. Finally, the models are compared in terms of evaluation metrics, and training and inference times. The model by transfer learning of VGG-16 achieves metrics about 10% higher than the model by a custom architecture, however, it requires approximately twice as much inference time as the latter.