Anti-Compression Contrastive Facial Forgery Detection

• Published in: IEEE transactions on multimedia 2024, Vol.26, p.6166-6177
• Main Authors: Huang, Jiajun, Du, Chengbin, Zhu, Xinqi, Ma, Siqi, Nepal, Surya, Xu, Chang
• Format: Article
• Language: English
• Subjects: Algorithms; anti-compression; contrastive Learning; Data models; Deepfakes; Digital imaging; Faces; Facial forgery detection; Feature extraction; Forgery; Image coding; Image compression; Performance degradation; Representations; Training; Video compression
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2023.3347103

Forgery of facial images and videos has increased the concern about digital security. It has led to the significant development of detecting forgery data recently. However, the data, especially the videos published on the Internet, are usually compressed with lossy compression algorithms such as H.264. The compressed data could significantly degrade the performance of recent detection algorithms. The existing anti-compression algorithms focus on enhancing the performance in detecting heavily compressed data but less consider the compression adaption to the data from various compression levels. We believe creating a forgery detection capable of handling data compressed with unknown levels is important. To enhance the performance of such models, we consider the weak compressed and strong compressed data as two views of the original data and they should have similar representation and relationships with other samples. We propose a novel anti-compression forgery detection framework by maintaining closer relations within data under different compression levels. Specifically, our algorithm measures the pair-wise similarity within data as the relations, ensuring that relationships between weakly and strongly compressed data remain consistent. This enhances the discriminative power for detecting highly compressed data. To achieve a better strong compressed data relation guided by the less compressed one, we apply video-level contrastive learning for weak compressed data, which forces the model to produce similar representations within the same video and far from the negative samples. The experiment results show that the proposed algorithm could boost performance for strong compressed data while improving the accuracy rate when detecting clean data.