Operation-wise Attention Network for Tampering Localization Fusion

• Main Authors: Charitidis, Polychronis, Kordopatis-Zilos, Giorgos, Papadopoulos, Symeon, Kompatsiaris, Ioannis
• Format: Conference Proceeding
• Language: English
• Subjects: Deep learning-based fusion; Feature extraction; Image forensics; Image tampering localization; Location awareness; Splicing; Supervised learning; Training; Transform coding
• ISSN: 1949-3991
• DOI: 10.1109/CBMI50038.2021.9461920

In this work, we present a deep learning-based approach for image tampering localization fusion. This approach is designed to combine the outcomes of multiple image forensics algorithms and provides a fused tampering localization map, which requires no expert knowledge and is easier to interpret by end users. Our fusion framework includes a set of five individual tampering localization methods for splicing localization on JPEG images. The proposed deep learning fusion model is an adapted architecture, initially proposed for the image restoration task, that performs multiple operations in parallel, weighted by an attention mechanism to enable the selection of proper operations depending on the input signals. This weighting process can be very beneficial for cases where the input signal is very diverse, as in our case where the output signals of multiple image forensics algorithms are combined. Evaluation in three publicly available forensics datasets demonstrates that the performance of the proposed approach is competitive, outperforming the individual forensics techniques as well as another recently proposed fusion framework in the majority of cases.