Exposing AI-generated videos with motion magnification

Recent progress of artificial intelligence makes it easier to edit facial movements in videos or create face substitutions, bringing new challenges to anti-fake-faces techniques. Although multimedia forensics provides many detection algorithms from a traditional point of view, it is increasingly har...

Full description

Saved in:
Bibliographic Details
Published in:Multimedia tools and applications 2021-08, Vol.80 (20), p.30789-30802
Main Authors: Fei, Jianwei, Xia, Zhihua, Yu, Peipeng, Xiao, Fengjun
Format: Article
Language:English
Subjects:
Algorithms
Artificial intelligence
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Deception
Flicker
Forensic computing
Forensic sciences
Image manipulation
Multimedia
Multimedia Information Systems
Special Purpose and Application-Based Systems
Training
Video data
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Recent progress of artificial intelligence makes it easier to edit facial movements in videos or create face substitutions, bringing new challenges to anti-fake-faces techniques. Although multimedia forensics provides many detection algorithms from a traditional point of view, it is increasingly hard to discriminate the fake videos from real ones while they become more sophisticated and plausible with updated forgery technologies. In this paper, we introduce a motion discrepancy based method that can effectively differentiate AI-generated fake videos from real ones. The amplitude of face motions in videos is first magnified, and fake videos will show more serious distortion or flicker than the pristine videos. We pre-trained a deep CNN on frames extracted from the training videos and the output vectors of the frame sequences are used as input of an LSTM at secondary training stage. Our approach is evaluated over a large fake video dataset Faceforensics++ produced by various advanced generation technologies, it shows superior performance contrasted to existing pixel-based fake video forensics approaches.
ISSN:1380-7501
1573-7721
DOI:10.1007/s11042-020-09147-3