Face Omron Ring: Proactive defense against face forgery with identity awareness

• Published in: Neural networks 2024-12, Vol.180, p.106639, Article 106639
• Main Authors: Dai, Yunshu, Fei, Jianwei, Huang, Fangjun, Xia, Zhihua
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Celebrities protection; Computer Security; Deep neural networks; Face; Face forgery; Humans; Identity awareness; Identity Theft - prevention & control; Image Processing, Computer-Assisted - methods; Neural Networks, Computer; Proactive defense
• ISSN: 0893-6080; 1879-2782; 1879-2782
• DOI: 10.1016/j.neunet.2024.106639

In the era of Artificial Intelligence Generated Content (AIGC), face forgery models pose significant security threats. These models have caused widespread negative impacts through the creation of forged products targeting public figures, national leaders, and other Persons-of-interest (POI). To address this, we propose the Face Omron Ring (FOR) to proactively protect the POI from face forgery. Specifically, by introducing FOR into a target face forgery model, the model will proactively refuse to forge any face image of protected identities without compromising the forgery capability for unprotected ones. We conduct extensive experiments on 4 face forgery models, StarGAN, AGGAN, AttGAN, and HiSD on the widely used large-scale face image datasets CelebA, CelebA-HQ, and PubFig83. Our results demonstrate that the proposed method can effectively protect 5000 different identities with a 100% protection success rate, for each of which only about 100 face images are needed. Our method also shows great robustness against multiple image processing attacks, such as JPEG, cropping, noise addition, and blurring. Compared to existing proactive defense methods, our method offers identity-centric protection for any image of the protected identity without requiring any special preprocessing, resulting in improved scalability and security. We hope that this work can provide a solution for responsible AIGC companies in regulating the use of face forgery models. •Face Omron Ring enables face forgery models to reject protected identities, yet work well on others.•Face Omron Ring protects multiple identities with limited data and is robust against image attacks.•Face Omron Ring requires no preprocessing and thus is more scalable in the protection of identities.