VFL: A Verifiable Federated Learning With Privacy-Preserving for Big Data in Industrial IoT

• Published in: IEEE transactions on industrial informatics 2022-05, Vol.18 (5), p.3316-3326
• Main Authors: Fu, Anmin, Zhang, Xianglong, Xiong, Naixue, Gao, Yansong, Wang, Huaqun, Zhang, Jing
• Format: Article
• Language: English
• Subjects: Agglomeration; Big Data; Data collection; Deep learning; Face recognition; Federated learning; federated learning (FL); Industrial applications; industrial Internet of Things (IoT); Internet of Things; Interpolation; Machine learning; Privacy; privacy-preserving; Servers; Training; verifiable
• ISSN: 1551-3203; 1941-0050
• DOI: 10.1109/TII.2020.3036166

Due to the strong analytical ability of big data, deep learning has been widely applied to model on the collected data in industrial Internet of Things (IoT). However, for privacy issues, traditional data-gathering centralized learning is not applicable to industrial scenarios sensitive to training sets, such as face recognition and medical systems. Recently, federated learning has received widespread attention, since it trains a model by only sharing gradients without accessing training sets. But existing research works reveal that the shared gradient still retains the sensitive information of the training set. Even worse, a malicious aggregation server may return forged aggregated gradients. In this article, we propose the VFL, a verifiable federated learning with privacy-preserving for big data in industrial IoT. Specifically, we use Lagrange interpolation to elaborately set interpolation points for verifying the correctness of the aggregated gradients. Compared with existing schemes, the verification overhead of VFL remains constant regardless of the number of participants. Moreover, we employ the blinding technology to protect the privacy of the privacy gradients. If no more than \boldsymbol{n}-2 of \boldsymbol{n} participants collude with the aggregation server, VFL could guarantee the encrypted gradients of other participants not being inverted. Experimental evaluations corroborate the practical performance of the presented VFL with high accuracy and efficiency.