One Bit Aggregation for Federated Edge Learning With Reconfigurable Intelligent Surface: Analysis and Optimization

• Published in: IEEE transactions on wireless communications 2023-02, Vol.22 (2), p.872-888
• Main Authors: Li, Heju, Wang, Rui, Zhang, Wei, Wu, Jun
• Format: Article
• Language: English
• Subjects: Agglomeration; Bit error rate; Communication; Convergence; Data transmission; Error analysis; Federated edge learning; Frequency division multiple access; Machine learning; Neural networks; Optimization; orthogonal frequency division multiple access; Orthogonal Frequency Division Multiplexing; Performance evaluation; reconfigurable intelligent surface; Reconfigurable intelligent surfaces; Resource management; SignSGD; Training; Wireless communication; Wireless communications
• ISSN: 1536-1276; 1558-2248
• DOI: 10.1109/TWC.2022.3198881

As one of the most popular and attractive frameworks for model training, federated edge learning (FEEL) presents a new paradigm, which avoids direct data transmission by collaboratively training a global learning model across multiple distributed edge devices, thus overcoming the disadvantage of centralized machine learning in resource limitations, delay constraints, and privacy issues. However, due to the heavy cost of communicating gradient among edge devices, sharing the parameters of a large-scale neural network can still be time-intensive. To alleviate this bottleneck, an efficient scheme, called SignSGD has been recently proposed, where the one-bit gradient quantization with majority vote is featured at edge devices. Nevertheless, the performance of one-bit aggregation will inevitably deteriorate due to the undesirable propagation error introduced by wireless channels. To address this issue, we propose in this work a novel reconfigurable intelligent surface (RIS)-aided one-bit communication optimization scheme under orthogonal frequency division multiple access (OFDMA) to relieve the negative influence of communication error on the SignSGD-based FEEL. Specifically, a learning convergence analysis is firstly presented to quantitatively characterize the impact of wireless communication error measured by the union bound on pairwise bit error rate (BER) on the performance of SignSGD-based FEEL. Immediately, a unified communication-learning optimization problem is further formulated to jointly optimize the sub-band assignment strategy, the power allocation vector, and the RIS configuration matrix. Numerical experiments show that the proposed design achieves substantial performance improvement compared with the state-of-the-art approaches.