Training Time Minimization in Quantized Federated Edge Learning under Bandwidth Constraint

• Main Authors: Liu, Peixi, Jiang, Jiamo, Zhu, Guangxu, Cheng, Lei, Jiang, Wei, Luo, Wu, Du, Ying, Wang, Zhiqin
• Format: Conference Proceeding
• Language: English
• Subjects: Bandwidth; Channel allocation; Minimization; Quantization (signal); Stochastic processes; Training; Wireless communication
• ISSN: 1558-2612
• DOI: 10.1109/WCNC51071.2022.9771723

In this paper, the training time minimization problem is investigated in a quantized FEEL system, where the heterogeneous edge devices send quantized gradients to the edge server via orthogonal channels. In particular, a stochastic quantization scheme is adopted for compression of uploaded gradients, which can reduce the burden of per-round communication but may come at the cost of increasing number of communication rounds. The intrinsic trade-off between the number of communication rounds and per-round latency is characterized. Specifically, we analyze the convergence behavior of the quantized FEEL in terms of the optimality gap. Constrained by total bandwidth, the training time minimization problem is formulated as a joint quantization level and bandwidth allocation optimization problem. To this end, an algorithm based on alternating optimization is proposed, which alternatively solves the subproblem of quantization optimization via successive convex approximation and the subproblem of bandwidth allocation via bisection search. With different learning tasks and models, the validation of our analysis and the near-optimal performance of the proposed algorithm are demonstrated by the experimental results.