Deep Reinforcement Learning Empowers Wireless Powered Mobile Edge Computing: Towards Energy-Aware Online Offloading

• Published in: IEEE transactions on communications 2023-09, Vol.71 (9), p.1-1
• Main Authors: Jiao, Xianlong, Wang, Yating, Guo, Songtao, Zhang, Hong, Dai, Haipeng, Li, Mingyan, Zhou, Pengzhan
• Format: Article
• Language: English
• Subjects: Algorithms; Charging; charging resource allocation; Deep learning; deep reinforcement learning; Design optimization; Edge computing; Energy management; Feasibility; Heuristic algorithms; Integer programming; Internet of Things; Mixed integer; Mobile computing; Network latency; online offloading decision; Optimization; Real time; Real-time systems; Resource allocation; Resource management; Task analysis; Wireless communication; Wireless power transmission; Wireless powered mobile edge computing
• ISSN: 0090-6778; 1558-0857
• DOI: 10.1109/TCOMM.2023.3283792

Deep integration of wireless power transmission and mobile edge computing (MEC) promotes wireless powered MEC to become a new research hotspot in the field of Internet of Things. In this paper, we focus on the joint optimization problem of online offloading decision and charging resource allocation for minimizing task accomplishing time in dynamic time-varying wireless channel scenarios. The optimal solution involves addressing a mixed integer programming problem in real time, which is proved to be NP-hard, and imposes nontrivial challenges to design with conventional optimization methods. To efficiently address this problem, we leverage the deep reinforcement learning (DRL) technology to propose an energy-aware online offloading algorithm called EAOO. EAOO algorithm learns empirically the online offloading decision policies via a well-designed DRL framework, and adopts the feasible solution region analysis method to implement the charging resource allocation. We further propose a novel feasible decision vector generation method, and incorporate the crossover and mutation technology to expand the offloading vector search space with the provable feasibility guarantee. Extensive experimental results show that, our EAOO algorithm outperforms existing baseline algorithms, and achieves near-optimal performance with low CPU execution latency, which well satisfies the practical requirements of real-time and efficiency.