DSUTO: Differential Rate SAC-Based UAV-Assisted Task Offloading Algorithm in Collaborative Edge Computing

• Main Authors: Zhang, Longxin, Tan, Runti, Ai, Minghui, Xiang, Huazheng, Peng, Cheng, Zeng, Zhihao
• Format: Conference Proceeding
• Language: English
• Subjects: Autonomous aerial vehicles; Benchmark testing; Collaboration; Costs; device-edge-cloud fusion; Entropy; maximum entropy reinforcement learning; mobile edge computing; Performance evaluation; Stability analysis; task offloading; UAV assistance
• ISSN: 2690-5965
• DOI: 10.1109/ICPADS60453.2023.00312

Mobile edge computing effectively enhances service quality and decreases system cost by processing resource-intensive tasks at the network edge. Today, unmanned aerial vehicles (UAVs) are increasingly being utilized for task offloading services in remote areas due to their convenient deployment and flexible mobility. However, the complex task environment when using UAVs brings great challenges to the optimization strategy's capacity to solve and converge in a stable manner. To solve this issue, a differential rate rule (DRR) is proposed in this work with the goal of improving the update stability of the agent in the actor-critic reinforcement learning (RL). Second, a UAV-assisted task offloading algorithm called DSUTO is designed based on DRR and maximum entropy RL. Finally, a UAV-assisted mobile device-edge-cloud collaborative computing model is constructed with time-varying channel obstacles and user movement, thus solving a multi-objective joint optimization problem on the task completion cost (including delay and energy consumption) and UAV endurance under resource constraints. The experiment results demonstrate that DSUTO not only has excellent performance in terms of convergence and stability, but also significantly reduces the total system cost by 21.38% compared with the latest benchmark algorithms under complex environment conditions.