Latency-Energy Tradeoff in Connected Autonomous Vehicles: A Deep Reinforcement Learning Scheme

• Published in: IEEE transactions on intelligent transportation systems 2023-11, Vol.24 (11), p.1-13
• Main Authors: Budhiraja, Ishan, Kumar, Neeraj, Sharma, Himanshu, Elhoseny, Mohamed, Lakys, Yahya, Rodrigues, Joel J. P. C.
• Format: Article
• Language: English
• Subjects: Autonomous vehicles; Cloud computing; Computation offloading; Computer science; connected autonomous vehicles; Deep learning; Delays; Edge computing; energy; Energy consumption; Energy management; Genetic algorithms; latency; Markov processes; Network latency; Optimization; Resource allocation; Servers; soft actor-critic; Task analysis; Vehicle edge computing; Vehicles
• ISSN: 1524-9050; 1558-0016
• DOI: 10.1109/TITS.2022.3215523

Vehicle Edge Computing (VEC)-assisted computational offloading brings cloud computing closer to user equipment (UEs) at the edge of the access network by delivering various services to the UEs with limited processing power and battery. However, in fifth-generation and beyond 5G (B5G) networks, where UEs' service requests and locations change dynamically, the deployment of static edge server deployments may lead to an increase in latency and total energy consumption. This paper presents a latency-energy-aware, efficient task offloading scheme for connected autonomous vehicular networks. Firstly, vehicles are assembled into clusters, in which vehicle can transmit tasks to the other vehicle, while on the other hand, the VEC server is used for processing the data. We developed a joint resource allocation and offloading decision optimization problem to minimize network latency and total energy usage. Due to the non-convex character of the optimization issue, we employed the Markov decision process (MDP) to convert it to a reinforcement learning (RL) problem. Then, we used a soft-actor critic-based scheme to achieve the optimal policy for resource allocation and task offloading to reduce the total latency and energy consumption for connected autonomous vehicles. Simulation analysis reveals that the proposed scheme attains 46.6% and 17.2% lesser delay, and 28.8% and 20.0% consumes less energy than the Hybrid DRL with Genetic Algorithm (HDRL-GA) and DRL based collaborative Data Scheduling (DRL-CDSS) state-of-art schemes.