Computing on Wheels: A Deep Reinforcement Learning-Based Approach

• Published in: IEEE transactions on intelligent transportation systems 2022-11, Vol.23 (11), p.22535-22548
• Main Authors: Kazmi, S. M. Ahsan, Ho, Tai Manh, Nguyen, Tuong Tri, Fahim, Muhammad, Khan, Adil, Piran, Md. Jalil, Baye, Gaspard
• Format: Article
• Language: English
• Subjects: Cloud computing; Computation offloading; Costs; Deep learning; deep reinforcement learning; Dynamic scheduling; Edge computing; Electric vehicles; Energy consumption; Network latency; Next-generation intelligent transport system; Roadsides; Task analysis; task offloading; Vehicle dynamics; vehicle-to-vehicle communication; Vehicular ad hoc networks
• ISSN: 1524-9050; 1558-0016
• DOI: 10.1109/TITS.2022.3165662

Future generation vehicles equipped with modern technologies will impose unprecedented computational demand due to the wide adoption of compute-intensive services with stringent latency requirements. The computational capacity of the next generation vehicular networks can be enhanced by incorporating vehicular edge or fog computing paradigm. However, the growing popularity and massive adoption of novel services make the edge resources insufficient. A possible solution to overcome this challenge is to employ the onboard computation resources of close vicinity vehicles that are not resource-constrained along with the edge computing resources for enabling tasks offloading service. In this paper, we investigate the problem of task offloading in a practical vehicular environment considering the mobility of the electric vehicles (EVs). We propose a novel offloading paradigm that enables EVs to offload their resource hungry computational tasks to either a roadside unit (RSU) or the nearby mobile EVs, which have no resource restrictions. Hence, we formulate a non-linear problem (NLP) to minimize the energy consumption subject to the network resources. Then, in order to solve the problem and tackle the issue of high mobility of the EVs, we propose a deep reinforcement learning (DRL) based solution to enable task offloading in EVs by finding the best power level for communication, an optimal assisting EV for EV pairing, and the optimal amount of the computation resources required to execute the task. The proposed solution minimizes the overall energy for the system which is pinnacle for EVs while meeting the requirements posed by the offloaded task. Finally, through simulation results, we demonstrate the performance of the proposed approach, which outperforms the baselines in terms of energy per task consumption.