Energy management for a hybrid electric vehicle based on prioritized deep reinforcement learning framework

• Published in: Energy (Oxford) 2022-02, Vol.241, p.122523, Article 122523
• Main Authors: Du, Guodong, Zou, Yuan, Zhang, Xudong, Guo, Lingxiong, Guo, Ningyuan
• Format: Article
• Language: English
• Subjects: Adaptability; Adaptive optimization method; Algorithms; Deep learning; Double deep Q-learning algorithm; Dynamic programming; Electric vehicles; Energy consumption; Energy management; Energy management control; Fuel economy; Hybrid electric vehicles; Learning; Machine learning; Modified prioritized experience replay; Optimization; Powertrain; Problem solving; Reinforcement; Series hybrid electric vehicle; Teaching methods; Tracked vehicles
• ISSN: 0360-5442; 1873-6785
• DOI: 10.1016/j.energy.2021.122523

A novel deep reinforcement learning (DRL) control framework for the energy management strategy of the series hybrid electric tracked vehicle (SHETV) is proposed in this paper. Firstly, the powertrain model of the vehicle is established, and the formulation of the energy management problem is given. Then, an efficient deep reinforcement learning framework based on the double deep Q-learning (DDQL) algorithm is built for the optimal problem solving, which also contains a modified prioritized experience replay (MPER) and an adaptive optimization method of network weights called AMSGrad. The proposed framework is verified by the realistic driving cycle, then is compared to the dynamic programming (DP) method and the previous deep reinforcement learning method. Simulation results show that the newly constructed deep reinforcement learning framework achieves higher training efficiency and lower energy consumption than the previous deep reinforcement learning method does, and the fuel economy is proved to approach the global optimality. Besides, its adaptability and robustness are validated by different driving schedules. •The powertrain model of the series hybrid electric tracked vehicle is established.•A new control framework based on double deep Q-learning algorithm is constructed.•Modified prioritized experience replay is designed to improve training efficiency.•An adaptive optimization method is applied to update weights of the neural network.•The proposed deep reinforcement learning framework realizes better performance.