Physics-Guided Reinforcement Learning System for Realistic Vehicle Active Suspension Control

• Main Authors: Nhu, Anh N., Le, Ngoc-Anh, Li, Shihang, Truong, Thang D.V.
• Format: Conference Proceeding
• Language: English
• Subjects: Active Suspension System; Control systems; Damping; Deep Reinforcement Learning; Mechanical En-gineering; Real-time systems; Roads; Stability criteria; Suspensions (mechanical systems); Vehicle; Vehicle dynamics; Vertical Dynamics
• ISSN: 1946-0759
• DOI: 10.1109/ICMLA58977.2023.00065

The suspension system is a crucial part of the automotive chassis, improving vehicle ride comfort and isolating passengers from rough road excitation. Unlike passive suspension, which has constant spring and damping coefficients, active suspension incorporates electronic actuators into the system to dynamically control stiffness and damping variables. However, effectively controlling the suspension system poses a challenging task that necessitates real-time adaptability to various road conditions. This paper presents the Physics-Guided Deep Re-inforcement Learning (DRL) for adjusting an active suspension system's variable kinematics and compliance properties for a quarter-car model in real time. Specifically, the outputs of the model are defined as actuator stiffness and damping control, which are bound within physically realistic ranges to maintain the system's physical compliance. The proposed model was trained on stochastic road profiles according to ISO 8608 standards to optimize the actuator's control policy. According to qualitative results on simulations, the vehicle body reacts smoothly to various novel real-world road conditions, having a much lower degree of oscillation. These observations mean a higher level of passenger comfort and better vehicle stability. Quantitatively, DRL out-performs passive systems in reducing the average vehicle body velocity and acceleration by 43.58% and 17.22%, respectively, minimizing the vertical movement impacts on the passengers.