Multi-agent evolution reinforcement learning method for machining parameters optimization based on bootstrap aggregating graph attention network simulated environment

• Published in: Journal of manufacturing systems 2023-04, Vol.67, p.424-438
• Main Authors: Li, Weiye, He, Songping, Mao, Xinyong, Li, Bin, Qiu, Chaochao, Yu, Jinwen, Peng, Fangyu, Tan, Xin
• Format: Article
• Language: English
• Subjects: Cutting efficiency; Evolutionary learning; Graph attention network; Machining parameters optimization; Multi-agent reinforcement learning; Surface roughness
• ISSN: 0278-6125; 1878-6642
• DOI: 10.1016/j.jmsy.2023.02.015

Improving machining quality and production efficiency is the focus of the manufacturing industry. How to obtain efficient machining parameters under multiple constraints such as machining quality is a severe challenge for manufacturing industry. In this paper, a multi-agent evolutionary reinforcement learning method (MAERL) is proposed to optimize the machining parameters for high quality and high efficiency machining by combining the graph neural network and reinforcement learning. Firstly, a bootstrap aggregating graph attention network (Bagging-GAT) based roughness estimation method for machined surface is proposed, which combines the structural knowledge between machining parameters and vibration features. Secondly, a mathematical model of machining parameters optimization problem is established, which is formalized into Markov decision process (MDP), and a multi-agent reinforcement learning method is proposed to solve the MDP problem, and evolutionary learning is introduced to improve the stability of multi-agent training. Finally, a series of experiments were carried out on the commutator production line, and the results show that the proposed Bagging-GAT-based method can improve the prediction effect by about 25% in the case of small samples, and the MAERL-based optimization method can better deal with the coupling problem of reward function in the optimization process. Compared with the classical optimization method, the optimization effect is improved by 13% and a lot of optimization time is saved. •The structural knowledge between machining parameters and vibration features are fully utilized.•Prediction variance of surface roughness estimation model with limited dataset is reduced.•The machining parameters optimization problem is formalized into Markov decision problems (MDPs).•The MDPs of machining parameter optimization is solved by multi-agent reinforcement learning.•Evolutionary learning is introduced to improve the stability of multi-agent training.