Flexible robotic cell scheduling with graph neural network based deep reinforcement learning

• Published in: Journal of manufacturing systems 2025-02, Vol.78, p.81-93
• Main Authors: Wang, Donghai, Liu, Shun, Zou, Jing, Qiao, Wenjun, Jin, Sun
• Format: Article
• Language: English
• Subjects: Deep reinforcement learning; Flexible robotic cell; Graph neural network; Transportation capacity
• ISSN: 0278-6125
• DOI: 10.1016/j.jmsy.2024.11.010

Flexible robotic cells are pivotal in flexible and customized manufacturing. An effective scheduling policy for such cells can significantly reduce the makespan and improve the production efficiency. This study introduces an innovative end-to-end real-time scheduling method leveraging deep reinforcement learning (DRL) to minimize the makespan in a flexible robotic cell. We introduce a heterogeneous disjunctive graph model for a nuanced representation of the scheduling problem, which incorporates transportation through specific disjunctive arcs. The DRL utilizes Graph Neural Network (GNN) for model feature extraction and employs Proximal Policy Optimization (PPO) to train the scheduling agent. Our methodology can also better leverage the transport robot capacity to mitigate system blockage and deadlock. Numerical experiments are conducted to demonstrate the effectiveness of the proposed method. •A GNN-based DRL framework optimizes real-time scheduling policies to reduce makespan.•A novel disjunctive graph model describes scheduling with transportation constraints.•Dataset tests confirm makespan reduction and assess impacts of system configurations.