Deep Reinforcement Learning for Task Assignment and Shelf Reallocation in Smart Warehouses

• Published in: IEEE access 2024, Vol.12, p.58915-58926
• Main Authors: Wu, Shao-Ci, Chiu, Wei-Yu, Wu, Chien-Feng
• Format: Article
• Language: English
• Subjects: Algorithms; Automated warehouse; Automation; Collision avoidance; Costs; Deep reinforcement learning; Electronic commerce; Robots; Service robots; Shelving; smart warehouse; Task analysis; task assignment; Warehouses; Warehousing
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2024.3392752

With the rapid development of online shopping and prosperity of the e-commerce industry in recent years, traditional warehouses are struggling to cope with increasing order volumes. Accordingly, smart warehouses have gained considerable attention for their relatively high efficiency and productivity. In such warehouses, robots transport shelves to picking stations on the basis of tasks assigned to them and then return to the inventory area. An accurate task assignment method must be developed to achieve high efficiency in smart warehouses; however, existing task assignment methods use limited information, resulting in a lack of insight regarding future tasks in warehouses. This paper proposes a method based on the deep Q-network (DQN) that considers inventory for task assignments. The developed DQN-based model determines shelf return locations on the basis of current states to improve warehouse performance. The proposed method was compared with a traditional task assignment method, namely regret and marginal-cost based task assignment algorithm; the results indicated the proposed approach is more efficient and faster than the traditional method and can accommodate more robots.