Digital Twin Assisted Resource Allocation for Network Slicing in Industry 4.0 and Beyond Using Distributed Deep Reinforcement Learning

• Published in: IEEE internet of things journal 2023-10, Vol.10 (19), p.1-1
• Main Authors: Tang, Lun, Du, Yucong, Liu, Qinghai, Li, Jinyu, Li, Shirui, Chen, Qianbin
• Format: Article
• Language: English
• Subjects: Algorithms; Closed loops; Convergence; Customization; Deep learning; Digital Twin Network; Digital twins; Equilibrium; Fourth Industrial Revolution; Industrial applications; Industrial Internet of Things; Industry 4.0; Industry 4.0 and Beyond; Industry Internet of Things; Internet of Things; Multiagent systems; Network slicing; Optimization; Prioritized Experience Replay; Resource Allocation; Resource management; Service Equilibrium
• ISSN: 2327-4662; 2327-4662
• DOI: 10.1109/JIOT.2023.3274163

Personalization is one of the primary emerging trends in Industry 4.0 and Beyond. Highly personalized services will present a significant challenge to the existing algorithms for Network Slicing (NS) and resource allocation, leading to issues such as nonequilibratory resource allocation in which some services are sacrificed for the maximum total reward of the algorithm, excessive cost and slow algorithm convergence. Digital Twin Network (DTN) is offered as a novel solution to the challenges listed above. By integrating the DTN and IIoT network slicing, we propose a Digital Twin Network Assisted Industry Internet of Things Network Slicing (DTN-IIoT NS) Architecture for Personalized IIoT services in Industry 4.0 and Beyond. The DTN-IIoT NS Architecture consists of three layers, three modules and two closed loops. On the basis of the aforementioned architecture, we focus on the resource allocation process in DTN-IIoT NS, model the DT-assisted resource allocation for highly personalized IIoT services, propose the service equilibrium rate, and formulate the optimization problem aiming at maximizing the equilibrium rate weighted net profit of network providers. Then, we propose a Dual-Channel Weighted (DCW) Critic network for service equilibrium in DTN-IIoT NS resource allocation and the matching Improved Prioritized Experience Replay (PER) to enhance convergent speed. In addition, we present a distributed DT-assisted DCW-PER Multiagent Deep Deterministic Policy Gradient (PER-DCW MADDPG) algorithm for the resource allocation process in DTN-IIoT NS. Simulation results indicate that the PER-DCW MADDPG algorithm can produce a better service equilibrium and accelerate the convergence speed of the algorithm.