Blockchain-Based Resource Trading in Multi-UAV-Assisted Industrial IoT Networks: A Multi-Agent DRL Approach

• Published in: IEEE eTransactions on network and service management 2023-03, Vol.20 (1), p.166-181
• Main Authors: Abegaz, Mohammed Seid, Abishu, Hayla Nahom, Yacob, Yasin Habtamu, Ayall, Tewodros Alemu, Erbad, Aiman, Guizani, Mohsen
• Format: Article
• Language: English
• Subjects: Algorithms; Blockchain; Blockchains; Cryptography; DRL; Electronic devices; Energy storage; Game theory; Games; Heuristic algorithms; Industrial applications; Industrial Internet of Things; industrial IoT; Internet of Things; Multiagent systems; Network latency; Optimization; Pricing; Quality of service; Radio equipment; Resource management; resource trading; Security; Unmanned aerial vehicles
• ISSN: 1932-4537; 1932-4537
• DOI: 10.1109/TNSM.2022.3197309

With the Industrial Internet of Things (IIoT), mobile devices (MDs) and their demands for low-latency data communication are increasing. Due to the limited resources of MDs, such as energy, computation, storage, and bandwidth, IIoT systems cannot meet MDs' quality of service (QoS) and security requirements. Recently, UAVs have been deployed as aerial base stations in the IIoT network to provide connectivity and share resources with MDs. We consider a resource trading environment where multiple resource providers compete to sell their resources to MDs and maximize their profit by continually adjusting their pricing strategies. Multiple MDs, on the other hand, interact with the environment to make purchasing decisions based on the prices set by resource providers to reduce costs and improve QoS. We propose a novel intelligent resource trading framework that integrates multi-agent deep reinforcement Learning (MADRL), blockchain, and game theory to manage dynamic resource trading environments. A consortium blockchain with a smart contract is deployed to ensure the security and privacy of the resource transactions. We formulated the optimization problem using a Stackelberg game. However, the formulated optimization problem in the multi-agent IIoT environment is complex and dynamic, making it difficult to solve directly. Thus, we transform it into a stochastic game to solve the dynamics of the optimization problem. We propose a dynamic pricing algorithm that combines the Stackelberg game with the MADRL algorithm to solve the formulated stochastic game. The simulation results show that our proposed scheme outperforms others to improve resource trading in UAV-assisted IIoT networks.