An Enhanced Tree Routing Based on Reinforcement Learning in Wireless Sensor Networks

• Published in: Sensors (Basel, Switzerland) Switzerland), 2022-12, Vol.23 (1), p.223
• Main Authors: Kim, Beom-Su, Suh, Beomkyu, Seo, In Jin, Lee, Han Byul, Gong, Ji Seon, Kim, Ki-Il
• Format: Article
• Language: English
• Subjects: Analysis; Business metrics; Decision making; Energy consumption; Energy efficiency; Mathematical optimization; Monitoring systems; multiple objectives; Network latency; Nodes; Q-learning; reinforcement learning; Reinforcement learning (Machine learning); Sensors; Topology; tree-based routing; Wireless networks; Wireless sensor networks; wireless sensor networks (WSNs)
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s23010223

In wireless sensor networks, tree-based routing can achieve a low control overhead and high responsiveness by eliminating the path search and avoiding the use of extensive broadcast messages. However, existing approaches face difficulty in finding an optimal parent node, owing to conflicting performance metrics such as reliability, latency, and energy efficiency. To strike a balance between these multiple objectives, in this paper, we revisit a classic problem of finding an optimal parent node in a tree topology. Our key idea is to find the best parent node by utilizing empirical data about the network obtained through Q-learning. Specifically, we define a state space, action set, and reward function using multiple cognitive metrics, and then find the best parent node through trial and error. Simulation results demonstrate that the proposed solution can achieve better performance regarding end-to-end delay, packet delivery ratio, and energy consumption compared with existing approaches.