PID-inspired modifications in response threshold models in swarm intelligent systems

• Published in: arXiv.org 2023-04
• Main Authors: Kebari, Maryam, Wu, Annie S, Mathias, H David
• Format: Article
• Language: English
• Subjects: Communication; Demand; Intelligent systems; Learning; Proportional integral derivative; System effectiveness; Thresholds
• ISSN: 2331-8422
• DOI: 10.48550/arxiv.2304.12385

In this study, we investigate the effectiveness of using the PID (Proportional - Integral - Derivative) control loop factors for modifying response thresholds in a decentralized, non-communicating, threshold-based swarm. Each agent in our swarm has a set of four thresholds, each corresponding to a task the agent is capable of performing. The agent will act on a particular task if the stimulus is higher than its corresponding threshold. The ability to modify their thresholds allows the agents to specialize dynamically in response to task demands. Current approaches to dynamic thresholds typically use a learning and forgetting process to adjust thresholds. These methods are able to effectively specialize once, but can have difficulty re-specializing if the task demands change. Our approach, inspired by the PID control loop, alters the threshold values based on the current task demand value, the change in task demand, and the cumulative sum of previous task demands. We show that our PID-inspired method is scalable and outperforms fixed and current learning and forgetting response thresholds with non-changing, constant, and abrupt changes in task demand. This superior performance is due to the ability of our method to re-specialize repeatedly in response to changing task demands.