A co-evolutionary migrating birds optimization algorithm based on online learning policy gradient

• Published in: Expert systems with applications 2023-10, Vol.228, p.120261, Article 120261
• Main Authors: Zhao, Fuqing, Jiang, Tao, Xu, Tianpeng, Zhu, Ningning, Jonrinaldi
• Format: Article
• Language: English
• Subjects: Co-evolution; Long short-term memory; Markov decision process; Migrating birds optimization; Policy gradient
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2023.120261

A co-evolutionary migrating birds optimization algorithm based on online learning policy gradient (CMBO-PG) is proposed to address complex continuous real-parameter optimization problems. In CMBO-PG, a Gaussian estimation of distribution algorithm (GEDA), which enhances the exploitation tendency, is utilized to generate the solutions of the leading flock. The neighborhood solutions of the following flock are produced by a multi-strategy learning mechanism to promote exploration capability. The co-evolution of the leading flock and following flock is realized by the information-sharing mechanism and the operation of destruction and construction to keep the balance of exploration and exploitation. The nonlinear selection of mutation strategies is laborious due to the differences in the ability to address optimization problems. In the mechanism of multi-strategy learning, a long short-term memory (LSTM) is adopted as a selector of mutation strategies to predict the selection probability of three mutation strategies. The evolutionary procedure of the following flock is modeled as a Markov decision process (MDP). The policy gradient (PG) is employed as a model optimizer to control the parameters of LSTM based on the historical feedback information. The performance of CMBO-PG is testified on the CEC 2017 benchmark test suite. The experimental results show that CMBO-PG is superior to the 12 comparison algorithms, including state-of-art algorithms.