Evolutionary Multitasking for Large-Scale Multiobjective Optimization

• Published in: IEEE transactions on evolutionary computation 2023-08, Vol.27 (4), p.863-877
• Main Authors: Liu, Songbai, Lin, Qiuzhen, Feng, Liang, Wong, Ka-Chun, Tan, Kay Chen
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial neural networks; Back propagation networks; Coders; Computer science; Evolutionary algorithm (EA); Evolutionary computation; Knowledge management; large-scale multiobjective optimization; Machine learning; Multiple objective analysis; Multitasking; Optimization; Pareto optimization; Sociology; Task analysis; Training; Transfer learning
• ISSN: 1089-778X; 1941-0026
• DOI: 10.1109/TEVC.2022.3166482

Evolutionary transfer optimization (ETO) has been becoming a hot research topic in the field of evolutionary computation, which is based on the fact that knowledge learning and transfer across the related optimization exercises can improve the efficiency of others. However, rare studies employ ETO to solve large-scale multiobjective optimization problems (LMOPs). To fill this research gap, this article proposes a new multitasking ETO algorithm via a powerful transfer learning model to simultaneously solve multiple LMOPs. In particular, inspired by adversarial domain adaptation in transfer learning, a discriminative reconstruction network (DRN) model (containing an encoder, a decoder, and a classifier) is created for each LMOP. At each generation, the DRN is trained by the currently obtained nondominated solutions for all LMOPs via backpropagation with gradient descent. With this well-trained DRN model, the proposed algorithm can transfer the solutions of source LMOPs directly to the target LMOP for assisting its optimization, can evaluate the correlation between the source and target LMOPs to control the transfer of solutions, and can learn a dimensional-reduced Pareto-optimal subspace of the target LMOP to improve the efficiency of transfer optimization in the large-scale search space. Moreover, we propose a real-world multitasking LMOP suite to simulate the training of deep neural networks (DNNs) on multiple different classification tasks. Finally, the effectiveness of the proposed algorithm has been validated in this real-world problem suite and the other two synthetic problem suites.