Improved firefly algorithm for feature selection with the ReliefF-based initialization and the weighted voting mechanism

• Published in: Neural computing & applications 2023, Vol.35 (1), p.275-301
• Main Authors: Yong, Xin, Gao, Yue-lin
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial Intelligence; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data mining; Data Mining and Knowledge Discovery; Datasets; Feature selection; Heuristic methods; Image Processing and Computer Vision; Mutation; Original Article; Probability and Statistics in Computer Science; Voting
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-022-07755-8

Feature selection has become popular in data mining tasks currently for its ability of improving the performance of the algorithm and gaining more information about the dataset. Although the firefly algorithm is a well-performed heuristic algorithm, there is still much room for improvement as to the feature selection problem. In this research, an improved firefly algorithm designed for feature selection with the ReliefF-based initialization method and the weighted voting mechanism is proposed. First of all, a feature grouping initialization method that combines the results of the ReliefF algorithm and the cosine similarity is designed to take place of random initialization. Then, the direction of the firefly is modified to move toward the optimal solution. Finally, inspired by the ensemble algorithm, a weighted voter is proposed to build recommended positions for fireflies, which is also integrated with the elite crossover operator and the mutation operator to improve the diversity of the population. Selected from the mixed swarm, a new population is constructed to replace the original population in the next stage. To verify the effectiveness of the algorithm proposed in this paper, 18 datasets are utilized and 9 comparison algorithms (e.g., Black Hole Algorithm, Grey Wolf Optimizer and Pigeon Inspired Optimizer) from state-of-the-art related works are selected for the simulating experiments. The experimental results demonstrate the superiority of the proposed algorithm applied to the feature selection problem.