Pattern recognition frequency-based feature selection with multi-objective discrete evolution strategy for high-dimensional medical datasets

• Published in: Expert systems with applications 2024-09, Vol.249, p.123521, Article 123521
• Main Authors: Nematzadeh, Hossein, García-Nieto, José, Aldana-Montes, José F., Navas-Delgado, Ismael
• Format: Article
• Language: English
• Subjects: Feature selection; Filter; High-dimensional datasets; Multi-objective optimization; Wrapper
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2024.123521

Feature selection has a prominent role in high-dimensional datasets to increase classification accuracy, decrease the learning algorithm computational time, and present the most informative features to decision-makers. This paper proposes a two-stage hybrid feature selection for high-dimensional medical datasets: Maximum Pattern Recognition - Multi-objective Discrete Evolution Strategy (MPR-MDES). MPR is a rapid filter ranker that significantly outperforms existing frequency-based rankers in recognizing non-linear patterns, effectively eliminating a majority of non-informative features. Then, the wrapper Multi-objective Discrete Evolution Strategy (MDES) uses the remaining features and obtains sets of solutions which are automatically presented to decision-makers. The experiments conducted on large medical datasets demonstrate that MPR-MDES achieves considerable improvements compared to state-of-the-art methods, in terms of both classification accuracy and dimensionality reduction. In this sense, the proposal successfully performs when presenting informative feature sets to decision-makers. The implementation is available on https://github.com/KhaosResearch/MPR-MDES. [Display omitted] •Maximum Pattern Recognition (MPR) is proposed as a frequency-based filter ranker.•Multi-objective Discrete Evolution Strategy (MDES) is proposed as a wrapper method.•The proposed MPR-MDES selects the best feature sets in the Pareto front.