Multi-label feature selection based on manifold regularization and imbalance ratio

• Published in: Applied intelligence (Dordrecht, Netherlands) Netherlands), 2022-08, Vol.52 (10), p.11652-11671
• Main Authors: Lu, Haohan, Chen, Hongmei, Li, Tianrui, Chen, Hao, Luo, Chuan
• Format: Article
• Language: English
• Subjects: Algorithms; Artificial Intelligence; Computer Science; Feature selection; Labels; Machine learning; Machines; Manifolds (mathematics); Manufacturing; Mechanical Engineering; Processes; Regularization
• ISSN: 0924-669X; 1573-7497
• DOI: 10.1007/s10489-021-03141-4

The dimension of data in the domain of multi-label learning is usually high, which makes the calculation cost very high. As an important data dimension reduction technology, feature selection has attracted the attention of many researchers. And the imbalance of data labels is also one of the factors that perplex multi-label learning. To tackle these problems, we propose a new multi-label feature selection algorithm named IMRFS, which combines manifold learning and label imbalance. Firstly, in order to keep the manifold structure between samples, the Laplacian graph is used to construct the manifold regularization. In addition, the local manifold structure of each label is considered to find the correlation between labels. And the imbalance distribution of labels is also considered, which is embedded into the manifold structure of labels. Furthermore, in order to ensure the robustness and sparsity of the IMRFS method, the L 2,1 -norm is applied to loss function and sparse regularization term simultaneously. Then, we adopt an iterative strategy to optimize the objective function of IMRFS. Finally, comparison results on multiple datasets show the effectiveness of IMRFS method.