A distributed feature selection scheme with partial information sharing

• Published in: Machine learning 2019-11, Vol.108 (11), p.2009-2034
• Main Authors: Brankovic, Aida, Piroddi, Luigi
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Classification; Computer Science; Computing time; Control; Mechatronics; Microprocessors; Natural Language Processing (NLP); Partitioning; Processors; Robotics; Simulation and Modeling
• ISSN: 0885-6125; 1573-0565
• DOI: 10.1007/s10994-019-05809-y

This paper introduces a novel feature selection and classification method, based on vertical data partitioning and a distributed searching architecture. The features are divided into subsets, each of which is associated to a dedicated processor that performs a local search. When all local selection processes are completed, each processor shares the features of its locally selected model with all other processors, and the local searches are repeated until convergence. Thanks to the vertical partitioning and the distributed selection scheme, the presented method is capable of addressing relatively large scale examples. The procedure is efficient since the local processors perform the selection tasks in parallel and on much smaller search spaces. Another important feature of the proposed method is its tendency to produce simple model structures, which is generally advantageous for the interpretability and robustness of the classifier. The proposed approach is evaluated and compared to other well-known feature selection and classification approaches proposed in the literature on several benchmark datasets. The obtained results demonstrate the effectiveness of the proposed approach, both in terms of classification accuracy and computational time.