Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering

• Published in: The Journal of supercomputing 2017-11, Vol.73 (11), p.4773-4795
• Main Authors: Abualigah, Laith Mohammad, Khader, Ahamad Tajudin
• Format: Article
• Language: English
• Subjects: Algorithms; Clustering; Compilers; Computation; Computer Science; Interpreters; Operators; Optimization algorithms; Particle swarm optimization; Performance enhancement; Performance evaluation; Processor Architectures; Programming Languages; Vector quantization
• ISSN: 0920-8542; 1573-0484
• DOI: 10.1007/s11227-017-2046-2

The text clustering technique is an appropriate method used to partition a huge amount of text documents into groups. The documents size affects the text clustering by decreasing its performance. Subsequently, text documents contain sparse and uninformative features, which reduce the performance of the underlying text clustering algorithm and increase the computational time. Feature selection is a fundamental unsupervised learning technique used to select a new subset of informative text features to improve the performance of the text clustering and reduce the computational time. This paper proposes a hybrid of particle swarm optimization algorithm with genetic operators for the feature selection problem. The k-means clustering is used to evaluate the effectiveness of the obtained features subsets. The experiments were conducted using eight common text datasets with variant characteristics. The results show that the proposed algorithm hybrid algorithm (H-FSPSOTC) improved the performance of the clustering algorithm by generating a new subset of more informative features. The proposed algorithm is compared with the other comparative algorithms published in the literature. Finally, the feature selection technique encourages the clustering algorithm to obtain accurate clusters.