Arabic text clustering using improved clustering algorithms with dimensionality reduction

• Published in: Cluster computing 2019-03, Vol.22 (Suppl 2), p.4535-4549
• Main Authors: Sangaiah, Arun Kumar, Fakhry, Ahmed E., Abdel-Basset, Mohamed, El-henawy, Ibrahim
• Format: Article
• Language: English
• Subjects: Algorithms; Arabic language; Cluster analysis; Clustering; Computer Communication Networks; Computer Science; Data mining; Datasets; Documents; Feature selection; Machine learning; Methods; Operating Systems; Pattern recognition; Processor Architectures; Reduction; Similarity; Support vector machines; Vector space; Weighting methods; Words (language)
• ISSN: 1386-7857; 1573-7543
• DOI: 10.1007/s10586-018-2084-4

Arabic Text document clustering is an important aspect for providing conjectural navigation and browsing techniques by organizing massive amounts of data into a small number of defined clusters. However, Words in form of vector are used for clustering methods is often unsatisfactory as it ignores relationships between important terms. Cluster analysis separates data into groups on clusters for the purposes of improved understanding or summarization. Clustering has a long history and many techniques developed in statistics, data mining, pattern recognition and other fields. This research proposes three approaches; Unsupervised, Semi Supervised techniques and Semi Supervised with dimensionality reduction to construct a clustering based classifier for Arabic text documents. Using k-means, incremental k-means, Threshold + k-means and k-means with dimensionality reduction, after document preprocessing removing stop words and gets the root for each term in each document. Then apply a term weighting method to get the weight of each term with respect to its document. Then apply a similarity measure method to each document and its similarity with other documents. And using F-measure, entropy and support vector machine (SVM) for calculate accuracy. The datasets are online dynamic datasets that are characterized by its availability and credibility on the internet. Arabic language is a challenging language when applied in an inference based algorithm. So, selecting the appropriate dataset is a principal factor in such research. The accuracy of those methods compared with other approaches and the proposed methods shows better accuracy and fewer errors for new classification test cases. Considering that the dimension reduction process is very sensitive because increasing the ratio of reduction can destroy important terms.