Beyond vector space model for hierarchical Arabic text classification: A Markov chain approach

The vector space model (VSM) is a textual representation method that is widely used in documents classification. However, it remains to be a space-challenging problem. One attempt to alleviate the space problem is by using dimensionality reduction techniques, however, such techniques have deficienci...

Full description

Saved in:
Bibliographic Details
Published in:Information processing & management 2018-01, Vol.54 (1), p.105-115
Main Authors: Al-Anzi, Fawaz S., AbuZeina, Dia
Format: Article
Language:English
Subjects:
Algebra
Arabic text
Classification
Data acquisition
Data collection
Hierarchy
Markov analysis
Markov chain
Markov chains
Reduction
Semantics
Text categorization
Vector space
Vector space model
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The vector space model (VSM) is a textual representation method that is widely used in documents classification. However, it remains to be a space-challenging problem. One attempt to alleviate the space problem is by using dimensionality reduction techniques, however, such techniques have deficiencies such as losing some important information. In this paper, we propose a novel text classification method that neither uses VSM nor dimensionality reduction techniques. The proposed method is a space efficient method that utilizes the first order Markov model for hierarchical Arabic text classification. For each category and sub-category, a Markov chain model is prepared based on the neighboring characters sequences. The prepared models are then used for scoring documents for classification purposes. For evaluation, we used a hierarchical Arabic text data collection that contains 11,191 documents that belong to eight topics distributed into 3-levels. The experimental results show that the Markov chains based method significantly outperforms the baseline system that employs the latent semantic indexing (LSI) method. That is, the proposed method enhances the F1-measure by 3.47%. The novelty of this work lies on the idea of decomposing words into sequences of characters, which found to be a promising approach in terms of space and accuracy. Based on our best knowledge, this is the first attempt to conduct research for hierarchical Arabic text classification with such relatively large data collection.
ISSN:0306-4573
1873-5371
DOI:10.1016/j.ipm.2017.10.003