A parametric methodology for text classification

Finding the correct category (class) a new unclassified document belongs to is an interesting and difficult problem, with a wide range of applications. Our methodology for narrative text classification is based on two techniques: we calculate the distance (similarity) between the new unclassified do...

Full description

Saved in:
Bibliographic Details
Published in:Journal of information science 2010-08, Vol.36 (4), p.421-442
Main Authors: Karanikolas, Nikitas N., Skourlas, Christos
Format: Article
Language:English
Subjects:
Algorithms
Automatic classification
Categories
Classification
Collection
Computerized information retrieval
Content analysis
Document management
Exact sciences and technology
Greek language
Indexing. Classification. Abstracting
Indexing. Classification. Abstracting. Syntheses
Information and communication sciences
Information and document structure and analysis
Information processing
Information processing and retrieval
Information retrieval
Information retrieval. Man machine relationship
Information science. Documentation
Mathematical analysis
Methodology
Natural language processing
Research process. Evaluation
Sciences and techniques of general use
Similarity
Studies
Text categorization
Texts
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Finding the correct category (class) a new unclassified document belongs to is an interesting and difficult problem, with a wide range of applications. Our methodology for narrative text classification is based on two techniques: we calculate the distance (similarity) between the new unclassified document and all the pre-classified documents of each class and also calculate the similarity of the new document to the ‘average class document’ of each class. In both cases we use key phrases (text phrases or key terms) as the distinctive features of our text classification methodology and eventually the proposed text classification method is based on the automatic extraction of an authority list of key phrases that is appropriate for discriminating between different classes. In this paper, we apply this methodology in handling Greek text and we present the key concepts, the algorithms, and some critical decisions. A number of parameters of the mining algorithm are also fine tuned. The actual text classification system, the adopted (embedded) ideas and the alternative values of parameters are evaluated using two training sets (test collections).
ISSN:0165-5515
1741-6485
DOI:10.1177/0165551510368620