Research on Chinese Text Automatic Categorization Based on VSM

Automatic text classifying is an import application of the information processing technology. This paper introduces the key techniques of Chinese text categorization such as text preprocessing, feature selection, feature representation, training and classifying algorithm, especially analyses the cur...

Full description

Saved in:
Bibliographic Details
Main Authors: Tong, Xiao-Jun, Cui, Ming-Gen, Song, Guo-Long
Format: Conference Proceeding
Language:English
Subjects:
Application software
Computer science
Educational institutions
Frequency
Information processing
Information science
Natural languages
Space technology
Text categorization
Vocabulary
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automatic text classifying is an import application of the information processing technology. This paper introduces the key techniques of Chinese text categorization such as text preprocessing, feature selection, feature representation, training and classifying algorithm, especially analyses the current most important several feature selection methods with emphasis. A Chinese text classifier based on KNN algorithm was developed. The system can preferably implement Chinese automatic text categorization and has a higher quality. We also use this classifier to compare several feature selection methods. In the end, we utilize the experiment results to prove the importance role of feature selection in text categorization.
ISSN:2161-9646
DOI:10.1109/WICOM.2007.955