Analysis of preprocessing methods on classification of Turkish texts

Preprocessing is an important task and critical step in information retrieval and text mining. The objective of this study is to analyze the effect of preprocessing methods in text classification on Turkish texts. We compiled two large datasets from Turkish newspapers using a crawler. On these compi...

Full description

Saved in:
Bibliographic Details
Main Authors: Torunoglu, D., Cakirman, E., Ganiz, M. C., Akyokus, S., Gurbuz, M. Z.
Format: Conference Proceeding
Language:English
Subjects:
Classification algorithms
Data preprocessing
Filtering
Information retrieval
stemming
stopword removal
Support vector machines
Text categorization
Text Classification
Text mining
Training
Turkish Text Classification
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Preprocessing is an important task and critical step in information retrieval and text mining. The objective of this study is to analyze the effect of preprocessing methods in text classification on Turkish texts. We compiled two large datasets from Turkish newspapers using a crawler. On these compiled data sets and using two additional datasets, we perform a detailed analysis of preprocessing methods such as stemming, stopword filtering and word weighting for Turkish text classification on several different Turkish datasets. We report the results of extensive experiments.
DOI:10.1109/INISTA.2011.5946084