Semi-Supervised Latent Dirichlet Allocation and Its Application for Document Classification

• Main Authors: Wang, Di, Thint, Marcus, Al-Rubaie, Ahmad
• Format: Conference Proceeding
• Language: English
• Subjects: Applied computing > Document management and text processing; Computing methodologies > Artificial intelligence > Natural language processing; Computing methodologies > Machine learning > Learning paradigms > Supervised learning > Supervised learning by classification; Computing methodologies > Machine learning > Machine learning approaches > Classification and regression trees; Latent Dirichlet allocation (LDA); natural language processing; semi-supervised LDA; semi-supervised learning; supervised learning; unsuperviased learning
• DOI: 10.1109/WI-IAT.2012.211

Latent Dirichlet Allocation (LDA) is an unsupervised topic modeling method widely applied in natural language processing. However, standard LDA does not permit the use of supervised labels to incorporate expert knowledge into the learning procedure. This paper describes a semi-supervised LDA (ssLDA) method that supports multiple-topic labels per document, to incorporate available expert knowledge during the model construction. This improvement enables the alignment of resulting model with human expectations for topic modeling and extraction. We apply ssLDA to document classification problem on benchmark datasets. We investigate and compare how the size of training set and proportion of supervised data affect the final model structure and improve the prediction accuracy.