Sentiment classification with word localization based on weakly supervised learning with a convolutional neural network

• Published in: Knowledge-based systems 2018-07, Vol.152, p.70-82
• Main Authors: Lee, Gichang, Jeong, Jaeyun, Seo, Seungwan, Kim, CzangYeob, Kang, Pilsung
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Class activation mapping; Classification; Convolutional neural network; Data mining; Datasets; Localization; Mathematical analysis; Matrix methods; Neural networks; Sentences; Sentiment analysis; Supervised learning; Weakly supervised learning; Word localization
• ISSN: 0950-7051; 1872-7409
• DOI: 10.1016/j.knosys.2018.04.006

In order to maximize the applicability of sentiment analysis results, it is necessary to not only classify the overall sentiment (positive/negative) of a given document but also to identify the main words that contribute to the classification. However, most datasets for sentiment analysis only have the sentiment label for each document or sentence. In other words, there is a lack of information about which words play an important role in sentiment classification. In this paper, we propose a method for identifying key words discriminating positive and negative sentences by using a weakly supervised learning method based on a convolutional neural network (CNN). In our model, each word is represented as a continuous-valued vector and each sentence is represented as a matrix whose rows correspond to the word vector used in the sentence. Then, the CNN model is trained using these sentence matrices as inputs and the sentiment labels as the output. Once the CNN model is trained, we implement the word attention mechanism that identifies high-contributing words to classification results with a class activation map, using the weights from the fully connected layer at the end of the learned CNN model. To verify the proposed methodology, we evaluated the classification accuracy and the rate of polarity words among high scoring words using two movie review datasets. Experimental results show that the proposed model can not only correctly classify the sentence polarity but also successfully identify the corresponding words with high polarity scores.