Multi-Modal Sentiment Classification With Independent and Interactive Knowledge via Semi-Supervised Learning

Multi-modal sentiment analysis extends conventional text-based definition of sentiment analysis to a multi-modal setup where multiple relevant modalities are leveraged to perform sentiment analysis. In real applications, however, acquiring annotated multi-modal data is normally labor expensive and t...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2020, Vol.8, p.22945-22954
Main Authors: Zhang, Dong, Li, Shoushan, Zhu, Qiaoming, Zhou, Guodong
Format: Article
Language:English
Subjects:
Annotations
Classification
Data acquisition
Data mining
Decoding
Empirical analysis
Feature extraction
Modal data
multimedia computing
Natural language processing
Semi-supervised learning
Semisupervised learning
Sentiment analysis
Supervised learning
Videos
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Multi-modal sentiment analysis extends conventional text-based definition of sentiment analysis to a multi-modal setup where multiple relevant modalities are leveraged to perform sentiment analysis. In real applications, however, acquiring annotated multi-modal data is normally labor expensive and time-consuming. In this paper, we aim to reduce the annotation effort for multi-modal sentiment classification via semi-supervised learning. The key idea is to leverage the semi-supervised variational autoencoders to mine more information from unlabeled data for multi-modal sentiment analysis. Specifically, the mined information includes both the independent knowledge within single modality and the interactive knowledge among different modalities. Empirical evaluation demonstrates the great effectiveness of the proposed semi-supervised approach to multi-modal sentiment classification.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2020.2969205