Emotion-driven Chinese folk music-image retrieval based on DE-SVM

In this study, we attempt to explore cross-media retrieval between music and image data based on the emotional correlation. Emotion feature analytic could be the bridge of cross-media retrieval, since emotion represents the user׳s perspective and effectively meets the user׳s retrieval need. Currentl...

Full description

Saved in:
Bibliographic Details
Published in:Neurocomputing (Amsterdam) 2015-01, Vol.148, p.619-627
Main Authors: Xing, Baixi, Zhang, Kejun, Sun, Shouqian, Zhang, Lekai, Gao, Zenggui, Wang, Jiaxi, Chen, Shi
Format: Article
Language:English
Subjects:
Anatomical correlates of behavior
Applied sciences
Artificial intelligence
Back propagation
Behavioral psychophysiology
Biological and medical sciences
Computer science
control theory
systems
Cross-media information retrieval
Data processing. List processing. Character string processing
Differential Evolutionary algorithm
Exact sciences and technology
Fundamental and applied biological sciences. Psychology
Image emotion recognition
Information systems. Data bases
Memory organisation. Data processing
Music emotion recognition
Pattern recognition. Digital image processing. Computational geometry
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Software
Support vector machine
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this study, we attempt to explore cross-media retrieval between music and image data based on the emotional correlation. Emotion feature analytic could be the bridge of cross-media retrieval, since emotion represents the user׳s perspective and effectively meets the user׳s retrieval need. Currently, there is little research about the emotion correlation of different multimedia data (e.g. image or music). We propose a promising model based on Differential Evolutionary-Support Vector Machine (DE-SVM) to build up the emotion-driven cross-media retrieval system between Chinese folk image and Chinese folk music. In this work, we first build up the Chinese Folk Music Library and Chinese Folk Image Library.Second, we compare Back Propagation(BP), Linear Regression(LR) and Differential Evolutionary-Support Vector Machine (DE-SVM), and find that DE-SVM has the best performance. Then we conduct DE-SVM to build the optimal model for music/image emotion recognition. Finally, an Emotion-driven Chinese Folk Music-Image Exploring System based on DE-SVM is developed and experiment results show our method is effective in terms of retrieval performance.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2014.08.007