An affect-based classification of emotions associated with images of food

• Published in: Journal of food measurement & characterization 2021-02, Vol.15 (1), p.519-530
• Main Authors: Tahir, Yusra, Rahman, Anis Ur, Ravana, Sri Devi
• Format: Article
• Language: English
• Subjects: Arousal; Chemistry; Chemistry and Materials Science; Chemistry/Food Science; Classification; Emotions; Engineering; Feature extraction; Food; Food Science; Image classification; Learning algorithms; Machine learning; Original Paper
• ISSN: 2193-4126; 2193-4134
• DOI: 10.1007/s11694-020-00650-7

Food and emotions are correlated. Recent research on the relationship between foods and emotions mainly focused on identifying emotions when viewing food images. The studies try to find image attributes that evoke food-related emotions. We concentrate on affective image classification and investigate the performance of different features in a food-related emotion classification framework. First, we extract features of different levels for each food image. Very basic low-level features and art features derived from principle-of-art features are extracted as mid-level features. Then, we develop models for valence-arousal affect dimensions trained using different machine learning techniques. Extensive experiments are conducted on a combined food image dataset. The results demonstrate the effectiveness of the proposed food-related emotion classification method. The results demonstrate the effectiveness of the proposed food-related emotion classification model by comparing different classifiers for the two affect dimensions (valence and arousal), resulting in an accuracy of 67% and 88% respectively.