Toward Use of Facial Thermal Features in Dynamic Assessment of Affect and Arousal Level

Automated assessment of affect and arousal level can help psychologists and psychiatrists in clinical diagnoses; and may enable affect-aware robot-human interaction. This work identifies major difficulties in automating affect and arousal assessment and attempts to overcome some of them. We first an...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on affective computing 2017-07, Vol.8 (3), p.412-425
Main Authors: Khan, Masood Mehmood, Ward, Robert D., Ingleby, Michael
Format: Article
Language:English
Subjects:
affect arousal assessment
affect classification
Affect-aware agents
Arousal
Automation
Centroids
Clusters
Encoding
Extraterrestrial measurements
Facial muscles
human-robot interaction
Infrared analysis
Infrared imagery
Muscles
Pattern recognition
Skin
Temperature measurement
Thermal measurement
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automated assessment of affect and arousal level can help psychologists and psychiatrists in clinical diagnoses; and may enable affect-aware robot-human interaction. This work identifies major difficulties in automating affect and arousal assessment and attempts to overcome some of them. We first analyze thermal infrared images and examine how changes in affect and/or arousal level would cause hæmodynamic variations, concentrated along certain facial muscles. These concentrations are used to measure affect/arousal induced facial thermal variations. In step-1 of a 2-step pattern recognition schema, `between-affect' and `between-arousal-level' variations are used to derive facial thermal features as Principal Components (PCs) of the facial thermal measurements. The most influential of these PCs are used to cluster the feature space for different affects and subsequently assign a set of thermal features to an affect cluster. In step-2, affect clusters are partitioned into high, medium and mild arousal levels. The distance between a test face vector and the centroids of sub-clusters at three arousal levels belonging to a single affective state, identified from step-1, is used to determine the arousal level of the identified affective state.
ISSN:1949-3045
1949-3045
DOI:10.1109/TAFFC.2016.2535291