Automatic Cognitive Load Detection from Face, Physiology, Task Performance and Fusion During Affective Interference

Cognitive load (CL) is experienced during critical tasks and also while engaged emotional states are induced either by the task itself or by extraneous experiences. Emotions irrelevant to the working memory representation may interfere with the processing of relevant tasks and can influence task per...

Full description

Saved in:
Bibliographic Details
Published in:Interacting with computers 2014-05, Vol.26 (3), p.256-268
Main Authors: Hussain, M. Sazzad, Calvo, Rafael A., Chen, Fang
Format: Article
Language:English
Subjects:
Accuracy
Automation
Emotions
Interference
Physiology
Representations
Stimuli
Tasks
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Cognitive load (CL) is experienced during critical tasks and also while engaged emotional states are induced either by the task itself or by extraneous experiences. Emotions irrelevant to the working memory representation may interfere with the processing of relevant tasks and can influence task performance and behavior, making the accurate detection of CL from nonverbal information challenging. This paper investigates automatic CL detection from facial features, physiology and task performance under affective interference. Data were collected from participants (n=20) solving mental arithmetic tasks with emotional stimuli in the background, and a combined classifier was used for detecting CL levels. Results indicate that the face modality for CL detection was more accurate under affective interference, whereas physiology and task performance were more accurate without the affective interference. Multimodal fusion improved detection accuracies, but it was less accurate under affective interferences. More specifically, the accuracy decreased with an increasing intensity of emotional arousal.
ISSN:0953-5438
1873-7951
DOI:10.1093/iwc/iwt032