Automatic prediction of frustration

• Published in: International journal of human-computer studies 2007-08, Vol.65 (8), p.724-736
• Main Authors: Kapoor, Ashish, Burleson, Winslow, Picard, Rosalind W.
• Format: Article
• Language: English
• Subjects: Affect recognition; Affective Learning Companion; Applied sciences; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Exact sciences and technology; General aspects; Intelligent Tutoring System; Learner state assessment; Occupational training. Personnel. Work management; Software
• ISSN: 1071-5819; 1095-9300
• DOI: 10.1016/j.ijhcs.2007.02.003

Predicting when a person might be frustrated can provide an intelligent system with important information about when to initiate interaction. For example, an automated Learning Companion or Intelligent Tutoring System might use this information to intervene, providing support to the learner who is likely to otherwise quit, while leaving engaged learners free to discover things without interruption. This paper presents the first automated method that assesses, using multiple channels of affect-related information, whether a learner is about to click on a button saying “I’m frustrated.” The new method was tested on data gathered from 24 participants using an automated Learning Companion. Their indication of frustration was automatically predicted from the collected data with 79% accuracy ( chance = 58 % ) . The new assessment method is based on Gaussian process classification and Bayesian inference. Its performance suggests that non-verbal channels carrying affective cues can help provide important information to a system for formulating a more intelligent response.