Modeling, Recognizing, and Explaining Apparent Personality From Videos

Explainability and interpretability are two critical aspects of decision support systems. Despite their importance, it is only recently that researchers are starting to explore these aspects. This paper provides an introduction to explainability and interpretability in the context of apparent person...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on affective computing 2022-04, Vol.13 (2), p.894-911
Main Authors: Escalante, Hugo Jair, Kaya, Heysem, Salah, Albert Ali, Escalera, Sergio, Gucluturk, Yagmur, Guclu, Umut, Baro, Xavier, Guyon, Isabelle, Junior, Julio C. S. Jacques, Madadi, Meysam, Ayache, Stephane, Viegas, Evelyne, Gurpnar, Furkan, Wicaksana, Achmadnoer Sukma, Liem, Cynthia C. S., van Gerven, Marcel A. J., van Lier, Rob
Format: Article
Language:English
Subjects:
algorithmic accountability
Computational modeling
Computer vision
Decision support systems
Explainable computer vision
Face
first impressions
Interviews
multimodal information
Personality
personality analysis
Predictive models
Videos
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Explainability and interpretability are two critical aspects of decision support systems. Despite their importance, it is only recently that researchers are starting to explore these aspects. This paper provides an introduction to explainability and interpretability in the context of apparent personality recognition. To the best of our knowledge, this is the first effort in this direction. We describe a challenge we organized on explainability in first impressions analysis from video. We analyze in detail the newly introduced data set, evaluation protocol, proposed solutions and summarize the results of the challenge. We investigate the issue of bias in detail. Finally, derived from our study, we outline research opportunities that we foresee will be relevant in this area in the near future.
ISSN:1949-3045
1949-3045
DOI:10.1109/TAFFC.2020.2973984