MuMIA: Multimodal Interactions to Better Understand Art Contexts

Cultural heritage is a challenging domain of application for novel interactive technologies, where varying aspects in the way that cultural assets are delivered play a major role in enhancing the visitor experience, either onsite or online. Technology-supported natural human–computer interaction tha...

Full description

Saved in:
Bibliographic Details
Published in:Applied sciences 2021-03, Vol.11 (6), p.2695
Main Authors: Raptis, George E., Kavvetsos, Giannis, Katsini, Christina
Format: Article
Language:English
Subjects:
Artificial intelligence
Communication
Cultural factors
Cultural heritage
Cultural resources
eye tracking
human–computer interaction
Interactive systems
Interfaces
Keyboards
multimodal interactions
museum
Museum exhibits
Museums
Speech
voice
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Cultural heritage is a challenging domain of application for novel interactive technologies, where varying aspects in the way that cultural assets are delivered play a major role in enhancing the visitor experience, either onsite or online. Technology-supported natural human–computer interaction that is based on multimodalities is a key factor in enabling wider and enriched access to cultural heritage assets. In this paper, we present the design and evaluation of an interactive system that aims to support visitors towards a better understanding of art contexts through the use of a multimodal interface, based on visual and audio interactions. The results of the evaluation study shed light on the dimensions of evoking natural interactions within cultural heritage environments, using micro-narratives for self-exploration and understanding of cultural content, and the intersection between human–computer interaction and artificial intelligence within cultural heritage. We expect our findings to provide useful insights for practitioners and researchers of the broad human–computer interaction and cultural heritage communities on designing and evaluating multimodal interfaces to better support visitor experiences.
ISSN:2076-3417
2076-3417
DOI:10.3390/app11062695