ODO: Design of Multimodal Chatbot for an Experiential Media System

This paper presents the design of a multimodal chatbot for use in an interactive theater performance. This chatbot has an architecture consisting of vision and natural language processing capabilities, as well as embodiment in a non-anthropomorphic movable LED array set in a stage. Designed for inte...

Full description

Saved in:
Bibliographic Details
Published in:Multimodal technologies and interaction 2020-12, Vol.4 (4), p.68
Main Authors: Bhushan, Ravi, Kulkarni, Karthik, Pandey, Vishal Kumar, Rawls, Connor, Mechtley, Brandon, Jayasuriya, Suren, Ziegler, Christian
Format: Article
Language:English
Subjects:
chatbots
digital theater
media arts
performing arts
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents the design of a multimodal chatbot for use in an interactive theater performance. This chatbot has an architecture consisting of vision and natural language processing capabilities, as well as embodiment in a non-anthropomorphic movable LED array set in a stage. Designed for interaction with up to five users at a time, the system can perform tasks including face detection and emotion classification, tracking of crowd movement through mobile phones, and real-time conversation to guide users through a nonlinear story and interactive games. The final prototype, named ODO, is a tangible embodiment of a distributed multimedia system that solves several technical challenges to provide users with a unique experience through novel interaction.
ISSN:2414-4088
2414-4088
DOI:10.3390/mti4040068