MuMMER: Socially Intelligent Human-Robot Interaction in Public Spaces

In the EU-funded MuMMER project, we have developed a social robot designed to interact naturally and flexibly with users in public spaces such as a shopping mall. We present the latest version of the robot system developed during the project. This system encompasses audio-visual sensing, social sign...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2019-09
Main Authors: Foster, Mary Ellen, Craenen, Bart, Deshmukh, Amol, Lemon, Oliver, Bastianelli, Emanuele, Dondrup, Christian, Papaioannou, Ioannis, Vanzo, Andrea, Jean-Marc Odobez, Canévet, Olivier, Cao, Yuanzhouhan, He, Weipeng, Martínez-González, Angel, Motlicek, Petr, Siegfried, Rémy, Alami, Rachid, Belhassein, Kathleen, Buisan, Guilhem, Clodic, Aurélie, Mayima, Amandine, Sallami, Yoan, Sarthou, Guillaume, Phani-Teja Singamaneni, Waldhart, Jules, Mazel, Alexandre, Caniot, Maxime, Niemelä, Marketta, Heikkilä, Päivi, Lammi, Hanna, Tammela, Antti
Format: Article
Language:English
Subjects:
Geometric reasoning
Human engineering
Motion planning
Public spaces
Robots
Shopping centers
Shopping malls
Signal processing
Visual signals
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In the EU-funded MuMMER project, we have developed a social robot designed to interact naturally and flexibly with users in public spaces such as a shopping mall. We present the latest version of the robot system developed during the project. This system encompasses audio-visual sensing, social signal processing, conversational interaction, perspective taking, geometric reasoning, and motion planning. It successfully combines all these components in an overarching framework using the Robot Operating System (ROS) and has been deployed to a shopping mall in Finland interacting with customers. In this paper, we describe the system components, their interplay, and the resulting robot behaviours and scenarios provided at the shopping mall.
ISSN:2331-8422