Waving Real Hand Gestures Recorded by Wearable Motion Sensors to a Virtual Car and Driver in a Mixed-Reality Parking Game

We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures reco...

Full description

Saved in:
Bibliographic Details
Main Authors: Bannach, D., Amft, O., Kunze, K.S., Heinz, E.A., Troster, G., Lukowicz, P.
Format: Conference Proceeding
Language:English
Subjects:
Ambient intelligence
Application software
Computer applications
Computer graphics
Context awareness
Game Control
Gesture Recognition
Humans
Immersive Human-Computer Interaction
Intelligent sensors
Java-3D
Mixed Reality
Motion Sensors
Pervasive computing
Virtual reality
Wearable Computing
Wearable sensors
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We envision to add context awareness and ambient intelligence to edutainment and computer gaming applications in general. This requires mixed-reality setups and ever-higher levels of immersive human-computer interaction. Here, we focus on the automatic recognition of natural human hand gestures recorded by inexpensive, wearable motion sensors. To study the feasibility of our approach, we chose an educational parking game with 3D graphics that employs motion sensors and hand gestures as its sole game controls. Our implementation prototype is based on Java-3D for the graphics display and on our own CRN Toolbox for sensor integration. It shows very promising results in practice regarding game appeal, player satisfaction, extensibility, ease of interfacing to the sensors, and - last but not least - sufficient accuracy of the real-time gesture recognition to allow for smooth game control. An initial quantitative performance evaluation confirms these notions and provides further support for our setup
ISSN:2325-4270
DOI:10.1109/CIG.2007.368076