An Implementation of Multi-Modal Game Interface Based on PDAs

In computer animation and interactive computer games, gesture and speech modality can be a powerful interface between humans and computers. In this paper, we propose a personal digital assistant (PDA)- based multi-modal network game interface using speech, gesture and touch sensations. To verify the...

Full description

Saved in:
Bibliographic Details
Main Authors: Kue-Bum Lee, Jung-Hyun Kim, Kwang-Seok Hong
Format: Conference Proceeding
Language:English
Subjects:
Application software
Computer interfaces
Computer vision
Interactive systems
Mice
Personal digital assistants
Power engineering computing
Speech recognition
Virtual environment
Virtual reality
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In computer animation and interactive computer games, gesture and speech modality can be a powerful interface between humans and computers. In this paper, we propose a personal digital assistant (PDA)- based multi-modal network game interface using speech, gesture and touch sensations. To verify the validity of our approach, we implement a multi-modal omok game using TCP/IP on a PDA network. The experimental results using the proposed multi-modal network game resulted in an average recognition rate of 97.4%, and accordingly as the weaknesses of uni- modality, such as incorrect command processing by recognition error, are offset by the strengths of other modalities, the user can enjoy a more interactive mobile game interface in any given environment.
DOI:10.1109/SERA.2007.48