Sign language learning using the hangman videogame

This paper describes the preliminary study and development of a videogame aimed at learning the alphabet in Portuguese sign language, through gestures. Leap Motion Controller is used, allowing the detection of fingers and hands with high accuracy and resolution. The project is based on the well-know...

Full description

Saved in:
Bibliographic Details
Main Authors: Soares, Filomena, Esteves, Joao Sena, Carvalho, Vitor, Moreira, Carlos, Lourenco, Pedro
Format: Conference Proceeding
Language:English
Subjects:
Alphabets
Assistive technology
Deaf people
Electronic & video games
Fingers
Games
Gesture recognition
Hand (anatomy)
Hangman game
Interactive
Leap Motion
Learning
Recording
Sign language
Speech
Speech recognition
Thumb
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper describes the preliminary study and development of a videogame aimed at learning the alphabet in Portuguese sign language, through gestures. Leap Motion Controller is used, allowing the detection of fingers and hands with high accuracy and resolution. The project is based on the well-known hangman game. The player inputs the gestures that represent the letters of the alphabet in the sign language. The Leap Trainer framework for gesture and pose learning and recognition was used. This framework is helpful to the development of the proposed game since it allows the recording of a gesture and a subsequent comparison with the recorded gesture, giving a match percentage result. There are many sign language learning games, but they are not interactive. The proposed game is primarily for children but also adequate for adults.
ISSN:2157-023X
2157-0221
DOI:10.1109/ICUMT.2015.7382433