ASL Recognition Based on Kinematics Derived from a Multi-Frequency RF Sensor Network

As a means for leveraging technology in the design of Deaf spaces, this paper presents initial results on American Sign Language (ASL) recognition using RF sensing. RF sensors are non-contact, non-invasive, and protective of privacy, making them of special interest for use in personal areas. Using j...

Full description

Saved in:
Bibliographic Details
Main Authors: Gurbuz, Sevgi Z., Gurbuz, Ali C., Malaia, Evie A., Griffin, Darrin J., Crawford, Chris, Kurtoglu, Emre, Rahman, M. Mahbubur, Aksu, Ridvan, Mdrafi, Robiulhossain
Format: Conference Proceeding
Language:English
Subjects:
American sign language
Assistive technology
Discrete cosine transforms
Feature extraction
Gesture recognition
Radar
radar micro-Doppler
Radio frequency
RF sensing
Support vector machines
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:As a means for leveraging technology in the design of Deaf spaces, this paper presents initial results on American Sign Language (ASL) recognition using RF sensing. RF sensors are non-contact, non-invasive, and protective of privacy, making them of special interest for use in personal areas. Using just the kinematic properties of signing as captured by the micro-Doppler signatures of a multi-frequency RF sensor network, this paper shows that native and imitation signing can be differentiated with %99 accuracy, while up to 20 ASL signs are recognized with an accuracy of %72 or higher.
ISSN:2168-9229
DOI:10.1109/SENSORS47125.2020.9278864