Optimization of Tongue Gesture Processing Algorithm for Standalone Multimodal Tongue Drive System

Multimodal tongue drive system (mTDS) is an assistive technology, which uses speech, tongue, and head movements of people with tetraplegia to help them control devices such as wheelchairs, PCs, or smartphones. In order to process tongue gestures, it is required to solve the magnetic dipole equation,...

Full description

Saved in:
Bibliographic Details
Published in:IEEE sensors journal 2019-04, Vol.19 (7), p.2704-2712
Main Authors: Sahadat, Md Nazmus, Sebkhi, Nordine, Anderson, David, Ghovanloo, Maysam
Format: Article
Language:English
Subjects:
Algorithms
assistive technology
computer access
embedded systems
Head movement
Headphones
Magnetic dipoles
Magnetic heads
Magnetic moments
magnetometer
Magnetometers
Optimization
Robots
Sensors
Smartphones
Spinal cord injury
Support vector machines
Tongue
tongue drive system
wheelchair navigation
Wheelchairs
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Multimodal tongue drive system (mTDS) is an assistive technology, which uses speech, tongue, and head movements of people with tetraplegia to help them control devices such as wheelchairs, PCs, or smartphones. In order to process tongue gestures, it is required to solve the magnetic dipole equation, which is computationally expensive to execute in a wearable embedded hardware. In this paper, a support vector machine with linear kernel-based algorithm is proposed, which uses an additional magnetometer that has 96.1% accuracy with a 2.2% sensitivity and 1.8% specificity among 15 participants, is computationally efficient for mTDS, generates high-performance classification results despite small changes of magnet positions (−5 to 5 mm) and orientations (−10° to 10°) from a four-dimensional robot emulated tongue movement data compared to five other algorithms. This algorithm generates more accurate results to control devices independently despite the Midas-touch problem between speech and tongue movements.
ISSN:1530-437X
1558-1748
DOI:10.1109/JSEN.2018.2887257