Mouth tracking for hands-free robot control systems

In this paper, we propose a mouth tracking method for remote robot control systems. The main idea behind the work is to help disabled people, who cannot operate any keyboard or joystick, to control a robot without use of their hands. The mouth tracking method is mainly based on the AdaBoost feature...

Full description

Saved in:
Bibliographic Details
Published in:International journal of control, automation, and systems 2014, Automation, and Systems, 12(3), , pp.628-636
Main Authors: Nam, Miyoung, Ahmed, Minhaz Uddin, Shen, Yan, Rhee, Phill Kyu
Format: Article
Language:English
Subjects:
Cameras
Communication
Control
Control systems
Corners
Engineering
Experiments
Human-computer interaction
Interactive computer systems
Internet access
Kalman filters
Keyboards
Machine learning
Mechatronics
Mouth
People with disabilities
Regular Papers
Robot control
Robotics
Robots
Tracking
Webcams
Wireless networks
제어계측공학
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we propose a mouth tracking method for remote robot control systems. The main idea behind the work is to help disabled people, who cannot operate any keyboard or joystick, to control a robot without use of their hands. The mouth tracking method is mainly based on the AdaBoost feature detection approach. By adding new Haar-like features for detecting the corner of the mouth, the speed and accuracy of detection are improved. The AdaBoost feature detection combined with the Kalman filter accomplished continuous and accurate mouth tracking. Meanwhile, the gripping commands for the robot manipulator were obtained through recognition of mouth shape, such as for a pouting mouth or a grinning mouth. To assess the validity of the method, mouth detection experiments and robot cargo transport experiments were conducted. The results indicate that the proposed method can realize mouth tracking and robot operations that are quick and accurate in retrieving items successfully.
ISSN:1598-6446
2005-4092
DOI:10.1007/s12555-012-0473-7