Design of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module

Current EEG-based brain-computer interface technologies mainly focus on how to independently use SSVEP, motor imagery, P300, or other signals to recognize human intention and generate several control commands. SSVEP and P300 require external stimulus, while motor imagery does not require it. However...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on autonomous mental development 2015-12, Vol.7 (4), p.332-341
Main Authors: Duan, Feng, Lin, Dongxue, Li, Wenyu, Zhang, Zhao
Format: Article
Language:English
Subjects:
Automobile industry
Biomedical image processing
Brain modeling
Brain-computer interface (BCI)
Commands
Control systems
electroencephalogram (EEG)
Electroencephalography
Emulation
Human-computer interface
Hybrid systems
Imagery
motor imagery (MI)
Motors
Robot control
Robots
service robot
Service robots
steady-state visual evoked potential (SSVEP)
Virtual reality
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Current EEG-based brain-computer interface technologies mainly focus on how to independently use SSVEP, motor imagery, P300, or other signals to recognize human intention and generate several control commands. SSVEP and P300 require external stimulus, while motor imagery does not require it. However, the generated control commands of these methods are limited and cannot control a robot to provide satisfactory service to the user. Taking advantage of both SSVEP and motor imagery, this paper aims to design a hybrid BCI system that can provide multimodal BCI control commands to the robot. In this hybrid BCI system, three SSVEP signals are used to control the robot to move forward, turn left, and turn right; one motor imagery signal is used to control the robot to execute the grasp motion. In order to enhance the performance of the hybrid BCI system, a visual servo module is also developed to control the robot to execute the grasp task. The effect of the entire system is verified in a simulation platform and a real humanoid robot, respectively. The experimental results show that all of the subjects were able to successfully use this hybrid BCI system with relative ease.
ISSN:1943-0604
2379-8920
1943-0612
2379-8939
DOI:10.1109/TAMD.2015.2434951