An Improved Schema of Brain-computer Interface Based on Motor Imagery with Eye Movement

Motor imagery (MI) can induce electroencephalogram (EEG) and realize human-computer interaction, but this kind of interaction has poor robustness and low stability. To solve these problems, we improved MI paradigms with eye movement and proposed convolutional neural network classification models bas...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2022-04, Vol.2219 (1), p.12057
Main Authors: Yu, Hao, Deng, Yifei, Yan, Fuwu, Guan, Zhizhou, Peng, Fuming
Format: Article
Language:English
Subjects:
Accuracy
Artificial neural networks
Attention mechanism
Classification
Comparative studies
Convolutional neural network
Electroencephalography
Eye movement
Eye movements
Human motion
Human-computer interface
Imagery
Modules
Motor imagery
Performance evaluation
Physics
Power spectral density
Signal quality
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Motor imagery (MI) can induce electroencephalogram (EEG) and realize human-computer interaction, but this kind of interaction has poor robustness and low stability. To solve these problems, we improved MI paradigms with eye movement and proposed convolutional neural network classification models based on attention mechanism. We conducted a comparative study to evaluate the performance of MI with different eye movement patterns, i.e. smooth pursuit MI (PMI), saccade MI (SMI) and pure MI. The differences between Squeeze-Excitation (SE) module and Convolutional Block Attention Module (CBAM) module were also explored. The results of power spectral density (PSD) showed that PMI paradigm induced the most significant event-related desynchronization (ERD) phenomenon and the average classification accuracy for PMI signals was also the best in the three paradigms. The combined EEGNet and SE framework achieved an average classification accuracy of 90.77%, which performed better than the model without attention module. PMI can optimize attention allocation of subjects, assist in the construction of motion thinking, and improve the quality of MI signals. EEGNet with SE module showed improved classification performance.
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/2219/1/012057