Standardization-refinement domain adaptation method for cross-subject EEG-based classification in imagined speech recognition

• Published in: Pattern recognition letters 2021-01, Vol.141, p.54-60
• Main Authors: Jiménez-Guarneros, Magdiel, Gómez-Gil, Pilar
• Format: Article
• Language: English
• Subjects: Adaptation; Classification; Classifiers; Deep learning; Disabilities; Divergence; Domains; EEG; Electroencephalography; Imagined speech; Machine learning; Speech; Speech recognition; Speeches; Standardization; Unsupervised domain adaptation; Voice recognition
• ISSN: 0167-8655; 1872-7344
• DOI: 10.1016/j.patrec.2020.11.013

•We proposed a D-UDA method for cross-subject EEG-based imagined speech recognition.•A novel loss is introduced to refine decision boundaries from target subject data.•The proposed method may build an effective classifier over a target subject.•Our proposal outperforms to other D-UDA methods on two imagined speech datasets. Recent advances in imagined speech recognition from EEG signals have shown their capability of enabling a new natural form of communication, which is posed to improve the lives of subjects with motor disabilities. However, differences among subjects may be an obstacle to the applicability of a previously trained classifier to new users, since a significant amount of labeled samples must be acquired for each new user, making this process tedious and time-consuming. In this sense, unsupervised domain adaptation (UDA) methods, especially those based on deep learning (D-UDA), arise as a potential solution to address this issue by reducing the differences among feature distributions of subjects. It has been shown that the divergence in the marginal and conditional distributions must be reduced to encourage similar feature distributions. However, current D-UDA methods may become sensitive under adaptation scenarios where a low discriminative feature space among classes is given, reducing the accuracy performance of the classifier. To address this issue, we introduce a D-UDA method, named Standardization-Refinement Domain Adaptation (SRDA), which combines Adaptive Batch Normalization (AdaBN) with a novel loss function based on the variation of information (VOI), in order to build an adaptive classifier on EEG data corresponding to imagined speech. Our proposal, applied over two imagined speech datasets, resulted in SRDA outperforming standard classifiers for BCI and existing D-UDA methods, achieving accuracy performances of 61.02±08.14% and 62.99±04.78%, assessed using leave-one-out cross-validation.