Loading…

Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging

This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset ex...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of biomedical and health informatics 2024-02, Vol.28 (2), p.1031-1042
Main Authors: Jain, Ritika, G., Ramakrishnan A.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93
cites cdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93
container_end_page 1042
container_issue 2
container_start_page 1031
container_title IEEE journal of biomedical and health informatics
container_volume 28
creator Jain, Ritika
G., Ramakrishnan A.
description This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.
doi_str_mv 10.1109/JBHI.2023.3339713
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmed_primary_38051608</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10343118</ieee_id><sourcerecordid>2923136522</sourcerecordid><originalsourceid>FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</originalsourceid><addsrcrecordid>eNpdkVFrFDEQx4MottR-AEEk4IsP7plJdjfJYz2tPakoXH0OuezskbKbrNms2G9vjruKOC-ZDL_5M_Aj5CWwFQDT7798uNmsOONiJYTQEsQTcs6hVRXnTD197EHXZ-Rynu9ZKVVGun1OzoRiDbRMnZPla-zs4PNDtZ3Q-d47eo02LwnpFgd02cfwjn602dKrZT9iyPYwojZ09A7HKSY70HUMGX9n2sdEN-OU4i_s6HdM5T_a4JD6QLcD4kS32e592L8gz3o7zHh5ei_Ij-tPd-ub6vbb58366rZyomG5UooztKC1Fp1zoKyUtgcGvRRCQlcrXivcdW2jeLMTtUbpXIOy1jW0EqwWF-TtMbfc9HPBOZvRzw6HwQaMy2y40ko3gsu6oG_-Q-_jkkK5znDNBYi24bxQcKRcivOcsDdT8qNNDwaYOWgxBy3moMWctJSd16fkZTdi93fjUUIBXh0Bj4j_BIpaACjxB42mj-0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2923136522</pqid></control><display><type>article</type><title>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</title><source>IEEE Xplore (Online service)</source><creator>Jain, Ritika ; G., Ramakrishnan A.</creator><creatorcontrib>Jain, Ritika ; G., Ramakrishnan A.</creatorcontrib><description>This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.</description><identifier>ISSN: 2168-2194</identifier><identifier>ISSN: 2168-2208</identifier><identifier>EISSN: 2168-2208</identifier><identifier>DOI: 10.1109/JBHI.2023.3339713</identifier><identifier>PMID: 38051608</identifier><identifier>CODEN: IJBHA9</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Brain modeling ; Classification ; Context ; Data augmentation ; Datasets ; Decision trees ; EEG ; Electroencephalography ; Electroencephalography - methods ; Electromyography ; Electrooculography ; EMG ; EOG ; Feature extraction ; Humans ; machine learning ; Model accuracy ; Performance enhancement ; Performance evaluation ; Recording ; RUSBoost ; Sleep ; sleep disorders ; Sleep Stages</subject><ispartof>IEEE journal of biomedical and health informatics, 2024-02, Vol.28 (2), p.1031-1042</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</citedby><cites>FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</cites><orcidid>0000-0003-3782-2932 ; 0000-0002-3646-1955</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10343118$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38051608$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Jain, Ritika</creatorcontrib><creatorcontrib>G., Ramakrishnan A.</creatorcontrib><title>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</title><title>IEEE journal of biomedical and health informatics</title><addtitle>JBHI</addtitle><addtitle>IEEE J Biomed Health Inform</addtitle><description>This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.</description><subject>Brain modeling</subject><subject>Classification</subject><subject>Context</subject><subject>Data augmentation</subject><subject>Datasets</subject><subject>Decision trees</subject><subject>EEG</subject><subject>Electroencephalography</subject><subject>Electroencephalography - methods</subject><subject>Electromyography</subject><subject>Electrooculography</subject><subject>EMG</subject><subject>EOG</subject><subject>Feature extraction</subject><subject>Humans</subject><subject>machine learning</subject><subject>Model accuracy</subject><subject>Performance enhancement</subject><subject>Performance evaluation</subject><subject>Recording</subject><subject>RUSBoost</subject><subject>Sleep</subject><subject>sleep disorders</subject><subject>Sleep Stages</subject><issn>2168-2194</issn><issn>2168-2208</issn><issn>2168-2208</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpdkVFrFDEQx4MottR-AEEk4IsP7plJdjfJYz2tPakoXH0OuezskbKbrNms2G9vjruKOC-ZDL_5M_Aj5CWwFQDT7798uNmsOONiJYTQEsQTcs6hVRXnTD197EHXZ-Rynu9ZKVVGun1OzoRiDbRMnZPla-zs4PNDtZ3Q-d47eo02LwnpFgd02cfwjn602dKrZT9iyPYwojZ09A7HKSY70HUMGX9n2sdEN-OU4i_s6HdM5T_a4JD6QLcD4kS32e592L8gz3o7zHh5ei_Ij-tPd-ub6vbb58366rZyomG5UooztKC1Fp1zoKyUtgcGvRRCQlcrXivcdW2jeLMTtUbpXIOy1jW0EqwWF-TtMbfc9HPBOZvRzw6HwQaMy2y40ko3gsu6oG_-Q-_jkkK5znDNBYi24bxQcKRcivOcsDdT8qNNDwaYOWgxBy3moMWctJSd16fkZTdi93fjUUIBXh0Bj4j_BIpaACjxB42mj-0</recordid><startdate>20240201</startdate><enddate>20240201</enddate><creator>Jain, Ritika</creator><creator>G., Ramakrishnan A.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>K9.</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-3782-2932</orcidid><orcidid>https://orcid.org/0000-0002-3646-1955</orcidid></search><sort><creationdate>20240201</creationdate><title>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</title><author>Jain, Ritika ; G., Ramakrishnan A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Brain modeling</topic><topic>Classification</topic><topic>Context</topic><topic>Data augmentation</topic><topic>Datasets</topic><topic>Decision trees</topic><topic>EEG</topic><topic>Electroencephalography</topic><topic>Electroencephalography - methods</topic><topic>Electromyography</topic><topic>Electrooculography</topic><topic>EMG</topic><topic>EOG</topic><topic>Feature extraction</topic><topic>Humans</topic><topic>machine learning</topic><topic>Model accuracy</topic><topic>Performance enhancement</topic><topic>Performance evaluation</topic><topic>Recording</topic><topic>RUSBoost</topic><topic>Sleep</topic><topic>sleep disorders</topic><topic>Sleep Stages</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jain, Ritika</creatorcontrib><creatorcontrib>G., Ramakrishnan A.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Xplore (Online service)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE journal of biomedical and health informatics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Jain, Ritika</au><au>G., Ramakrishnan A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</atitle><jtitle>IEEE journal of biomedical and health informatics</jtitle><stitle>JBHI</stitle><addtitle>IEEE J Biomed Health Inform</addtitle><date>2024-02-01</date><risdate>2024</risdate><volume>28</volume><issue>2</issue><spage>1031</spage><epage>1042</epage><pages>1031-1042</pages><issn>2168-2194</issn><issn>2168-2208</issn><eissn>2168-2208</eissn><coden>IJBHA9</coden><abstract>This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>38051608</pmid><doi>10.1109/JBHI.2023.3339713</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0003-3782-2932</orcidid><orcidid>https://orcid.org/0000-0002-3646-1955</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 2168-2194
ispartof IEEE journal of biomedical and health informatics, 2024-02, Vol.28 (2), p.1031-1042
issn 2168-2194
2168-2208
2168-2208
language eng
recordid cdi_pubmed_primary_38051608
source IEEE Xplore (Online service)
subjects Brain modeling
Classification
Context
Data augmentation
Datasets
Decision trees
EEG
Electroencephalography
Electroencephalography - methods
Electromyography
Electrooculography
EMG
EOG
Feature extraction
Humans
machine learning
Model accuracy
Performance enhancement
Performance evaluation
Recording
RUSBoost
Sleep
sleep disorders
Sleep Stages
title Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T07%3A21%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Modality-Specific%20Feature%20Selection,%20Data%20Augmentation%20and%20Temporal%20Context%20for%20Improved%20Performance%20in%20Sleep%20Staging&rft.jtitle=IEEE%20journal%20of%20biomedical%20and%20health%20informatics&rft.au=Jain,%20Ritika&rft.date=2024-02-01&rft.volume=28&rft.issue=2&rft.spage=1031&rft.epage=1042&rft.pages=1031-1042&rft.issn=2168-2194&rft.eissn=2168-2208&rft.coden=IJBHA9&rft_id=info:doi/10.1109/JBHI.2023.3339713&rft_dat=%3Cproquest_pubme%3E2923136522%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2923136522&rft_id=info:pmid/38051608&rft_ieee_id=10343118&rfr_iscdi=true