Loading…
Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging
This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset ex...
Saved in:
Published in: | IEEE journal of biomedical and health informatics 2024-02, Vol.28 (2), p.1031-1042 |
---|---|
Main Authors: | , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93 |
---|---|
cites | cdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93 |
container_end_page | 1042 |
container_issue | 2 |
container_start_page | 1031 |
container_title | IEEE journal of biomedical and health informatics |
container_volume | 28 |
creator | Jain, Ritika G., Ramakrishnan A. |
description | This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients. |
doi_str_mv | 10.1109/JBHI.2023.3339713 |
format | article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmed_primary_38051608</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10343118</ieee_id><sourcerecordid>2923136522</sourcerecordid><originalsourceid>FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</originalsourceid><addsrcrecordid>eNpdkVFrFDEQx4MottR-AEEk4IsP7plJdjfJYz2tPakoXH0OuezskbKbrNms2G9vjruKOC-ZDL_5M_Aj5CWwFQDT7798uNmsOONiJYTQEsQTcs6hVRXnTD197EHXZ-Rynu9ZKVVGun1OzoRiDbRMnZPla-zs4PNDtZ3Q-d47eo02LwnpFgd02cfwjn602dKrZT9iyPYwojZ09A7HKSY70HUMGX9n2sdEN-OU4i_s6HdM5T_a4JD6QLcD4kS32e592L8gz3o7zHh5ei_Ij-tPd-ub6vbb58366rZyomG5UooztKC1Fp1zoKyUtgcGvRRCQlcrXivcdW2jeLMTtUbpXIOy1jW0EqwWF-TtMbfc9HPBOZvRzw6HwQaMy2y40ko3gsu6oG_-Q-_jkkK5znDNBYi24bxQcKRcivOcsDdT8qNNDwaYOWgxBy3moMWctJSd16fkZTdi93fjUUIBXh0Bj4j_BIpaACjxB42mj-0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2923136522</pqid></control><display><type>article</type><title>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</title><source>IEEE Xplore (Online service)</source><creator>Jain, Ritika ; G., Ramakrishnan A.</creator><creatorcontrib>Jain, Ritika ; G., Ramakrishnan A.</creatorcontrib><description>This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.</description><identifier>ISSN: 2168-2194</identifier><identifier>ISSN: 2168-2208</identifier><identifier>EISSN: 2168-2208</identifier><identifier>DOI: 10.1109/JBHI.2023.3339713</identifier><identifier>PMID: 38051608</identifier><identifier>CODEN: IJBHA9</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Brain modeling ; Classification ; Context ; Data augmentation ; Datasets ; Decision trees ; EEG ; Electroencephalography ; Electroencephalography - methods ; Electromyography ; Electrooculography ; EMG ; EOG ; Feature extraction ; Humans ; machine learning ; Model accuracy ; Performance enhancement ; Performance evaluation ; Recording ; RUSBoost ; Sleep ; sleep disorders ; Sleep Stages</subject><ispartof>IEEE journal of biomedical and health informatics, 2024-02, Vol.28 (2), p.1031-1042</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</citedby><cites>FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</cites><orcidid>0000-0003-3782-2932 ; 0000-0002-3646-1955</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10343118$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38051608$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Jain, Ritika</creatorcontrib><creatorcontrib>G., Ramakrishnan A.</creatorcontrib><title>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</title><title>IEEE journal of biomedical and health informatics</title><addtitle>JBHI</addtitle><addtitle>IEEE J Biomed Health Inform</addtitle><description>This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.</description><subject>Brain modeling</subject><subject>Classification</subject><subject>Context</subject><subject>Data augmentation</subject><subject>Datasets</subject><subject>Decision trees</subject><subject>EEG</subject><subject>Electroencephalography</subject><subject>Electroencephalography - methods</subject><subject>Electromyography</subject><subject>Electrooculography</subject><subject>EMG</subject><subject>EOG</subject><subject>Feature extraction</subject><subject>Humans</subject><subject>machine learning</subject><subject>Model accuracy</subject><subject>Performance enhancement</subject><subject>Performance evaluation</subject><subject>Recording</subject><subject>RUSBoost</subject><subject>Sleep</subject><subject>sleep disorders</subject><subject>Sleep Stages</subject><issn>2168-2194</issn><issn>2168-2208</issn><issn>2168-2208</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpdkVFrFDEQx4MottR-AEEk4IsP7plJdjfJYz2tPakoXH0OuezskbKbrNms2G9vjruKOC-ZDL_5M_Aj5CWwFQDT7798uNmsOONiJYTQEsQTcs6hVRXnTD197EHXZ-Rynu9ZKVVGun1OzoRiDbRMnZPla-zs4PNDtZ3Q-d47eo02LwnpFgd02cfwjn602dKrZT9iyPYwojZ09A7HKSY70HUMGX9n2sdEN-OU4i_s6HdM5T_a4JD6QLcD4kS32e592L8gz3o7zHh5ei_Ij-tPd-ub6vbb58366rZyomG5UooztKC1Fp1zoKyUtgcGvRRCQlcrXivcdW2jeLMTtUbpXIOy1jW0EqwWF-TtMbfc9HPBOZvRzw6HwQaMy2y40ko3gsu6oG_-Q-_jkkK5znDNBYi24bxQcKRcivOcsDdT8qNNDwaYOWgxBy3moMWctJSd16fkZTdi93fjUUIBXh0Bj4j_BIpaACjxB42mj-0</recordid><startdate>20240201</startdate><enddate>20240201</enddate><creator>Jain, Ritika</creator><creator>G., Ramakrishnan A.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>K9.</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-3782-2932</orcidid><orcidid>https://orcid.org/0000-0002-3646-1955</orcidid></search><sort><creationdate>20240201</creationdate><title>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</title><author>Jain, Ritika ; G., Ramakrishnan A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Brain modeling</topic><topic>Classification</topic><topic>Context</topic><topic>Data augmentation</topic><topic>Datasets</topic><topic>Decision trees</topic><topic>EEG</topic><topic>Electroencephalography</topic><topic>Electroencephalography - methods</topic><topic>Electromyography</topic><topic>Electrooculography</topic><topic>EMG</topic><topic>EOG</topic><topic>Feature extraction</topic><topic>Humans</topic><topic>machine learning</topic><topic>Model accuracy</topic><topic>Performance enhancement</topic><topic>Performance evaluation</topic><topic>Recording</topic><topic>RUSBoost</topic><topic>Sleep</topic><topic>sleep disorders</topic><topic>Sleep Stages</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jain, Ritika</creatorcontrib><creatorcontrib>G., Ramakrishnan A.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Xplore (Online service)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing & Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE journal of biomedical and health informatics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Jain, Ritika</au><au>G., Ramakrishnan A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging</atitle><jtitle>IEEE journal of biomedical and health informatics</jtitle><stitle>JBHI</stitle><addtitle>IEEE J Biomed Health Inform</addtitle><date>2024-02-01</date><risdate>2024</risdate><volume>28</volume><issue>2</issue><spage>1031</spage><epage>1042</epage><pages>1031-1042</pages><issn>2168-2194</issn><issn>2168-2208</issn><eissn>2168-2208</eissn><coden>IJBHA9</coden><abstract>This work attempts to design an effective sleep staging system, making the best use of the available signals, strategies, and features in the literature. It must not only perform well on different datasets comprising healthy and clinical populations but also achieve good accuracy in cross-dataset experiments. Toward this end, we propose a model comprising multiple binary classifiers in a hierarchical fashion, where, at each level, one or more of EEG, EOG, and EMG are selected to best differentiate between two sleep stages. The best set of 100 features is chosen out of all the features derived from selected signals. The class imbalance in data is addressed by random undersampling and boosting techniques with decision trees as weak learners. Temporal context and data augmentation are used to improve the performance. We also evaluate the performance of our model by training and testing on different datasets. We compare the results of five approaches: using only EEG, EEG+EOG, EEG+EMG+EOG, EEG+EMG, and selective modality with a specific combination of EEG, EMG, and/or EOG at each level. The best results are obtained by considering features from EEG+EMG+EOG at each hierarchical level. The proposed model achieves average accuracies of 83.1%, 90.0%, 84.4%, 82.1%, 81.5%, 79.9%, and 73.7% on Sleep-EDF, Exp Sleep-EDF, ISRUC-S1, S2 and S3, DRMS-SUB, and DRMS-PAT datasets, respectively. For all the datasets except DRMS-SUB, the proposed method outperforms all the state-of-the-art approaches. Cross-dataset performance exceeds 80% for all datasets except DRMS-PAT; independent of whether the test data is from normal subjects or patients.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>38051608</pmid><doi>10.1109/JBHI.2023.3339713</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0003-3782-2932</orcidid><orcidid>https://orcid.org/0000-0002-3646-1955</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2168-2194 |
ispartof | IEEE journal of biomedical and health informatics, 2024-02, Vol.28 (2), p.1031-1042 |
issn | 2168-2194 2168-2208 2168-2208 |
language | eng |
recordid | cdi_pubmed_primary_38051608 |
source | IEEE Xplore (Online service) |
subjects | Brain modeling Classification Context Data augmentation Datasets Decision trees EEG Electroencephalography Electroencephalography - methods Electromyography Electrooculography EMG EOG Feature extraction Humans machine learning Model accuracy Performance enhancement Performance evaluation Recording RUSBoost Sleep sleep disorders Sleep Stages |
title | Modality-Specific Feature Selection, Data Augmentation and Temporal Context for Improved Performance in Sleep Staging |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T07%3A21%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Modality-Specific%20Feature%20Selection,%20Data%20Augmentation%20and%20Temporal%20Context%20for%20Improved%20Performance%20in%20Sleep%20Staging&rft.jtitle=IEEE%20journal%20of%20biomedical%20and%20health%20informatics&rft.au=Jain,%20Ritika&rft.date=2024-02-01&rft.volume=28&rft.issue=2&rft.spage=1031&rft.epage=1042&rft.pages=1031-1042&rft.issn=2168-2194&rft.eissn=2168-2208&rft.coden=IJBHA9&rft_id=info:doi/10.1109/JBHI.2023.3339713&rft_dat=%3Cproquest_pubme%3E2923136522%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c350t-8820ea19993dcc18a77af101f73371d48248ebd65825b349e7cc5e74941671a93%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2923136522&rft_id=info:pmid/38051608&rft_ieee_id=10343118&rfr_iscdi=true |