Loading…

Toward high performance, weakly invasive brain computer interfaces using selective visual attention

Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we pro...

Full description

Saved in:
Bibliographic Details
Published in:The Journal of neuroscience 2013-04, Vol.33 (14), p.6001-6011
Main Authors: Rotermund, David, Ernst, Udo A, Mandon, Sunita, Taylor, Katja, Smiyukha, Yulia, Kreiter, Andreas K, Pawelzik, Klaus R
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673
cites cdi_FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673
container_end_page 6011
container_issue 14
container_start_page 6001
container_title The Journal of neuroscience
container_volume 33
creator Rotermund, David
Ernst, Udo A
Mandon, Sunita
Taylor, Katja
Smiyukha, Yulia
Kreiter, Andreas K
Pawelzik, Klaus R
description Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.
doi_str_mv 10.1523/JNEUROSCI.4225-12.2013
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_6618919</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1324384976</sourcerecordid><originalsourceid>FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673</originalsourceid><addsrcrecordid>eNqFkcFu1DAQhi0EokvhFSofOZCtx3Hs-IKEVi20qqgE7dmaeCe7hiRe7GSrvj1ZtazgxGVGmvnnnxl9jJ2BWEIly_Prrxf3326_r66WSsqqALmUAsoXbDF3bSGVgJdsIaQRhVZGnbA3Of8QQhgB5jU7kWVVKVXDgvm7-IBpzbdhs-U7Sm1MPQ6ePvAHwp_dIw_DHnPYE28ShoH72O-mkdJcn2OLnjKfchg2PFNHfjwo9yFP2HEcRxrGEIe37FWLXaZ3z_mU3V9e3K2-FDe3n69Wn24Kr5QZC6-xLde1VRYM-bqd70Nh0VsvRdUgCgIiMrBuKtHUlrAyqGULUiqFtTblKfv45Lubmp7Wft6esHO7FHpMjy5icP92hrB1m7h3WkNtwc4G758NUvw1UR5dH7KnrsOB4pQdVBVo0NbA_6WlVGWtrNGzVD9JfYo5J2qPF4FwB5juCNMdYDqQ7gBzHjz7-5_j2B965W9Jbp8O</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1324384976</pqid></control><display><type>article</type><title>Toward high performance, weakly invasive brain computer interfaces using selective visual attention</title><source>PubMed Central</source><creator>Rotermund, David ; Ernst, Udo A ; Mandon, Sunita ; Taylor, Katja ; Smiyukha, Yulia ; Kreiter, Andreas K ; Pawelzik, Klaus R</creator><creatorcontrib>Rotermund, David ; Ernst, Udo A ; Mandon, Sunita ; Taylor, Katja ; Smiyukha, Yulia ; Kreiter, Andreas K ; Pawelzik, Klaus R</creatorcontrib><description>Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.</description><identifier>ISSN: 0270-6474</identifier><identifier>ISSN: 1529-2401</identifier><identifier>EISSN: 1529-2401</identifier><identifier>DOI: 10.1523/JNEUROSCI.4225-12.2013</identifier><identifier>PMID: 23554481</identifier><language>eng</language><publisher>United States: Society for Neuroscience</publisher><subject>Animals ; Attention - physiology ; Brain - physiology ; Brain-Computer Interfaces ; Discrimination (Psychology) - physiology ; Electrodes, Implanted ; Electroencephalography ; Evoked Potentials ; Macaca ; Macaca mulatta ; Male ; Photic Stimulation ; Reaction Time</subject><ispartof>The Journal of neuroscience, 2013-04, Vol.33 (14), p.6001-6011</ispartof><rights>Copyright © 2013 the authors 0270-6474/13/336001-11$15.00/0 2013</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673</citedby><cites>FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC6618919/pdf/$$EPDF$$P50$$Gpubmedcentral$$H</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC6618919/$$EHTML$$P50$$Gpubmedcentral$$H</linktohtml><link.rule.ids>230,314,727,780,784,885,27923,27924,53790,53792</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/23554481$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Rotermund, David</creatorcontrib><creatorcontrib>Ernst, Udo A</creatorcontrib><creatorcontrib>Mandon, Sunita</creatorcontrib><creatorcontrib>Taylor, Katja</creatorcontrib><creatorcontrib>Smiyukha, Yulia</creatorcontrib><creatorcontrib>Kreiter, Andreas K</creatorcontrib><creatorcontrib>Pawelzik, Klaus R</creatorcontrib><title>Toward high performance, weakly invasive brain computer interfaces using selective visual attention</title><title>The Journal of neuroscience</title><addtitle>J Neurosci</addtitle><description>Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.</description><subject>Animals</subject><subject>Attention - physiology</subject><subject>Brain - physiology</subject><subject>Brain-Computer Interfaces</subject><subject>Discrimination (Psychology) - physiology</subject><subject>Electrodes, Implanted</subject><subject>Electroencephalography</subject><subject>Evoked Potentials</subject><subject>Macaca</subject><subject>Macaca mulatta</subject><subject>Male</subject><subject>Photic Stimulation</subject><subject>Reaction Time</subject><issn>0270-6474</issn><issn>1529-2401</issn><issn>1529-2401</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><recordid>eNqFkcFu1DAQhi0EokvhFSofOZCtx3Hs-IKEVi20qqgE7dmaeCe7hiRe7GSrvj1ZtazgxGVGmvnnnxl9jJ2BWEIly_Prrxf3326_r66WSsqqALmUAsoXbDF3bSGVgJdsIaQRhVZGnbA3Of8QQhgB5jU7kWVVKVXDgvm7-IBpzbdhs-U7Sm1MPQ6ePvAHwp_dIw_DHnPYE28ShoH72O-mkdJcn2OLnjKfchg2PFNHfjwo9yFP2HEcRxrGEIe37FWLXaZ3z_mU3V9e3K2-FDe3n69Wn24Kr5QZC6-xLde1VRYM-bqd70Nh0VsvRdUgCgIiMrBuKtHUlrAyqGULUiqFtTblKfv45Lubmp7Wft6esHO7FHpMjy5icP92hrB1m7h3WkNtwc4G758NUvw1UR5dH7KnrsOB4pQdVBVo0NbA_6WlVGWtrNGzVD9JfYo5J2qPF4FwB5juCNMdYDqQ7gBzHjz7-5_j2B965W9Jbp8O</recordid><startdate>20130403</startdate><enddate>20130403</enddate><creator>Rotermund, David</creator><creator>Ernst, Udo A</creator><creator>Mandon, Sunita</creator><creator>Taylor, Katja</creator><creator>Smiyukha, Yulia</creator><creator>Kreiter, Andreas K</creator><creator>Pawelzik, Klaus R</creator><general>Society for Neuroscience</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>7TK</scope><scope>5PM</scope></search><sort><creationdate>20130403</creationdate><title>Toward high performance, weakly invasive brain computer interfaces using selective visual attention</title><author>Rotermund, David ; Ernst, Udo A ; Mandon, Sunita ; Taylor, Katja ; Smiyukha, Yulia ; Kreiter, Andreas K ; Pawelzik, Klaus R</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Animals</topic><topic>Attention - physiology</topic><topic>Brain - physiology</topic><topic>Brain-Computer Interfaces</topic><topic>Discrimination (Psychology) - physiology</topic><topic>Electrodes, Implanted</topic><topic>Electroencephalography</topic><topic>Evoked Potentials</topic><topic>Macaca</topic><topic>Macaca mulatta</topic><topic>Male</topic><topic>Photic Stimulation</topic><topic>Reaction Time</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rotermund, David</creatorcontrib><creatorcontrib>Ernst, Udo A</creatorcontrib><creatorcontrib>Mandon, Sunita</creatorcontrib><creatorcontrib>Taylor, Katja</creatorcontrib><creatorcontrib>Smiyukha, Yulia</creatorcontrib><creatorcontrib>Kreiter, Andreas K</creatorcontrib><creatorcontrib>Pawelzik, Klaus R</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>Neurosciences Abstracts</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>The Journal of neuroscience</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rotermund, David</au><au>Ernst, Udo A</au><au>Mandon, Sunita</au><au>Taylor, Katja</au><au>Smiyukha, Yulia</au><au>Kreiter, Andreas K</au><au>Pawelzik, Klaus R</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Toward high performance, weakly invasive brain computer interfaces using selective visual attention</atitle><jtitle>The Journal of neuroscience</jtitle><addtitle>J Neurosci</addtitle><date>2013-04-03</date><risdate>2013</risdate><volume>33</volume><issue>14</issue><spage>6001</spage><epage>6011</epage><pages>6001-6011</pages><issn>0270-6474</issn><issn>1529-2401</issn><eissn>1529-2401</eissn><abstract>Brain-computer interfaces have been proposed as a solution for paralyzed persons to communicate and interact with their environment. However, the neural signals used for controlling such prostheses are often noisy and unreliable, resulting in a low performance of real-world applications. Here we propose neural signatures of selective visual attention in epidural recordings as a fast, reliable, and high-performance control signal for brain prostheses. We recorded epidural field potentials with chronically implanted electrode arrays from two macaque monkeys engaged in a shape-tracking task. For single trials, we classified the direction of attention to one of two visual stimuli based on spectral amplitude, coherence, and phase difference in time windows fixed relative to stimulus onset. Classification performances reached up to 99.9%, and the information about attentional states could be transferred at rates exceeding 580 bits/min. Good classification can already be achieved in time windows as short as 200 ms. The classification performance changed dynamically over the trial and modulated with the task's varying demands for attention. For all three signal features, the information about the direction of attention was contained in the γ-band. The most informative feature was spectral amplitude. Together, these findings establish a novel paradigm for constructing brain prostheses as, for example, virtual spelling boards, promising a major gain in performance and robustness for human brain-computer interfaces.</abstract><cop>United States</cop><pub>Society for Neuroscience</pub><pmid>23554481</pmid><doi>10.1523/JNEUROSCI.4225-12.2013</doi><tpages>11</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0270-6474
ispartof The Journal of neuroscience, 2013-04, Vol.33 (14), p.6001-6011
issn 0270-6474
1529-2401
1529-2401
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_6618919
source PubMed Central
subjects Animals
Attention - physiology
Brain - physiology
Brain-Computer Interfaces
Discrimination (Psychology) - physiology
Electrodes, Implanted
Electroencephalography
Evoked Potentials
Macaca
Macaca mulatta
Male
Photic Stimulation
Reaction Time
title Toward high performance, weakly invasive brain computer interfaces using selective visual attention
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T00%3A56%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Toward%20high%20performance,%20weakly%20invasive%20brain%20computer%20interfaces%20using%20selective%20visual%20attention&rft.jtitle=The%20Journal%20of%20neuroscience&rft.au=Rotermund,%20David&rft.date=2013-04-03&rft.volume=33&rft.issue=14&rft.spage=6001&rft.epage=6011&rft.pages=6001-6011&rft.issn=0270-6474&rft.eissn=1529-2401&rft_id=info:doi/10.1523/JNEUROSCI.4225-12.2013&rft_dat=%3Cproquest_pubme%3E1324384976%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c447t-c6af3d894917ec8f481a09ac9c205baa0e1eee71db50b89ea57a62f12244a8673%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1324384976&rft_id=info:pmid/23554481&rfr_iscdi=true