Loading…

Brain–Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications

Brain–computer interfaces (BCI) are a type of assistive technology that uses the brain signals of users to establish a communication and control channel between them and an external device. BCI systems may be a suitable tool to restore communication skills in severely motor-disabled patients, as BCI...

Full description

Saved in:
Bibliographic Details
Published in:Sensors (Basel, Switzerland) Switzerland), 2021-05, Vol.21 (11), p.3716
Main Authors: Velasco-Álvarez, Francisco, Fernández-Rodríguez, Álvaro, Vizcaíno-Martín, Francisco-Javier, Díaz-Estrella, Antonio, Ron-Angevin, Ricardo
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033
cites cdi_FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033
container_end_page
container_issue 11
container_start_page 3716
container_title Sensors (Basel, Switzerland)
container_volume 21
creator Velasco-Álvarez, Francisco
Fernández-Rodríguez, Álvaro
Vizcaíno-Martín, Francisco-Javier
Díaz-Estrella, Antonio
Ron-Angevin, Ricardo
description Brain–computer interfaces (BCI) are a type of assistive technology that uses the brain signals of users to establish a communication and control channel between them and an external device. BCI systems may be a suitable tool to restore communication skills in severely motor-disabled patients, as BCI do not rely on muscular control. The loss of communication is one of the most negative consequences reported by such patients. This paper presents a BCI system focused on the control of four mainstream messaging applications running in a smartphone: WhatsApp, Telegram, e-mail and short message service (SMS). The control of the BCI is achieved through the well-known visual P300 row-column paradigm (RCP), allowing the user to select control commands as well as spelling characters. For the control of the smartphone, the system sends synthesized voice commands that are interpreted by a virtual assistant running in the smartphone. Four tasks related to the four mentioned messaging services were tested with 15 healthy volunteers, most of whom were able to accomplish the tasks, which included sending free text e-mails to an address proposed by the subjects themselves. The online performance results obtained, as well as the results of subjective questionnaires, support the viability of the proposed system.
doi_str_mv 10.3390/s21113716
format article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_7b989846a928411c8fdbcc5480c15093</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><doaj_id>oai_doaj_org_article_7b989846a928411c8fdbcc5480c15093</doaj_id><sourcerecordid>2536495097</sourcerecordid><originalsourceid>FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033</originalsourceid><addsrcrecordid>eNpdkktuFDEQhlsIREJgwQ0ssUkWA361294gTVo8RkrEgoitVXa7Jx712I3tjsSOO3BDToKHiSLCplwq__rqr1I1zWuC3zKm8LtMCSGsI-JJc0o45StJKX76T37SvMh5hzFljMnnzQnjuGMC09Nmvkzgw--fv_q4n5fiEtqEGkewDp1f9psL1MdQUpxQHBGgbz6VBSa0ztnnAqEgH2r56x5SmW9jcKhEdA0Btg5du5xh68MWred58haKjyG_bJ6NMGX36v49a24-frjpP6-uvnza9OurleVclJUchZHE1KmGFoMC2jLTtiMzzigqFaNEWGc6zkF2jneYCSEsNwMF13HM2FmzOWKHCDs9J18d_tARvP5biGmrq2VvJ6c7o6SSXEAFc0KsHAdjbcsltqTF6sB6f2TNi9m7wbq6EJgeQR__BH-rt_FOS6IUF7gCzu8BKX5fXC5677N10wTBxSXrOpzgqvbqqvTNf9JdXFKomzqolJKEiYPq4qiyKeac3PhghmB9OAn9cBLsD8CsprA</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2539981367</pqid></control><display><type>article</type><title>Brain–Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications</title><source>Publicly Available Content (ProQuest)</source><source>PubMed Central</source><creator>Velasco-Álvarez, Francisco ; Fernández-Rodríguez, Álvaro ; Vizcaíno-Martín, Francisco-Javier ; Díaz-Estrella, Antonio ; Ron-Angevin, Ricardo</creator><creatorcontrib>Velasco-Álvarez, Francisco ; Fernández-Rodríguez, Álvaro ; Vizcaíno-Martín, Francisco-Javier ; Díaz-Estrella, Antonio ; Ron-Angevin, Ricardo</creatorcontrib><description>Brain–computer interfaces (BCI) are a type of assistive technology that uses the brain signals of users to establish a communication and control channel between them and an external device. BCI systems may be a suitable tool to restore communication skills in severely motor-disabled patients, as BCI do not rely on muscular control. The loss of communication is one of the most negative consequences reported by such patients. This paper presents a BCI system focused on the control of four mainstream messaging applications running in a smartphone: WhatsApp, Telegram, e-mail and short message service (SMS). The control of the BCI is achieved through the well-known visual P300 row-column paradigm (RCP), allowing the user to select control commands as well as spelling characters. For the control of the smartphone, the system sends synthesized voice commands that are interpreted by a virtual assistant running in the smartphone. Four tasks related to the four mentioned messaging services were tested with 15 healthy volunteers, most of whom were able to accomplish the tasks, which included sending free text e-mails to an address proposed by the subjects themselves. The online performance results obtained, as well as the results of subjective questionnaires, support the viability of the proposed system.</description><identifier>ISSN: 1424-8220</identifier><identifier>EISSN: 1424-8220</identifier><identifier>DOI: 10.3390/s21113716</identifier><identifier>PMID: 34073602</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Amyotrophic lateral sclerosis ; Application programming interface ; assistive technology ; brain–computer interface (BCI) ; Communication channels ; Communication skills ; Control systems ; Electroencephalography ; Electromyography ; Human-computer interface ; messaging applications ; P300 ; Patients ; Running ; Sensors ; Short message service ; Smartphones ; Telegram ; Web browsers ; WhatsApp ; Wheelchairs</subject><ispartof>Sensors (Basel, Switzerland), 2021-05, Vol.21 (11), p.3716</ispartof><rights>2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2021 by the authors. 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033</citedby><cites>FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033</cites><orcidid>0000-0001-8721-0585 ; 0000-0002-5235-5597 ; 0000-0002-3421-976X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2539981367/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2539981367?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,25753,27924,27925,37012,37013,44590,53791,53793,75126</link.rule.ids></links><search><creatorcontrib>Velasco-Álvarez, Francisco</creatorcontrib><creatorcontrib>Fernández-Rodríguez, Álvaro</creatorcontrib><creatorcontrib>Vizcaíno-Martín, Francisco-Javier</creatorcontrib><creatorcontrib>Díaz-Estrella, Antonio</creatorcontrib><creatorcontrib>Ron-Angevin, Ricardo</creatorcontrib><title>Brain–Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications</title><title>Sensors (Basel, Switzerland)</title><description>Brain–computer interfaces (BCI) are a type of assistive technology that uses the brain signals of users to establish a communication and control channel between them and an external device. BCI systems may be a suitable tool to restore communication skills in severely motor-disabled patients, as BCI do not rely on muscular control. The loss of communication is one of the most negative consequences reported by such patients. This paper presents a BCI system focused on the control of four mainstream messaging applications running in a smartphone: WhatsApp, Telegram, e-mail and short message service (SMS). The control of the BCI is achieved through the well-known visual P300 row-column paradigm (RCP), allowing the user to select control commands as well as spelling characters. For the control of the smartphone, the system sends synthesized voice commands that are interpreted by a virtual assistant running in the smartphone. Four tasks related to the four mentioned messaging services were tested with 15 healthy volunteers, most of whom were able to accomplish the tasks, which included sending free text e-mails to an address proposed by the subjects themselves. The online performance results obtained, as well as the results of subjective questionnaires, support the viability of the proposed system.</description><subject>Amyotrophic lateral sclerosis</subject><subject>Application programming interface</subject><subject>assistive technology</subject><subject>brain–computer interface (BCI)</subject><subject>Communication channels</subject><subject>Communication skills</subject><subject>Control systems</subject><subject>Electroencephalography</subject><subject>Electromyography</subject><subject>Human-computer interface</subject><subject>messaging applications</subject><subject>P300</subject><subject>Patients</subject><subject>Running</subject><subject>Sensors</subject><subject>Short message service</subject><subject>Smartphones</subject><subject>Telegram</subject><subject>Web browsers</subject><subject>WhatsApp</subject><subject>Wheelchairs</subject><issn>1424-8220</issn><issn>1424-8220</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNpdkktuFDEQhlsIREJgwQ0ssUkWA361294gTVo8RkrEgoitVXa7Jx712I3tjsSOO3BDToKHiSLCplwq__rqr1I1zWuC3zKm8LtMCSGsI-JJc0o45StJKX76T37SvMh5hzFljMnnzQnjuGMC09Nmvkzgw--fv_q4n5fiEtqEGkewDp1f9psL1MdQUpxQHBGgbz6VBSa0ztnnAqEgH2r56x5SmW9jcKhEdA0Btg5du5xh68MWred58haKjyG_bJ6NMGX36v49a24-frjpP6-uvnza9OurleVclJUchZHE1KmGFoMC2jLTtiMzzigqFaNEWGc6zkF2jneYCSEsNwMF13HM2FmzOWKHCDs9J18d_tARvP5biGmrq2VvJ6c7o6SSXEAFc0KsHAdjbcsltqTF6sB6f2TNi9m7wbq6EJgeQR__BH-rt_FOS6IUF7gCzu8BKX5fXC5677N10wTBxSXrOpzgqvbqqvTNf9JdXFKomzqolJKEiYPq4qiyKeac3PhghmB9OAn9cBLsD8CsprA</recordid><startdate>20210526</startdate><enddate>20210526</enddate><creator>Velasco-Álvarez, Francisco</creator><creator>Fernández-Rodríguez, Álvaro</creator><creator>Vizcaíno-Martín, Francisco-Javier</creator><creator>Díaz-Estrella, Antonio</creator><creator>Ron-Angevin, Ricardo</creator><general>MDPI AG</general><general>MDPI</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>M0S</scope><scope>M1P</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0001-8721-0585</orcidid><orcidid>https://orcid.org/0000-0002-5235-5597</orcidid><orcidid>https://orcid.org/0000-0002-3421-976X</orcidid></search><sort><creationdate>20210526</creationdate><title>Brain–Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications</title><author>Velasco-Álvarez, Francisco ; Fernández-Rodríguez, Álvaro ; Vizcaíno-Martín, Francisco-Javier ; Díaz-Estrella, Antonio ; Ron-Angevin, Ricardo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Amyotrophic lateral sclerosis</topic><topic>Application programming interface</topic><topic>assistive technology</topic><topic>brain–computer interface (BCI)</topic><topic>Communication channels</topic><topic>Communication skills</topic><topic>Control systems</topic><topic>Electroencephalography</topic><topic>Electromyography</topic><topic>Human-computer interface</topic><topic>messaging applications</topic><topic>P300</topic><topic>Patients</topic><topic>Running</topic><topic>Sensors</topic><topic>Short message service</topic><topic>Smartphones</topic><topic>Telegram</topic><topic>Web browsers</topic><topic>WhatsApp</topic><topic>Wheelchairs</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Velasco-Álvarez, Francisco</creatorcontrib><creatorcontrib>Fernández-Rodríguez, Álvaro</creatorcontrib><creatorcontrib>Vizcaíno-Martín, Francisco-Javier</creatorcontrib><creatorcontrib>Díaz-Estrella, Antonio</creatorcontrib><creatorcontrib>Ron-Angevin, Ricardo</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Health &amp; Medical Collection (Proquest)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>PML(ProQuest Medical Library)</collection><collection>Publicly Available Content (ProQuest)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>Directory of Open Access Journals</collection><jtitle>Sensors (Basel, Switzerland)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Velasco-Álvarez, Francisco</au><au>Fernández-Rodríguez, Álvaro</au><au>Vizcaíno-Martín, Francisco-Javier</au><au>Díaz-Estrella, Antonio</au><au>Ron-Angevin, Ricardo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Brain–Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications</atitle><jtitle>Sensors (Basel, Switzerland)</jtitle><date>2021-05-26</date><risdate>2021</risdate><volume>21</volume><issue>11</issue><spage>3716</spage><pages>3716-</pages><issn>1424-8220</issn><eissn>1424-8220</eissn><abstract>Brain–computer interfaces (BCI) are a type of assistive technology that uses the brain signals of users to establish a communication and control channel between them and an external device. BCI systems may be a suitable tool to restore communication skills in severely motor-disabled patients, as BCI do not rely on muscular control. The loss of communication is one of the most negative consequences reported by such patients. This paper presents a BCI system focused on the control of four mainstream messaging applications running in a smartphone: WhatsApp, Telegram, e-mail and short message service (SMS). The control of the BCI is achieved through the well-known visual P300 row-column paradigm (RCP), allowing the user to select control commands as well as spelling characters. For the control of the smartphone, the system sends synthesized voice commands that are interpreted by a virtual assistant running in the smartphone. Four tasks related to the four mentioned messaging services were tested with 15 healthy volunteers, most of whom were able to accomplish the tasks, which included sending free text e-mails to an address proposed by the subjects themselves. The online performance results obtained, as well as the results of subjective questionnaires, support the viability of the proposed system.</abstract><cop>Basel</cop><pub>MDPI AG</pub><pmid>34073602</pmid><doi>10.3390/s21113716</doi><orcidid>https://orcid.org/0000-0001-8721-0585</orcidid><orcidid>https://orcid.org/0000-0002-5235-5597</orcidid><orcidid>https://orcid.org/0000-0002-3421-976X</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1424-8220
ispartof Sensors (Basel, Switzerland), 2021-05, Vol.21 (11), p.3716
issn 1424-8220
1424-8220
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_7b989846a928411c8fdbcc5480c15093
source Publicly Available Content (ProQuest); PubMed Central
subjects Amyotrophic lateral sclerosis
Application programming interface
assistive technology
brain–computer interface (BCI)
Communication channels
Communication skills
Control systems
Electroencephalography
Electromyography
Human-computer interface
messaging applications
P300
Patients
Running
Sensors
Short message service
Smartphones
Telegram
Web browsers
WhatsApp
Wheelchairs
title Brain–Computer Interface (BCI) Control of a Virtual Assistant in a Smartphone to Manage Messaging Applications
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T18%3A01%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Brain%E2%80%93Computer%20Interface%20(BCI)%20Control%20of%20a%20Virtual%20Assistant%20in%20a%20Smartphone%20to%20Manage%20Messaging%20Applications&rft.jtitle=Sensors%20(Basel,%20Switzerland)&rft.au=Velasco-%C3%81lvarez,%20Francisco&rft.date=2021-05-26&rft.volume=21&rft.issue=11&rft.spage=3716&rft.pages=3716-&rft.issn=1424-8220&rft.eissn=1424-8220&rft_id=info:doi/10.3390/s21113716&rft_dat=%3Cproquest_doaj_%3E2536495097%3C/proquest_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c446t-8f6b81b137d50a9a253b55f3beb92893216ceb744a87e4703666c4bd2ae74033%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2539981367&rft_id=info:pmid/34073602&rfr_iscdi=true