When assistive eye tracking fails: Communicating with a brainstem-stroke patient through the pupillary accommodative response – A case study

• Published in: Biomedical signal processing and control 2021-05, Vol.67, p.102515, Article 102515
• Main Authors: Lorenzo Villalobos, Andres Eduardo, Giusiano, Silvia, Musso, Luca, de’Sperati, Claudio, Riberi, Alessandra, Spalek, Piotr, Calvo, Andrea, Moglia, Cristina, Roatta, Silvestro
• Format: Article
• Language: English
• Subjects: Assistive device; Augmentative alternative communication; Brain computer interface; Locked-in syndrome
• ISSN: 1746-8094; 1746-8108
• DOI: 10.1016/j.bspc.2021.102515

[Display omitted] •Communication without movement remains an open research and clinical challenge.•Voluntary control of pupil size is a novel approach to serve this purpose.•A low-cost communication system, based on the pupil accommodative response, is presented.•For the first time this approach is successfully tested in a clinical condition. Poor control of eye movement and coordination may impair the use of eye-trackers for communication in patients affected by severe motor diseases. Recently, the “voluntary” pupil accommodative response (PAR) was suggested as a possible alternative to traditional assistive technology. Aim of this study is to provide a proof of concept of this methodology in a clinical setting. A low-cost communication system was implemented, which detects the accommodative pupillary constrictions in real time and generates trigger events to drive a commercial scanning-selection interface. As a first implementation, a simple binary yes/no selection interface was designed to be tested with a brainstem stroke patient, unable to use standard communicators based on eye tracking. The patient was instructed to operate the intended selection by switching the focus of attention from a far to a near target, and was then presented with 10 questions with obvious answer. The patient easily understood how to perform the accommodative task. The pupillary constrictions were marked and clearly detectable in spite of the disturbing action of persistent nystagmus. On the first presentation of the device, the patient managed to correctly answer 8 out of 10 questions. The present results provide a proof-of-concept for PAR-based communication in a clinical setting and support its usefulness with patients who, due to impaired control of eye movements, may be unable to use tracking-based devices.