Unsupervised Deep Learning-Driven Stabilization of Smartphone-Based Quantitative Pupillometry for Mobile Emergency Medicine

• Main Authors: John, Ivo, Yari, Zipei, Bogucki, Aleksander, Swiatek, Michal, Chrost, Hugo, Wlodarski, Michal, Chrapkiewicz, Radoslaw, Li, Jizhou
• Format: Conference Proceeding
• Language: English
• Subjects: Dynamics; Emergency medicine; Helicopters; implicit neural representation; Medical devices; Quantitative pupillometry; smartphone-based software as a medical device (SaMD); Software; Stability analysis; Three-dimensional displays
• ISSN: 1945-8452
• DOI: 10.1109/ISBI56570.2024.10635305

Pupillometry. the assessment of pupil size and reactivity, is crucial in critical care and emergency medicine, serving as a primary method for non-invasive evaluation of neurological health after a severe acute brain injury (SABI), such as stroke or traumatic brain injury (TBI). The advent of smartphone-based quantitative pupillometry has enabled its new potential applications, for example in mobile emergency medicine in ambulances and helicopters, where traditional hardware-based pupillometers are impractical. However, these environments can be highly dynamic and pose challenges to the 3D stability of recordings acquired using a handheld device, implemented as software as a medical device (SaMD). The lack of 3D stability in mobile settings can lead to motion artifacts, significantly distorting measurements. This paper introduces a robust method that effectively stabilizes the pupillometry video input acquired under unstable conditions. Our two-stage approach first utilizes deep feature matching to mitigate the effects of motion coarsely. Subsequently, an implicit neural representation is employed for fine displacement estimation between frames, resulting in significantly stabilized output. We demonstrate enhanced sensitivity and noise reduction in the measured pupil dynamics. The effectiveness of the proposed unsupervised method is validated in challenging conditions, with substantial lateral and axial motions of the smartphone camera, emulating dynamic conditions experienced by emergency medicine teams in ambulances and helicopters.