An infrared image‐enhancement algorithm in simulated prosthetic vision: Enlarging working environment of future retinal prostheses

• Published in: Artificial organs 2022-11, Vol.46 (11), p.2147-2158
• Main Authors: Liang, Junling, Li, Heng, Chen, Jianpin, Zhai, Zhenzhen, Wang, Jing, Di, Liqing, Chai, Xinyu
• Format: Article
• Language: English
• Subjects: Algorithms; Cameras; dual‐mode camera; Feasibility; Image enhancement; Infrared imagery; infrared image‐processing algorithm; Light; Neural prostheses; Prostheses; Prosthetics; Psychophysics; Retina; retinal prosthesis; simulated prosthetic vision; Vision; Visual tasks; Working conditions
• ISSN: 0160-564X; 1525-1594
• DOI: 10.1111/aor.14247

Background Most existing retinal prostheses contain a built‐in visible‐light camera module that captures images of the surrounding environment. Thus, in case of insufficient or lack of visible light, the camera fails to work, and the retinal prostheses enter a dormant or “OFF” state. A simple and effective solution is replacing the visible‐light camera with a dual‐mode camera. The present research aimed to achieve two main purposes: (1) to explore whether the dual‐mode camera in prosthesis recipients works under no visible‐light conditions and (2) to assess its performance. Methods To accomplish these aims, we enrolled subjects in a psychophysical experiment under simulated prosthetic vision conditions. We found that the subjects could complete some simple visual tasks, but the recognition performance under the infrared mode was significantly inferior to that under the visible‐light mode. These results inspired us to develop and propose a feasible infrared image‐enhancement processing algorithm. Another psychophysical experiment was performed to verify the feasibility of the algorithm. Results The obtained results showed that the average efficiency of the subjects completing visual tasks using our enhancement algorithm (0.014 ± 0.001) was significantly higher (p