Autonomous Flying With Neuromorphic Sensing

• Published in: Frontiers in neuroscience 2021-05, Vol.15, p.672161-672161
• Main Authors: Parlevliet, Patricia P, Kanaev, Andrey, Hung, Chou P, Schweiger, Andreas, Gregory, Frederick D, Benosman, Ryad, de Croon, Guido C H E, Gutfreund, Yoram, Lo, Chung-Chuan, Moss, Cynthia F
• Format: Article
• Language: English
• Subjects: Aircraft; autonomous flight; Aviation; bio-inspiration; Cameras; Chemical elements; Computational neuroscience; Computer Science; Decision making; Evacuations & rescues; Flight behavior; flight control; flying animals; Information processing; learning; Machine learning; Mathematical models; Nervous system; neuromorphic sensing; Neuroscience; Robotics; Sensors; Space surveillance; Surveillance; Unmanned aerial vehicles
• ISSN: 1662-4548; 1662-453X; 1662-453X
• DOI: 10.3389/fnins.2021.672161

Autonomous flight for large aircraft appears to be within our reach. However, launching autonomous systems for everyday missions still requires an immense interdisciplinary research effort supported by pointed policies and funding. We believe that concerted endeavors in the fields of neuroscience, mathematics, sensor physics, robotics, and computer science are needed to address remaining crucial scientific challenges. In this paper, we argue for a bio-inspired approach to solve autonomous flying challenges, outline the frontier of sensing, data processing, and flight control within a neuromorphic paradigm, and chart directions of research needed to achieve operational capabilities comparable to those we observe in nature. One central problem of neuromorphic computing is learning. In biological systems, learning is achieved by adaptive and relativistic information acquisition characterized by near-continuous information retrieval with variable rates and sparsity. This results in both energy and computational resource savings being an inspiration for autonomous systems. We consider pertinent features of insect, bat and bird flight behavior as examples to address various vital aspects of autonomous flight. Insects exhibit sophisticated flight dynamics with comparatively reduced complexity of the brain. They represent excellent objects for the study of navigation and flight control. Bats and birds enable more complex models of attention and point to the importance of active sensing for conducting more complex missions. The implementation of neuromorphic paradigms for autonomous flight will require fundamental changes in both traditional hardware and software. We provide recommendations for sensor hardware and processing algorithm development to enable energy efficient and computationally effective flight control.