Improving the Accuracy of Spiking Neural Networks for Radar Gesture Recognition Through Preprocessing

• Published in: IEEE transaction on neural networks and learning systems 2023-06, Vol.34 (6), p.2869-2881
• Main Authors: Safa, Ali, Corradi, Federico, Keuninckx, Lars, Ocket, Ilja, Bourdoux, Andre, Catthoor, Francky, Gielen, Georges G. E.
• Format: Article
• Language: English
• Subjects: Accuracy; Artificial neural networks; Cameras; Computer architecture; Doppler radar; Energy- and area-efficient networks; Firing pattern; Generalization, Psychological; Gesture recognition; Gestures; Information processing; Network topologies; Neural networks; Neural Networks, Computer; Neurons; Preprocessing; preprocessing impact on accuracy; Radar; Radar imaging; radar processing; Recognition, Psychology; Spiking; spiking neural networks (SNNs); Topology; Training
• ISSN: 2162-237X; 2162-2388
• DOI: 10.1109/TNNLS.2021.3109958

Event-based neural networks are currently being explored as efficient solutions for performing AI tasks at the extreme edge. To fully exploit their potential, event-based neural networks coupled to adequate preprocessing must be investigated. Within this context, we demonstrate a 4-b-weight spiking neural network (SNN) for radar gesture recognition, achieving a state-of-the-art 93% accuracy within only four processing time steps while using only one convolutional layer and two fully connected layers. This solution consumes very little energy and area if implemented in event-based hardware, which makes it suited for embedded extreme-edge applications. In addition, we demonstrate the importance of signal preprocessing for achieving this high recognition accuracy in SNNs compared to deep neural networks (DNNs) with the same network topology and training strategy. We show that efficient preprocessing prior to the neural network is drastically more important for SNNs compared to DNNs. We also demonstrate, for the first time, that the preprocessing parameters can affect SNNs and DNNs in antagonistic ways, prohibiting the generalization of conclusions drawn from DNN design to SNNs. We demonstrate our findings by comparing the gesture recognition accuracy achieved with our SNN to a DNN with the same architecture and similar training. Unlike previously proposed neural networks for radar processing, this work enables ultralow-power radar-based gesture recognition for extreme-edge devices.