Robust Dynamic Hand Gesture Recognition Based on Millimeter Wave Radar Using Atten-TsNN

The millimeter-wave radar can sense the subtle movement of the hand. However, the traditional hand gesture recognition methods do not work well in dynamic interference scenarios. To address this issue, a robust hand gesture recognition method is proposed based on the self-attention time-series neura...

Full description

Saved in:
Bibliographic Details
Published in:IEEE sensors journal 2022-06, Vol.22 (11), p.10861-10869
Main Authors: Jin, Biao, Peng, Yu, Kuang, Xiaofei, Zhang, Zhenkai, Lian, Zhuxian, Wang, Biao
Format: Article
Language:English
Subjects:
Convolution
dynamic gesture recognition
Feature extraction
Gesture recognition
Interference
Millimeter wave radar
Millimeter waves
Neural networks
one-dimensional timing network
Radar
Radar echoes
Radar target recognition
Robustness
self-attention mechanism
Sensors
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The millimeter-wave radar can sense the subtle movement of the hand. However, the traditional hand gesture recognition methods do not work well in dynamic interference scenarios. To address this issue, a robust hand gesture recognition method is proposed based on the self-attention time-series neural networks. Firstly, the original radar echo is constructed in terms of frame, sequence, and channel at the input terminal of the network. A one-dimensional time-series neural network is built, and the time-distributed layer is used as the wrapper to extract the feature from each frame sequence independently. Then the self-attention mechanism is employed to assign the adequate weights to the sequence of frames entered in parallel to obtain the inter-frame correlation and suppress the random interference. Finally, the Global AvgPooling layer is used to reduce the number of channels, and the fully connected layer outputs the label of the gesture. The experimental results show that the proposed method can achieve a high recognition rate in the presence of random dynamic interference.
ISSN:1530-437X
1558-1748
DOI:10.1109/JSEN.2022.3170311