Wavelet Transform Assisted Neural Networks for Human Activity Recognition

• Main Authors: Sengupta, Roshwin, Polian, Ilia, Hayes, John P.
• Format: Conference Proceeding
• Language: English
• Subjects: Artificial neural networks; Computer architecture; Feature extraction; hardware implementation; human activity recognition; Human computer interaction; Resource management; Software; wavelet transform; Wavelet transforms
• ISSN: 2158-1525
• DOI: 10.1109/ISCAS48785.2022.9937939

Human activity recognition (HAR) is a challenging area of research with many applications in human-computer interaction. With advances in artificial neural networks (ANNs), methods of HAR feature extraction from wearable sensor data have greatly improved and have increased interest in their classification using ANNs. Most prior work has only investigated the software implementations of ANN-based HAR. Here, we investigate, for the first time, two novel hardware implementations for use in resource-constrained edge devices. Through architecture exploration, we identify first a hybrid ANN we call DCLSTM incorporating the convolutional and long-short-term memory techniques. The second is a much more compact implementation WCLSTM that uses wavelet transforms (WTs) to enhance feature extraction; it can achieve even better accuracy while being smaller and simpler; it is therefore the better choice for resource-constrained applications. We present hardware implementations of these ANNs and evaluate their performance and resource utilization on the UCI HAR and WISDM datasets. Synthesis results on an FPGA platform show the superiority of the WT-assisted version in accuracy and size. Moreover, our networks achieve a better accuracy than earlier published works.