Smartphone sensors‐based human activity recognition using feature selection and deep decision fusion

• Published in: IET cyber-physical systems 2023-06, Vol.8 (2), p.76-90
• Main Authors: Zhang, Yijia, Yao, Xiaolan, Fei, Qing, Chen, Zhen
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; Artificial neural networks; Classification; Datasets; Deep learning; Discriminant analysis; feature extraction; Feature maps; Feature recognition; Feature selection; Human activity recognition; Human influences; Machine learning; Neural networks; Optimization algorithms; Optimization techniques; particle swarm optimisation; Particle swarm optimization; Redundancy; sensor fusion; Sensors; Signal classification; Smartphones; Support vector machines
• ISSN: 2398-3396; 2398-3396
• DOI: 10.1049/cps2.12045

Human activity recognition (HAR) with smartphone sensors is a significant research direction in human‐cyber‐physical systems. Aiming at the problem of feature redundancy and low recognition accuracy of HAR, this paper presents a novel system architecture comprising three parts: feature selection based on an oppositional and chaos particle swarm optimization (OCPSO) algorithm, multi‐input one‐dimensional convolutional neural network (MI‐1D‐CNN) utilizing time‐domain and frequency‐domain signals, and deep decision fusion (DDF) combining D‐S evidence theory and entropy. The proposed architecture is evaluated on the UCI HAR and WIDSM datasets. The results highlight that OCPSO performs better than particle swarm optimization (PSO) in feature selection, convergence speed, and recognition accuracy. Moreover, it is shown that for the MI‐1D‐CNN classifier, the frequency‐domain signals (95.96%) perform better than time‐domain signals (95.66%). In addition, this paper investigates the impact of the convolution layers, feature maps, filter sizes, and decision fusion methods on recognition accuracy. The results demonstrate that the DDF method (97.81%) outperforms single‐layer decision fusion in improving the recognition accuracy on the UCI HAR dataset. The manuscript presents a novel smartphone sensors‐based system architecture for human activity recognition comprising three parts: OCPSO feature selection, multi‐input one‐dimensional convolutional neural network (MI‐1D‐CNN) classifier, and deep decision fusion. Experiment results show that the proposed architecture can improve recognition accuracy and robustness for sensors‐based human activity recognition.