kNN Prototyping Schemes for Embedded Human Activity Recognition with Online Learning

• Published in: Computers (Basel) 2020-12, Vol.9 (4), p.96
• Main Authors: Ferreira, Paulo J. S., Cardoso, João M. P., Mendes-Moreira, João
• Format: Article
• Language: English
• Subjects: Accuracy; Algorithms; classification; Datasets; Distance learning; Embedded systems; Energy consumption; Feature selection; Human activity recognition; Human Activity Recognition (HAR); k-nearest neighbor; kNN prototyping; Machine learning; Moving object recognition; Optimization techniques; Prototyping; Run time (computers); Training
• ISSN: 2073-431X; 2073-431X
• DOI: 10.3390/computers9040096

The kNN machine learning method is widely used as a classifier in Human Activity Recognition (HAR) systems. Although the kNN algorithm works similarly both online and in offline mode, the use of all training instances is much more critical online than offline due to time and memory restrictions in the online mode. Some methods propose decreasing the high computational costs of kNN by focusing, e.g., on approximate kNN solutions such as the ones relying on Locality-Sensitive Hashing (LSH). However, embedded kNN implementations also need to address the target device’s memory constraints, especially as the use of online classification needs to cope with those constraints to be practical. This paper discusses online approaches to reduce the number of training instances stored in the kNN search space. To address practical implementations of HAR systems using kNN, this paper presents simple, energy/computationally efficient, and real-time feasible schemes to maintain at runtime a maximum number of training instances stored by kNN. The proposed schemes include policies for substituting the training instances, maintaining the search space to a maximum size. Experiments in the context of HAR datasets show the efficiency of our best schemes.