Multitask Deep Learning for Human Activity, Speed, and Body Weight Estimation Using Commercial Smart Insoles

Healthcare professionals and individual users use wearable devices equipped with various sensors for healthcare management. Recently, the joint usage of artificial intelligence and these wearable sensors has played an essential role in healthcare management by providing a wide range of applications,...

Full description

Saved in:
Bibliographic Details
Published in:IEEE internet of things journal 2023-09, Vol.10 (18), p.16121-16133
Main Authors: Kim, Jaeho, Kang, Hyewon, Yang, Jaewan, Jung, Haneul, Lee, Seulki, Lee, Junghye
Format: Article
Language:English
Subjects:
Artificial intelligence
Body weight
Computer networks
Deep learning
Health care
Insoles
Machine learning
Parameter modification
Rehabilitation
Sensors
Telemedicine
Wearable technology
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Healthcare professionals and individual users use wearable devices equipped with various sensors for healthcare management. Recently, the joint usage of artificial intelligence and these wearable sensors has played an essential role in healthcare management by providing a wide range of applications, such as fitness tracking, gym activity monitoring, patient rehabilitation monitoring, and disease detection. These tasks eventually aim to enhance personal well-being and better manage the user’s physical health by monitoring different activity types and body weight changes. Here, we present an efficient multitask learning (MTL) framework based on commercial smart insoles that can solve three tasks related to physical health management: 1) activity classification; 2) speed estimation; and 3) body weight estimation. Our multitask framework converts the sensor data from the smart insole to a recurrence plot, which shows significant performance improvement compared to processing the raw time-series data. In addition, we utilized a modified MobileNetV2 as our backbone network, which has a total parameter of less than 100K and a computational budget of 0.34G of multiply-accumulate operations. Furthermore, we collected a vast data set from 72 users carrying out 16 experiments, which contains the largest number of people for MTL purposes using smart insoles. Extensive experiments show that the proposed MTL framework is extremely efficient while outperforming or leading to comparable performance against single-task models.
ISSN:2327-4662
2327-4662
DOI:10.1109/JIOT.2023.3267335