Validity of Estimating the Maximal Oxygen Consumption by Consumer Wearables: A Systematic Review with Meta-analysis and Expert Statement of the INTERLIVE Network

• Published in: Sports medicine (Auckland) 2022-07, Vol.52 (7), p.1577-1597
• Main Authors: Molina-Garcia, Pablo, Notbohm, Hannah L., Schumann, Moritz, Argent, Rob, Hetherington-Rauth, Megan, Stang, Julie, Bloch, Wilhelm, Cheng, Sulin, Ekelund, Ulf, Sardinha, Luis B., Caulfield, Brian, Brønd, Jan Christian, Grøntved, Anders, Ortega, Francisco B.
• Format: Article
• Language: English
• Subjects: Algorithms; Bias; Consortia; Exercise; Laboratories; Medicin och hälsovetenskap; Medicine; Medicine & Public Health; Meta-analysis; Oxygen consumption; Physical activity; Physical fitness; Physical training; Protocol; R&D; Research & development; Reviews; Sports Medicine; Statistical analysis; Systematic Review; Validation studies; Validity; Wearable computers; Well being
• ISSN: 0112-1642; 1179-2035; 1179-2035
• DOI: 10.1007/s40279-021-01639-y

Background Technological advances have recently made possible the estimation of maximal oxygen consumption ( V O 2max ) by consumer wearables. However, the validity of such estimations has not been systematically summarized using meta-analytic methods and there are no standards guiding the validation protocols. Objective The aim was to (1) quantitatively summarize previous studies investigating the validity of the V O 2max estimated by consumer wearables and (2) provide best-practice recommendations for future validation studies. Methods First, we conducted a systematic review and meta-analysis of studies validating the estimation of V O 2max by wearables. Second, based on the state of knowledge (derived from the systematic review) combined with the expert discussion between the members of the Towards Intelligent Health and Well-Being Network of Physical Activity Assessment (INTERLIVE) consortium, we provided a set of best-practice recommendations for validation protocols. Results Fourteen validation studies were included in the systematic review and meta-analysis. Meta-analysis results revealed that wearables using resting condition information in their algorithms significantly overestimated V O 2max (bias 2.17 ml·kg −1 ·min −1 ; limits of agreement − 13.07 to 17.41 ml·kg −1 ·min −1 ), while devices using exercise-based information in their algorithms showed a lower systematic and random error (bias − 0.09 ml·kg −1 ·min −1 ; limits of agreement − 9.92 to 9.74 ml·kg −1 ·min −1 ). The INTERLIVE consortium proposed six key domains to be considered for validating wearable devices estimating V O 2max , concerning the following: the target population, reference standard, index measure, testing conditions, data processing, and statistical analysis. Conclusions Our meta-analysis suggests that the estimations of V O 2max by wearables that use exercise-based algorithms provide higher accuracy than those based on resting conditions. The exercise-based estimation seems to be optimal for measuring V O 2max at the population level, yet the estimation error at the individual level is large, and, therefore, for sport/clinical purposes these methods still need improvement. The INTERLIVE network hereby provides best-practice recommendations to be used in future protocols to move towards a more accurate, transparent and comparable validation of V O 2max derived from wearables. PROSPERO ID CRD42021246192.