Permutation tests for ASCA in multivariate longitudinal intervention studies

Permutation tests are the standard technique for significance testing in Analysis of Variance Simultaneous Component Analysis. However, there is a vast number of alternative approaches for permutation testing, and the number of choices grows in relation to the complexity of the study design. In this...

Full description

Saved in:
Bibliographic Details
Published in:Journal of chemometrics 2023-07, Vol.37 (7), p.n/a
Main Authors: Camacho, José, Díaz, Caridad, Sánchez‐Rovira, Pedro
Format: Article
Language:English
Subjects:
ASCA
Complexity
Design of experiments
Experimental design
longitudinal intervention studies
Multivariate analysis
omics
permutation tests
Permutations
power analysis
power curves
Variance analysis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Permutation tests are the standard technique for significance testing in Analysis of Variance Simultaneous Component Analysis. However, there is a vast number of alternative approaches for permutation testing, and the number of choices grows in relation to the complexity of the study design. In this paper, we focus on longitudinal intervention studies with multivariate outcomes, a relevant experimental design in clinical studies where the outcome is an omics profile (such as in genomics, metabolomics, and the like). We propose a new technique to derive power curves tailored to the size and (un)balanced nature of the data set in the study. This technique is useful to identify misleading permutation tests, with lack of power or overly optimistic outcomes. We found that choosing the best permutation approach is far from intuitive and that there is a significant risk of deriving incorrect conclusions in real‐life analyses. Our approach avoids this risk and can be extended to other complex designs of interest. The code is available for free use. Permutation tests are the standard technique for significance testing in ASCA. However, there is a vast number of alternative approaches. In this paper, we focus on clinical studies where the outcome is an omics profile (such as in metabolomics and the like). We propose a new technique to derive power curves tailored to the size and (un)balanced nature of the data set. This technique is useful to identify misleading permutation tests, with lack of power or overly optimistic outcomes.
ISSN:0886-9383
1099-128X
DOI:10.1002/cem.3398