Implementing statistical methods for generalizing randomized trial findings to a target population

Randomized trials are considered the gold standard for assessing the causal effects of a drug or intervention in a study population, and their results are often utilized in the formulation of health policy. However, there is growing concern that results from trials do not necessarily generalize well...

Full description

Saved in:
Bibliographic Details
Published in:Addictive behaviors 2019-07, Vol.94, p.124-132
Main Authors: Ackerman, Benjamin, Schmid, Ian, Rudolph, Kara E., Seamans, Marissa J., Susukida, Ryoko, Mojtabai, Ramin, Stuart, Elizabeth A.
Format: Article
Language:English
Subjects:
Demographics
Dependence
Drug abuse
Evidence-based medicine
External validity
Generalizability
Health policy
Methamphetamine
Population studies
Randomized trials
Statistical methods
Statistics
Substance use
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Randomized trials are considered the gold standard for assessing the causal effects of a drug or intervention in a study population, and their results are often utilized in the formulation of health policy. However, there is growing concern that results from trials do not necessarily generalize well to their respective target populations, in which policies are enacted, due to substantial demographic differences between study and target populations. In trials related to substance use disorders (SUDs), especially, strict exclusion criteria make it challenging to obtain study samples that are fully “representative” of the populations that policymakers may wish to generalize their results to. In this paper, we provide an overview of post-trial statistical methods for assessing and improving upon the generalizability of a randomized trial to a well-defined target population. We then illustrate the different methods using a randomized trial related to methamphetamine dependence and a target population of substance abuse treatment seekers, and provide software to implement the methods in R using the “generalize” package. We discuss several practical considerations for researchers who wish to utilize these tools, such as the importance of acquiring population-level data to represent the target population of interest, and the challenges of data harmonization. •RCT results from non-representative samples may not generalize to the population.•Methods exist to assess a trial's generalizability and estimate population effects.•Carefully defining a target population is crucial to generalizing RCT findings.
ISSN:0306-4603
1873-6327
DOI:10.1016/j.addbeh.2018.10.033