University of South Florida
Measurements of Generalizability and Adjustment for Bias in Clinical Trials
Abstract
dc:descriptionWhile randomized controlled trials (RCTs) are widely used as a gold standard in clinical research and public health, they are criticized because of a potential lack of generalizability, as the trial patients may be unrepresentative of the target patient population. Few research addresses how to assess and evaluate the generalizability of RCTs. As we know, patients are rarely selected on a random basis from a well-defined patient population of interest into a clinical trial. Generalizing findings from the RCT samples to the patient population has begun to receive increasing attention. We simulate a patient population with treatment effect size of 0.5 (Cohen’s d) and seven covariates that included gender, health insurance, race, baseline symptoms, comorbidity, age, and motivation. We then compare 6 generalizability indexes (SMD: standardized mean difference, C-statistic, β-index, OVL: overlapping coefficient, KSD: Kolmogorov-Smirnov distance, LD: Lévy Distance) with selected nonrandom trials and random trials from the patient population. Based on our results, we conclude that β-index could work as a reliable generalizability metric, and C-statistic and LD are also acceptable. When we know a trial is biased, the question is how to make inference from the bias sample to the patient population. We use 4 statistical approaches (IPSW: inverse probability-of-selection weights; EB: entropy balance, EVB: external validity bias, SC: subclassification estimator) to adjust the trial bias. Based on our results, EB should not be considered as bias adjustment method, SC over adjust the bias, IPSW could be an option, and EVB seems to be more reliable compared to other metrics, when all the covariates are observed.
Degree
thesis:*- Name thesis:degree_name
- Doctor of Public Health (Dr.PH.)
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Public Health
- Grantor
- University of South Florida
- Year dc:date
- 2022
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Lu, Yuanyuan
- Contributors dc:contributor
-
- Henian Chen, Ph.D.
- Wei Wang, Ph.D.
- Yangxin Huang, Ph.D.
- Feng Cheng, Ph.D.
- Ellen M. Daley, Ph.D.
Subjects
dc:subject × 5Identifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.usf.edu/etd/9400