{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-10597"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-10597","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Measurements of Generalizability and Adjustment for Bias in Clinical Trials","abstract":"While randomized controlled trials (RCTs) are widely used as a gold standard in clinical research and public health, they are criticized because of a potential lack of generalizability, as the trial patients may be unrepresentative of the target patient population. Few research addresses how to assess and evaluate the generalizability of RCTs. As we know, patients are rarely selected on a random basis from a well-defined patient population of interest into a clinical trial. Generalizing findings from the RCT samples to the patient population has begun to receive increasing attention. We simulate a patient population with treatment effect size of 0.5 (Cohen’s d) and seven covariates that included gender, health insurance, race, baseline symptoms, comorbidity, age, and motivation. We then compare 6 generalizability indexes (SMD: standardized mean difference, C-statistic, β-index, OVL: overlapping coefficient, KSD: Kolmogorov-Smirnov distance, LD: Lévy Distance) with selected nonrandom trials and random trials from the patient population. Based on our results, we conclude that β-index could work as a reliable generalizability metric, and C-statistic and LD are also acceptable. When we know a trial is biased, the question is how to make inference from the bias sample to the patient population. We use 4 statistical approaches (IPSW: inverse probability-of-selection weights; EB: entropy balance, EVB: external validity bias, SC: subclassification estimator) to adjust the trial bias. Based on our results, EB should not be considered as bias adjustment method, SC over adjust the bias, IPSW could be an option, and EVB seems to be more reliable compared to other metrics, when all the covariates are observed.","abstract_html":"While randomized controlled trials (RCTs) are widely used as a gold standard in clinical research and public health, they are criticized because of a potential lack of generalizability, as the trial patients may be unrepresentative of the target patient population. Few research addresses how to assess and evaluate the generalizability of RCTs. As we know, patients are rarely selected on a random basis from a well-defined patient population of interest into a clinical trial. Generalizing findings from the RCT samples to the patient population has begun to receive increasing attention. We simulate a patient population with treatment effect size of 0.5 (Cohen’s d) and seven covariates that included gender, health insurance, race, baseline symptoms, comorbidity, age, and motivation. We then compare 6 generalizability indexes (SMD: standardized mean difference, C-statistic, β-index, OVL: overlapping coefficient, KSD: Kolmogorov-Smirnov distance, LD: Lévy Distance) with selected nonrandom trials and random trials from the patient population. Based on our results, we conclude that β-index could work as a reliable generalizability metric, and C-statistic and LD are also acceptable. When we know a trial is biased, the question is how to make inference from the bias sample to the patient population. We use 4 statistical approaches (IPSW: inverse probability-of-selection weights; EB: entropy balance, EVB: external validity bias, SC: subclassification estimator) to adjust the trial bias. Based on our results, EB should not be considered as bias adjustment method, SC over adjust the bias, IPSW could be an option, and EVB seems to be more reliable compared to other metrics, when all the covariates are observed.","abstract_has_math":false,"creators":["Lu, Yuanyuan"],"institution":"University of South Florida","degree_name":"Doctor of Public Health (Dr.PH.)","degree_level":"Dissertation","degree_discipline":"Public Health","degree_department":null,"school":null,"contributors":["Henian Chen, Ph.D.","Wei Wang, Ph.D.","Yangxin Huang, Ph.D.","Feng Cheng, Ph.D.","Ellen M. Daley, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-03-16T07:00:00Z","date_published":"2022-03-16T07:00:00Z","updated_at":"2026-11-19T08:47:41Z","subjects":["inference","non-random trial","propensity score","trial simulation","Biostatistics"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/9400","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/9400","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-10597","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Henian Chen, Ph.D.","Wei Wang, Ph.D.","Yangxin Huang, Ph.D.","Feng Cheng, Ph.D.","Ellen M. Daley, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Lu, Yuanyuan"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2022-03-16T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Public Health"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","D.P.H."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Public Health (Dr.PH.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["inference","non-random trial","propensity score","trial simulation","Biostatistics"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/9400"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["While randomized controlled trials (RCTs) are widely used as a gold standard in clinical research and public health, they are criticized because of a potential lack of generalizability, as the trial patients may be unrepresentative of the target patient population. Few research addresses how to assess and evaluate the generalizability of RCTs. As we know, patients are rarely selected on a random basis from a well-defined patient population of interest into a clinical trial. Generalizing findings from the RCT samples to the patient population has begun to receive increasing attention. We simulate a patient population with treatment effect size of 0.5 (Cohen’s d) and seven covariates that included gender, health insurance, race, baseline symptoms, comorbidity, age, and motivation. We then compare 6 generalizability indexes (SMD: standardized mean difference, C-statistic, β-index, OVL: overlapping coefficient, KSD: Kolmogorov-Smirnov distance, LD: Lévy Distance) with selected nonrandom trials and random trials from the patient population. Based on our results, we conclude that β-index could work as a reliable generalizability metric, and C-statistic and LD are also acceptable. When we know a trial is biased, the question is how to make inference from the bias sample to the patient population. We use 4 statistical approaches (IPSW: inverse probability-of-selection weights; EB: entropy balance, EVB: external validity bias, SC: subclassification estimator) to adjust the trial bias. Based on our results, EB should not be considered as bias adjustment method, SC over adjust the bias, IPSW could be an option, and EVB seems to be more reliable compared to other metrics, when all the covariates are observed."]},{"key":"dc:title","label":"Title","values":["Measurements of Generalizability and Adjustment for Bias in Clinical Trials"]}]}],"canonical_facts":{"dc:contributor":["Henian Chen, Ph.D.","Wei Wang, Ph.D.","Yangxin Huang, Ph.D.","Feng Cheng, Ph.D.","Ellen M. Daley, Ph.D."],"dc:creator":["Lu, Yuanyuan"],"dc:date":["2022-03-16T07:00:00Z"],"dc:description":["While randomized controlled trials (RCTs) are widely used as a gold standard in clinical research and public health, they are criticized because of a potential lack of generalizability, as the trial patients may be unrepresentative of the target patient population. Few research addresses how to assess and evaluate the generalizability of RCTs. As we know, patients are rarely selected on a random basis from a well-defined patient population of interest into a clinical trial. Generalizing findings from the RCT samples to the patient population has begun to receive increasing attention. We simulate a patient population with treatment effect size of 0.5 (Cohen’s d) and seven covariates that included gender, health insurance, race, baseline symptoms, comorbidity, age, and motivation. We then compare 6 generalizability indexes (SMD: standardized mean difference, C-statistic, β-index, OVL: overlapping coefficient, KSD: Kolmogorov-Smirnov distance, LD: Lévy Distance) with selected nonrandom trials and random trials from the patient population. Based on our results, we conclude that β-index could work as a reliable generalizability metric, and C-statistic and LD are also acceptable. When we know a trial is biased, the question is how to make inference from the bias sample to the patient population. We use 4 statistical approaches (IPSW: inverse probability-of-selection weights; EB: entropy balance, EVB: external validity bias, SC: subclassification estimator) to adjust the trial bias. Based on our results, EB should not be considered as bias adjustment method, SC over adjust the bias, IPSW could be an option, and EVB seems to be more reliable compared to other metrics, when all the covariates are observed."],"dc:identifier":["https://digitalcommons.usf.edu/etd/9400"],"dc:subject":["inference","non-random trial","propensity score","trial simulation","Biostatistics"],"dc:title":["Measurements of Generalizability and Adjustment for Bias in Clinical Trials"],"thesis:degree_discipline":["Public Health"],"thesis:degree_level":["Dissertation","D.P.H."],"thesis:degree_name":["Doctor of Public Health (Dr.PH.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:47:41Z"}