{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-12380"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-12380","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Statistical Challenges and Simulation Results for Pilot Clinical Trials","abstract":"Background: The effect size estimated from a pilot trial is often an inaccurate reflection of the true effect size observed in a large trial, leading to either underestimation or overestimation. Published data suggest that effect sizes from large trials are typically smaller than those reported in their corresponding pilot trials. To address this discrepancy, conservative or discount adjustment methods are widely recommended to modify pilot trial effect sizes when calculating sample sizes, thereby maintaining adequate statistical power. This study aims to assess effect sizes from both pilot and large trials and to evaluate the performance of existing adjustment methods. Methods: Published effect sizes from both pilot trials and large trials were systematically reviewed. Existing adjustment methods for pilot trial effect sizes, including multiplicative, additive, lower confidence limit (LCL), and the Dual-Bound Weighted method, were evaluated through simulated clinical trials across a range of true effect sizes and sample sizes. Both underestimation and overestimation were examined and compared. Results: When pilot estimates showed upward bias, conservative methods reduced overestimation and improved accuracy. However, when pilot trials underestimated the true effect, these methods exaggerated underestimation, leading to excessively large sample size recommendations. Performance varied by context: multiplicative and 60% LCL adjustments worked well for small and moderate effects under random or upward bias, but none were optimal across all scenarios. The proposed DB-weighted method achieved greater balance and accuracy for larger sample sizes and effect sizes, regardless of bias direction. Conclusion: Findings challenge the universal use of conservative adjustments of pilot ES estimates. Researchers should tailor adjustment strategies based on bias direction, sample size, and effect size magnitude. The DB-weighted method provides a more balanced alternative when bias direction is uncertain. This study offers practical guidance for selecting adjustment methods based on suspected bias direction, sample size, and effect size magnitude.","abstract_html":"Background: The effect size estimated from a pilot trial is often an inaccurate reflection of the true effect size observed in a large trial, leading to either underestimation or overestimation. Published data suggest that effect sizes from large trials are typically smaller than those reported in their corresponding pilot trials. To address this discrepancy, conservative or discount adjustment methods are widely recommended to modify pilot trial effect sizes when calculating sample sizes, thereby maintaining adequate statistical power. This study aims to assess effect sizes from both pilot and large trials and to evaluate the performance of existing adjustment methods. Methods: Published effect sizes from both pilot trials and large trials were systematically reviewed. Existing adjustment methods for pilot trial effect sizes, including multiplicative, additive, lower confidence limit (LCL), and the Dual-Bound Weighted method, were evaluated through simulated clinical trials across a range of true effect sizes and sample sizes. Both underestimation and overestimation were examined and compared. Results: When pilot estimates showed upward bias, conservative methods reduced overestimation and improved accuracy. However, when pilot trials underestimated the true effect, these methods exaggerated underestimation, leading to excessively large sample size recommendations. Performance varied by context: multiplicative and 60% LCL adjustments worked well for small and moderate effects under random or upward bias, but none were optimal across all scenarios. The proposed DB-weighted method achieved greater balance and accuracy for larger sample sizes and effect sizes, regardless of bias direction. Conclusion: Findings challenge the universal use of conservative adjustments of pilot ES estimates. Researchers should tailor adjustment strategies based on bias direction, sample size, and effect size magnitude. The DB-weighted method provides a more balanced alternative when bias direction is uncertain. This study offers practical guidance for selecting adjustment methods based on suspected bias direction, sample size, and effect size magnitude.","abstract_has_math":false,"creators":["Cen, Weiliang"],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Public Health","degree_department":null,"school":null,"contributors":["Henian Chen, Ph.D.","Stephanie Marhefka-Day, Ph.D.","Wei Wang, Ph.D.","Yangxin Huang, Ph.D.","Matthew Valente, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2025,"date_issued":"2025-11-07T08:00:00Z","date_published":"2025-11-07T08:00:00Z","updated_at":"2026-11-19T08:49:48Z","subjects":["Clinical Trials","Effect size","Effect Size Adjustments","Pilot Trials","Sample Size","Trial Simulations","Biostatistics"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/11077","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/11077","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-12380","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Henian Chen, Ph.D.","Stephanie Marhefka-Day, Ph.D.","Wei Wang, Ph.D.","Yangxin Huang, Ph.D.","Matthew Valente, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Cen, Weiliang"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2025-11-07T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Public Health"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Clinical Trials","Effect size","Effect Size Adjustments","Pilot Trials","Sample Size","Trial Simulations","Biostatistics"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/11077"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Background: The effect size estimated from a pilot trial is often an inaccurate reflection of the true effect size observed in a large trial, leading to either underestimation or overestimation. Published data suggest that effect sizes from large trials are typically smaller than those reported in their corresponding pilot trials. To address this discrepancy, conservative or discount adjustment methods are widely recommended to modify pilot trial effect sizes when calculating sample sizes, thereby maintaining adequate statistical power. This study aims to assess effect sizes from both pilot and large trials and to evaluate the performance of existing adjustment methods. Methods: Published effect sizes from both pilot trials and large trials were systematically reviewed. Existing adjustment methods for pilot trial effect sizes, including multiplicative, additive, lower confidence limit (LCL), and the Dual-Bound Weighted method, were evaluated through simulated clinical trials across a range of true effect sizes and sample sizes. Both underestimation and overestimation were examined and compared. Results: When pilot estimates showed upward bias, conservative methods reduced overestimation and improved accuracy. However, when pilot trials underestimated the true effect, these methods exaggerated underestimation, leading to excessively large sample size recommendations. Performance varied by context: multiplicative and 60% LCL adjustments worked well for small and moderate effects under random or upward bias, but none were optimal across all scenarios. The proposed DB-weighted method achieved greater balance and accuracy for larger sample sizes and effect sizes, regardless of bias direction. Conclusion: Findings challenge the universal use of conservative adjustments of pilot ES estimates. Researchers should tailor adjustment strategies based on bias direction, sample size, and effect size magnitude. The DB-weighted method provides a more balanced alternative when bias direction is uncertain. This study offers practical guidance for selecting adjustment methods based on suspected bias direction, sample size, and effect size magnitude."]},{"key":"dc:title","label":"Title","values":["Statistical Challenges and Simulation Results for Pilot Clinical Trials"]}]}],"canonical_facts":{"dc:contributor":["Henian Chen, Ph.D.","Stephanie Marhefka-Day, Ph.D.","Wei Wang, Ph.D.","Yangxin Huang, Ph.D.","Matthew Valente, Ph.D."],"dc:creator":["Cen, Weiliang"],"dc:date":["2025-11-07T08:00:00Z"],"dc:description":["Background: The effect size estimated from a pilot trial is often an inaccurate reflection of the true effect size observed in a large trial, leading to either underestimation or overestimation. Published data suggest that effect sizes from large trials are typically smaller than those reported in their corresponding pilot trials. To address this discrepancy, conservative or discount adjustment methods are widely recommended to modify pilot trial effect sizes when calculating sample sizes, thereby maintaining adequate statistical power. This study aims to assess effect sizes from both pilot and large trials and to evaluate the performance of existing adjustment methods. Methods: Published effect sizes from both pilot trials and large trials were systematically reviewed. Existing adjustment methods for pilot trial effect sizes, including multiplicative, additive, lower confidence limit (LCL), and the Dual-Bound Weighted method, were evaluated through simulated clinical trials across a range of true effect sizes and sample sizes. Both underestimation and overestimation were examined and compared. Results: When pilot estimates showed upward bias, conservative methods reduced overestimation and improved accuracy. However, when pilot trials underestimated the true effect, these methods exaggerated underestimation, leading to excessively large sample size recommendations. Performance varied by context: multiplicative and 60% LCL adjustments worked well for small and moderate effects under random or upward bias, but none were optimal across all scenarios. The proposed DB-weighted method achieved greater balance and accuracy for larger sample sizes and effect sizes, regardless of bias direction. Conclusion: Findings challenge the universal use of conservative adjustments of pilot ES estimates. Researchers should tailor adjustment strategies based on bias direction, sample size, and effect size magnitude. The DB-weighted method provides a more balanced alternative when bias direction is uncertain. This study offers practical guidance for selecting adjustment methods based on suspected bias direction, sample size, and effect size magnitude."],"dc:identifier":["https://digitalcommons.usf.edu/etd/11077"],"dc:subject":["Clinical Trials","Effect size","Effect Size Adjustments","Pilot Trials","Sample Size","Trial Simulations","Biostatistics"],"dc:title":["Statistical Challenges and Simulation Results for Pilot Clinical Trials"],"thesis:degree_discipline":["Public Health"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:49:48Z"}