The age-cutoff regression discontinuity design (RDD) has emerged as one of the most rigorous quasi-experimental approaches to determining program effects of prekindergarten on literacy and numeracy outcomes for children at kindergarten entry. However, few pre-K meta-analyses have focused attention on validity threats. The current random-effects meta-regression tests the moderating effects of prominent threats to validity, selection bias and sensitivity, on impact estimates generated from age-cutoff regression discontinuity studies from large-scale programs. Results from averaging dependent standardized mean difference effects suggested small positive moderating effects of total attrition and robust 3-month bandwidths on reading effects, but not on math. However, these results were not statistically significant. In contrast, results generated from robust variance estimation yielded a small statistically significant association between total attrition and math effects. These mixed results may warrant further research on prekindergarten evaluation methodology, evaluation estimation methods, and the totality of evidence used to inform policy.