Virginia Tech
Statistical Inference for Image Classification, Language Reasoning, and Counterfactual Estimation
Abstract
dc:description.abstractThis dissertation addresses three interconnected challenges in statistical inference and machine learning: uncertainty quantification under distribution shift, robust causal estimation in panel data, and reliable confidence estimation for large language models. The first contribution introduces DPI-RG, a distribution-free framework for constructing predictive sets for high-dimensional data under distribution shifts. Using a conditional Wasserstein round-trip generative model, DPI-RG maps data to a lower-dimensional latent space where test statistics asymptotically follow a Chi-square distribution, yielding theoretically guaranteed p-values. The framework exhibits strong robustness to outliers and target shifts without requiring outlier labels during training. The second contribution presents CONCORD, a confidence estimation framework for large language models that represents responses as semantic distributions over constituent clauses rather than single embedding vectors. By combining Sentence Mover's Distance with Symbolic Answer Match, CONCORD captures both structural divergence and discrete answer agreement, producing calibrated confidence scores that substantially outperform logit-based and embedding-based baselines on mathematical reasoning benchmarks. The third contribution proposes an Linfty-regularized Synthetic Control method that bridges the sparse weighting of traditional synthetic control and the denser, more robust weighting of Difference-in-Differences. By distributing weights more evenly across control units while remaining data-driven, the method improves robustness and interpretability while increasing the likelihood of satisfying the parallel trends assumption.
Degree
thesis:*- Name thesis:degree_name
- Doctor of Philosophy
- Level thesis:degree_level
- doctoral
- Discipline thesis:degree_discipline
- Statistics
- Department dc:contributor.department
- Statistics
- Grantor dc:publisher
- Virginia Tech
- Year dc:date.issued
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Ye, Youhui
- Chair dc:contributor.committeechair
-
- Xing, Xin
- Committee members dc:contributor.committeemember
-
- Kim, Inyoung
- Du, Pang
- Wang, Le
Subjects
dc:subject × 3Rights
dc:rights- Statement dc:rights
-
- Creative Commons Attribution 4.0 International
- Licence dc:rights.uri
- Language dc:language.iso
- en
Identifiers
dc:identifier.*- Dc Identifier Other
- vt_gsexam:46721