Back to search

Virginia Tech

Statistical Inference for Image Classification, Language Reasoning, and Counterfactual Estimation

Abstract

dc:description.abstract

This dissertation addresses three interconnected challenges in statistical inference and machine learning: uncertainty quantification under distribution shift, robust causal estimation in panel data, and reliable confidence estimation for large language models. The first contribution introduces DPI-RG, a distribution-free framework for constructing predictive sets for high-dimensional data under distribution shifts. Using a conditional Wasserstein round-trip generative model, DPI-RG maps data to a lower-dimensional latent space where test statistics asymptotically follow a Chi-square distribution, yielding theoretically guaranteed p-values. The framework exhibits strong robustness to outliers and target shifts without requiring outlier labels during training. The second contribution presents CONCORD, a confidence estimation framework for large language models that represents responses as semantic distributions over constituent clauses rather than single embedding vectors. By combining Sentence Mover's Distance with Symbolic Answer Match, CONCORD captures both structural divergence and discrete answer agreement, producing calibrated confidence scores that substantially outperform logit-based and embedding-based baselines on mathematical reasoning benchmarks. The third contribution proposes an Linfty-regularized Synthetic Control method that bridges the sparse weighting of traditional synthetic control and the denser, more robust weighting of Difference-in-Differences. By distributing weights more evenly across control units while remaining data-driven, the method improves robustness and interpretability while increasing the likelihood of satisfying the parallel trends assumption.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Statistics
Department dc:contributor.department
Statistics
Grantor dc:publisher
Virginia Tech
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ye, Youhui
Chair dc:contributor.committeechair
  • Xing, Xin
Committee members dc:contributor.committeemember
  • Kim, Inyoung
  • Du, Pang
  • Wang, Le

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • Creative Commons Attribution 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Other
vt_gsexam:46721

Chain of custody

source
Harvested from
Virginia Tech
Base URL
vtechworks.lib.vt.edu/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Ye, Youhui. Statistical Inference for Image Classification, Language Reasoning, and Counterfactual Estimation. doctoral thesis, Virginia Tech, 2026. https://hdl.handle.net/10919/143407