Back to search

University of Washington

Structure-Guided Approaches for Robust Language Model Reasoning

Abstract

dc:description.abstract

Large Language Models exhibit increasingly sophisticated behaviors, yet we lack systematic methods to evaluate their true reasoning capabilities. Current approaches—such as collecting human-generated data—cannot reliably predict model failure modes, distinguish genuine reasoning from complex memorization patterns, nor guarantee synthetic data quality.This thesis explores the idea that imbuing tasks with explicit structure provides the control and verification mechanisms necessary for more principled evaluation and reliable data generation. Structure unlocks optimization and search algorithms that can systematically discover model flaws while supporting both higher-quality training data generation and targeted inference-time improvements through more interpretable methods. This creates a virtuous cycle where better evaluation can lead to stronger modeling. Throughout four works, I demonstrate this approach across degrees of structural abstraction, ranging from surface-level to semantic-level control. Applications span from prompt formatting sensitivity and compositional reasoning analysis, to theory of mind reasoning improvement and evaluation. Crucially, it is this explicit structure that unlocks diverse techniques including multi-armed bandits for exploration, A* search for adversarial discovery of challenging data, and custom graph algorithms for reasoning representation and mental state modeling. By simultaneously showing successful applications for improving evaluation rigor, data quality, and overall model performance, structure-guided approaches offer a path toward more reliable and capable language modeling.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Sclar, Melanie
Advisors dc:contributor.advisor
  • Choi, Yejin
  • Tsvetkov, Yulia

Subjects

dc:subject × 2

Rights

dc:rights
Statement dc:rights
  • CC BY
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1773/57743

Chain of custody

source
Harvested from
University of Washington
Base URL
digital.lib.washington.edu/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Sclar, Melanie. Structure-Guided Approaches for Robust Language Model Reasoning. 2026. https://hdl.handle.net/1773/57743