Back to search

Georgia Institute of Technology

Advancing reasoning and planning in large language models via reward shaping

Abstract

dc:description.abstract

Recent advancements in large language models (LLMs) have significantly enhanced their reasoning and planning capabilities, enabling them to serve effectively in complex, real-world scenarios. Despite these improvements, achieving human-level performance remains challenging, particularly for tasks requiring extensive multi-step reasoning and sophisticated planning. Motivated by these limitations, my dissertation focuses on improving the reasoning and planning abilities of LLMs through reward shaping to guide LLM decision-making by optimizing rewards for desired outcomes. The core contributions of this thesis are organized around three key aspects of effective and robust reasoning in LLM agents: (1) advancing LLM reasoning and planning capabilities through environmental feedback, long-term memory, and external tool use (Aim 1); (2) integrating human values, goals, and distinct capabilities into LLMs through precise reward models and human-like preferences for reinforcement learning (Aim 2); and (3) improving model robustness to imperfect samples, including sparse data, out-of-distribution data, and noisy labels (Aim 3). Additionally, the dissertation emphasizes data-centric approaches to curate high-quality datasets with light human effort, ensuring both training efficiency and faithful evaluation. Together, these thrusts represent a cohesive, data-centric strategy for enhancing LLM capabilities, systematically improving their ability to reason, plan, and adapt efficiently in complex, real-world environments.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Computational Science and Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhuang, Yuchen
Advisor dc:contributor.advisor
  • Zhang, Chao
Committee members dc:contributor.committeemember
  • Dai, Bo
  • Zhao, Tuo
  • Mussmann, Steve
  • Yang, Sherry

Subjects

dc:subject × 2

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/78674

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhuang, Yuchen. Advancing reasoning and planning in large language models via reward shaping. Doctoral thesis, Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/78674