Back to search

Cornell University

Learning from Naturally Occurring Human Feedback

Abstract

dc:description.abstract

As Artificial Intelligence (AI) systems are increasingly deployed in real-world settings, their effectiveness is often constrained by the assumption that tasks are fully understood and clearly specified from the start. In practice, users struggle to articulate their full range of needs, while models lack the ability to learn from and adapt to real-world objectives once deployed. Recent advances in instruction following research have made progress in aligning models with human intent, but they rely on preference data from paid annotators, do not enable continual post-deployment improvement, and still depend on users’ prompt engineering skills. To address these limitations, this thesis develops AI language systems that learn from naturally occurring user feedback, introducing adaptable and reliable methods to enhance their practical utility. Proposed approaches including prioritizing real-world usage data over manually curated annotations, incorporating diverse feedback signals beyond traditional setups, and improving both individual model behavior and the broader language processing pipeline. By shifting AI development from static, pre-deployment objectives to interactive, real-world adaptation, this work contributes to building more practical, adaptive, and user-aligned AI systems.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Computer Science
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Computer Science
Grantor
Cornell University
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gao, Ge
Chair dc:contributor.chair
  • Cardie, Claire
Committee members dc:contributor.committeemember
  • Lee, Daniel
  • Snavely, Keith

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16938312
Dc Identifier Other
ProQuest Submission ID: 14968
ProQuest Publication ID: 32000331

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Gao, Ge. Learning from Naturally Occurring Human Feedback. Doctor of Philosophy thesis, Cornell University, 2025. https://hdl.handle.net/1813/117560