Back to search

Cornell University

Designing for Inference in Future Generative Models

Abstract

dc:description.abstract

The rapid evolution of generative models has significantly advanced artificial intelligence, enabling the creation of human-like text, realistic images, and even scientific discoveries. Powered by transformer architectures and vast datasets, these models demonstrate remarkable proficiency across various domains. However, as these models become increasingly large and sophisticated, they face substantial computational challenges. The quadratic complexity inherent in attention mechanisms during inference poses a significant bottleneck, restricting practical deployment—especially in resource-constrained environments. Consequently, despite their impressive capabilities, the scalability and accessibility of current generative models remain constrained. This thesis addresses these challenges by designing new models and inference paradigms for future generative models that retain or surpass high-quality outputs while significantly improving computational efficiency. We investigate how increasing context complexity impacts computational efficiency and model performance, identifying bottlenecks in current architectures (RQ1). Leveraging architectural innovations and advanced model compression techniques, we develop novel models that optimize inference for detailed and high-resolution outputs without incurring prohibitive computational costs (RQ2). We adapt these models for deployment in resource-constrained environments without sacrificing performance or capabilities, broadening their accessibility and practicality (RQ3). Additionally, we enhance interpretability and usability by studying how users make sense of interactions with generative models, ensuring fairness and facilitating meaningful human engagement in user-facing applications (RQ4). Our contributions advance the design of inference paradigms for future generative models, paving the way for scalable, efficient, and user-friendly systems that bridge the gap between advanced capabilities and real-world deployment.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Information Science
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Information Science
Grantor
Cornell University
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Yan, Jing Nathan
Chair dc:contributor.chair
  • Rzeszotarski, Jeffrey
Committee members dc:contributor.committeemember
  • Rush, Alexander
  • Fussell, Susan
  • Joachims, Thorsten

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16922036
Dc Identifier Other
ProQuest Submission ID: 14786
ProQuest Publication ID: 31641537

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Yan, Jing Nathan. Designing for Inference in Future Generative Models. Doctor of Philosophy thesis, Cornell University, 2024. https://hdl.handle.net/1813/117157