Back to search

University of Washington

On the Interaction of Learning Stages: Compression, Representation, and Transfer in Deep Learning

Abstract

dc:description.abstract

Machine learning systems are rarely monolithic. They are assembled from sequences of distinct learning stages, each transforming representations for the next. These stages include initialization and optimization, pre-training and fine-tuning, and compression and generation. In practice, however, each stage is typically designed and optimized in isolation. We argue that this neglect of cross-stage structure is a source of inefficiency and brittleness in modern deep learning: much of what determines a pipeline's behavior lies not within any single stage, but in the interactions between them. When a stage is designed with knowledge of those that follow, information and inductive biases can be carried forward in ways that improve the system as a whole. In this dissertation, we investigate how to make these cross-stage interactions explicit, and how doing so can improve the efficiency, robustness, and scaling of learning systems across both image understanding and image generation. We organize this study along three axes: representation, transfer, and compression. We first study representation, examining how a model's features can be deliberately trained so that future, independently trained models remain compatible with them, easing model updates in large-scale retrieval systems. We then turn to transfer, characterizing how properties of the pre-training stage relate to the robustness of fine-tuned models under distribution shift, and developing neural priming, which adapts vision-language models to new tasks at inference time using their own pre-training data. Finally, in generation, we examine how the rate-distortion trade-off of the tokenization stage affects how generation scales with compute, and introduce causally regularized tokenization, which incorporates inductive biases from the generation stage into the tokenizer to improve compute-optimal scaling. Taken together, these results suggest that deep learning pipelines yield more efficient and robust models when their stages are co-designed as interacting parts rather than optimized as independent components.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ramanujan, Vivek Kelan
Advisor dc:contributor.advisor
  • Farhadi, Ali

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • CC BY
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1773/57253

Chain of custody

source
Harvested from
University of Washington
Base URL
digital.lib.washington.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Ramanujan, Vivek Kelan. On the Interaction of Learning Stages: Compression, Representation, and Transfer in Deep Learning. 2026. https://hdl.handle.net/1773/57253