Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 3 of 3 for “"Post Training Compression"”.
-
Improving the ML Tradeoff Curve: Efficiencies in Computation, Memory, and Tuning
… of resources to increase model capability. More training iterations, hyperparameter tuning, model parameters, or data are generally beneficial. For a computational or memory resource, and a capability metric, there is a a Pareto frontier. Navigating this tradeoff curve, i.e. scaling resources to …
-
Exploring Efficient Methods for Transformer-based Foundation Language Models
… on architectural modifications during the pre-training stage. It is presented as a collection of three peer-reviewed publications, each addressing a specific component of the Transformer architecture. The first work introduces a parameter-efficient embedding layer that uses a hashing function …
-
Compression Trinity: Exploring Sparsity, Quantization, and Low-Rank Approximations for LLM Compression
… of Large Language Models (LLMs). Traditional compression techniques (sparsity, quantization, low-rank approximations) are typically applied in isolation, limiting effectiveness as each hits an accuracy-efficiency wall. Addressing this is critical for sustainable LLM deployment. This thesis …