Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 3 of 3 for “"Post Training Compression"”.

  1. Improving the ML Tradeoff Curve: Efficiencies in Computation, Memory, and Tuning

    … of resources to increase model capability. More training iterations, hyperparameter tuning, model parameters, or data are generally beneficial. For a computational or memory resource, and a capability metric, there is a a Pareto frontier. Navigating this tradeoff curve, i.e. scaling resources to …

    cornell Repository record for Improving the ML Tradeoff Curve: Efficiencies in Computation, Memory, and Tuning (opens in a new tab)

  2. Exploring Efficient Methods for Transformer-based Foundation Language Models

    … on architectural modifications during the pre-training stage. It is presented as a collection of three peer-reviewed publications, each addressing a specific component of the Transformer architecture. The first work introduces a parameter-efficient embedding layer that uses a hashing function …

    whiterose Download PDF for Exploring Efficient Methods for Transformer-based Foundation Language Models (opens in a new tab)

  3. Compression Trinity: Exploring Sparsity, Quantization, and Low-Rank Approximations for LLM Compression

    … of Large Language Models (LLMs). Traditional compression techniques (sparsity, quantization, low-rank approximations) are typically applied in isolation, limiting effectiveness as each hits an accuracy-efficiency wall. Addressing this is critical for sustainable LLM deployment. This thesis …

    toronto-retro Repository record for Compression Trinity: Exploring Sparsity, Quantization, and Low-Rank Approximations for LLM Compression (opens in a new tab)