Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 2 of 2 for “"Key Value Caches"”.

  1. Model Guided Memory Optimization For Key-Value Caches

    Modern web services deploy key-value caches to store popular requests to backend systems. As such, how the cache stores data impacts both the cache miss ratio and throughput. Therefore, in this thesis, we introduce and apply cache modeling techniques to optimize the memory organization of a …

    mtu Repository record for Model Guided Memory Optimization For Key-Value Caches (opens in a new tab)

  2. Toward Efficient Machine Learning Systems with Sampling and Compression.

    … strategies for efficient graph neural networks (CacheSample), accelerated 3D image rendering (FastSR-NeRF), and optimized retrieval-augmented generation systems (TeleRAG). We further propose novel compression methods targeting convolutional neural networks (SPIN), large language models (Atom), …

    washington Repository record for Toward Efficient Machine Learning Systems with Sampling and Compression. (opens in a new tab)