Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 3 of 3 for “"Serverless Inference"”.

  1. Towards SLO-aware Resource Scheduling for Serverless Inference Workloads

    … necessitating efficient and cost-effective ML inference capabilities. Function-as-a-Service (FaaS) has emerged as a promising approach for hosting ML inference services, providing a serverless computing environment that streamlines development cycles and offers scalability and simplified …

    vt Repository record for Towards SLO-aware Resource Scheduling for Serverless Inference Workloads (opens in a new tab)

  2. PAMBA: Partition-aware and Multi-SLO Batching for Serverless Inference on Heterogeneous Clouds

    Serverless computing offers elasticity and fine-grained billing for machine learning inference, but efficiently supporting large models under diverse latency service-level objectives (SLOs) remains challenging. In particular, existing approaches face a wide cost–performance gap between CPU and GPU …

    york Repository record for PAMBA: Partition-aware and Multi-SLO Batching for Serverless Inference on Heterogeneous Clouds (opens in a new tab)

  3. Rethinking Serverless for Machine Learning Inference

    … intelligence and machine learning, AI/ML inference tasks have become exceedingly popular. However, executing these workloads on dedicated hardware may not be feasible for many users due to high maintenance costs, varying load patterns, and time to production. Furthermore, ML inference …

    vt Repository record for Rethinking Serverless for Machine Learning Inference (opens in a new tab)