Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 56 for “"Tail Latency"”.

  1. Delivering Predictable Tail Latency in Data Center Networks

    … of RPCs whose slowest 1% dominate end-to-end latency, costing revenue and straining user patience. Operators codify expectations as tail latency SLOs, but meeting them is difficult even in well-run data center networks. Although such networks expose configuration parameters that have a large …

    washington Repository record for Delivering Predictable Tail Latency in Data Center Networks (opens in a new tab)

  2. CO-DESIGNING SYSTEMS FOR MICROSECOND-SCALE CONSISTENT TAIL LATENCY IN DATACENTERS

    Datacenters require microsecond-scale tail latency, as overall response time is dominated by the slowest server. Despite advances in high-speed networking and datapath OS architectures, fundamental challenges remain: expensive coordination in distributed consensus, dynamic workload imbalance, and …

    nus Repository record for CO-DESIGNING SYSTEMS FOR MICROSECOND-SCALE CONSISTENT TAIL LATENCY IN DATACENTERS (opens in a new tab) Download file for CO-DESIGNING SYSTEMS FOR MICROSECOND-SCALE CONSISTENT TAIL LATENCY IN DATACENTERS (opens in a new tab)

  3. New techniques to lower the tail latency in stream processing systems

    … of effort has been made to reduce the average latency of stream processing systems, how to shorten their tail latency has received little attention. This thesis presents a series of novel techniques for reducing the tail latency in stream processing systems like Apache Storm. Concretely, we …

    uiuc Repository record for New techniques to lower the tail latency in stream processing systems (opens in a new tab)

  4. Towards SLO-aware Resource Scheduling for Serverless Inference Workloads

    … critical factors such as response time and tail latency. Additionally, Python's Global Interpreter Lock (GIL) poses challenges for parallel computing in high-request traffic scenarios. This thesis addresses the need for efficient and cost-effective Machine Learning (ML) inference …

    vt Repository record for Towards SLO-aware Resource Scheduling for Serverless Inference Workloads (opens in a new tab)

  5. Optimizing interactive analytics engines for heterogeneous clusters

    … Compared to Getafix, Getafix-H improves the tail latency by 18% and reduces memory usage by up to 27% (2-3X improvement over Scarlett). In presence of stragglers, Getafix-H improves tail latency by 55% and reduces memory usage by upto 20% compared to Getafix. Getafix-H enables sysadmins to …

    uiuc Repository record for Optimizing interactive analytics engines for heterogeneous clusters (opens in a new tab)

  6. PerfDB + PerlML: Enabling Big Data-Driven Research On Fine-Grained Performance Phenomena

    The long-tail latency problem is a well-known problem in large-scale system topologies like cloud platforms. Long-tail latency can lead to less predictable system performance, degraded quality of experience and potential economic loss. Previous research has focused on coarse- grained, symptomatic …

    gatech Repository record for PerfDB + PerlML: Enabling Big Data-Driven Research On Fine-Grained Performance Phenomena (opens in a new tab)

  7. Service Boosters: Library Operating Systems For The Datacenter

    … to stringent performance requirements. High tail latency — percentiles at the tail of the response time distribution — is a threat to these requirements. As little as 0.01% slow requests in one microservice can significantly degrade performance for the entire application. The conventional …

    penn Repository record for Service Boosters: Library Operating Systems For The Datacenter (opens in a new tab)

  8. Multi-agent Learning for Cooperative Scheduling of Microsecond-scale Services at Rack Scale

    … throughput while providing microsecond-scale tail latency and high availability is extremely challenging. To address this challenge, we design a fully distributed load-balancing framework. In this framework, servers cooperatively balance the load in the system. We model the interactions among …

    waterloo Repository record for Multi-agent Learning for Cooperative Scheduling of Microsecond-scale Services at Rack Scale (opens in a new tab)

  9. Evaluating GossipSub for Data Availability Sampling Under Ethereum Consensus Deadlines

    … completion-time distributions (with emphasis on tail latency), bandwidth consumption, and duplication overhead. The results show that segmentation and replication dominate performance and overhead: increasing SA from coarse to moderate values reduces duplication with diminishing returns beyond SA …

    lancaster Download PDF for Evaluating GossipSub for Data Availability Sampling Under Ethereum Consensus Deadlines (opens in a new tab)

  10. EFFICIENT AND AUTOMATED SCALING OF DISTRIBUTED AI INFRASTRUCTURE

    … cost modeling (TAPAS). On serving, we reduce tail latency under long, variable outputs via predictive scheduling and overlapped KV offloading (Tetris). Collectively, these contributions turn brittle, hand-tuned scaling into principled, automated workflows across the training-serving lifecycle.

    nus Repository record for EFFICIENT AND AUTOMATED SCALING OF DISTRIBUTED AI INFRASTRUCTURE (opens in a new tab) Download file for EFFICIENT AND AUTOMATED SCALING OF DISTRIBUTED AI INFRASTRUCTURE (opens in a new tab)

  11. Towards High Performance Abstractions for Strong Geo-Replicated Systems

    … services that meet the high throughput and low latency requirements of large-scale Internet applications sacrifice strong guarantees or generality in the application programming interface. This dissertation argues that geo-replicated services that provide strong guaranteescan meet the high …

    cornell Repository record for Towards High Performance Abstractions for Strong Geo-Replicated Systems (opens in a new tab)

  12. Predictive Parallelization: A Framework for Reducing Tail Latencies of Web Search Queries

    … fast responses to user queries, making the tail latency more important to reduce than the average latency. With modern multicore servers, intra-query parallelization becomes a desirable technique for reducing the query response time. Our workload characterization of commercial search engine …

    rice Repository record for Predictive Parallelization: A Framework for Reducing Tail Latencies of Web Search Queries (opens in a new tab)

  13. Chasing the “tail at scale”: Toward cloud-native architectures

    … of their infrastructure. However, the detailed characterization of cloud-native environments presented in this thesis shows that these workloads differ significantly from traditional monolithic applications. They execute services that run for short times, exhibit bursty invocation …

    uiuc Repository record for Chasing the “tail at scale”: Toward cloud-native architectures (opens in a new tab)

  14. Lite-Falcon: Targeted Hardware Transport for Low-Latency Exchange-facing Environments

    … derived from Falcon principles, targeting tail-latency-sensitive workloads such as high-frequency trading (HFT). Unlike prior work focused on datacenter-scale systems, this implementation isolates and realizes a minimal, single-connection transport architecture in synthesizable register …

    houston Repository record for Lite-Falcon: Targeted Hardware Transport for Low-Latency Exchange-facing Environments (opens in a new tab) Embargoed until 2028-05-01

  15. OPTIMIZING SYSTEM PERFORMANCE BY USING NON-VOLATILE MEMORY

    … to overcome the huge memory consumption, long tail latency, and long recovery time problems. As one of the important use cases of AI databases, we then explore the method of using NVM for the Deep learning recommendation models (DLRM) training process. We propose OpenEmbedding, which applies an …

    nus Repository record for OPTIMIZING SYSTEM PERFORMANCE BY USING NON-VOLATILE MEMORY (opens in a new tab) Download file for OPTIMIZING SYSTEM PERFORMANCE BY USING NON-VOLATILE MEMORY (opens in a new tab)

  16. UniNet: accelerating the container network data plane in IaaS clouds

    … SmartNICs for enhanced performance and reduced latency, and (3) instituting an isolated control plane that separates VM- and container-level rule insertions, making it tenant-accessible. UniNet boosts CNI throughput by 7.08x on average, cuts tail latency by 41.6%, and reduces CPU usage by up to …

    uiuc Repository record for UniNet: accelerating the container network data plane in IaaS clouds (opens in a new tab)

  17. Private 5G and its Suitability for Industrial Networking

    … 1 ms, real-time, and Ultra-Reliable and Low-Latency Communications (URLLC). This was partly intended to get the attention of vertical industries to become new customers for mobile networks, which shall be deployed in their factories. With the allowance of federal agencies, companies deployed …

    qucosa-diss

  18. Enabling QoS Controls in Modern Distributed Storage Platforms

    … service, as well as providing differentiated tail latency guarantees to the clients. In this thesis, we present novel approaches for providing bandwidth allocation and response time QoS in distributed storage platforms. For bandwidth allocation QoS, we develop a token-based scheduling …

    rice Repository record for Enabling QoS Controls in Modern Distributed Storage Platforms (opens in a new tab)

  19. PERFORMANCE AND ENDURANCE CONTROL IN EMERGING STORAGE TECHNOLOGIES

    … the cloud and de- mands high performance in low latency and high throughput. Facebook reported that 3.3 billion people monthly and 2.6 billion people daily use their data centers over the network. Many emerging user-facing applications require strict control over the stor- age latency’s tail to …

    temple Repository record for PERFORMANCE AND ENDURANCE CONTROL IN EMERGING STORAGE TECHNOLOGIES (opens in a new tab)

  20. Lost in translation : giving SMR drives a second chance

    … I/O performance. However, there are no detailed root cause analyses of this degradation. This shallow evidence has led to the misconception that SMR drives are inherently inferior to their CMR counterparts and must only be used with applications that write sequentially. This dissertation …

    ubc Repository record for Lost in translation : giving SMR drives a second chance (opens in a new tab) Download PDF for Lost in translation : giving SMR drives a second chance (opens in a new tab)

Page 1 of 3