Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 56 for “"Tail Latency"”.
-
Delivering Predictable Tail Latency in Data Center Networks
… of RPCs whose slowest 1% dominate end-to-end latency, costing revenue and straining user patience. Operators codify expectations as tail latency SLOs, but meeting them is difficult even in well-run data center networks. Although such networks expose configuration parameters that have a large …
-
CO-DESIGNING SYSTEMS FOR MICROSECOND-SCALE CONSISTENT TAIL LATENCY IN DATACENTERS
Datacenters require microsecond-scale tail latency, as overall response time is dominated by the slowest server. Despite advances in high-speed networking and datapath OS architectures, fundamental challenges remain: expensive coordination in distributed consensus, dynamic workload imbalance, and …
-
New techniques to lower the tail latency in stream processing systems
… of effort has been made to reduce the average latency of stream processing systems, how to shorten their tail latency has received little attention. This thesis presents a series of novel techniques for reducing the tail latency in stream processing systems like Apache Storm. Concretely, we …
-
Towards SLO-aware Resource Scheduling for Serverless Inference Workloads
… critical factors such as response time and tail latency. Additionally, Python's Global Interpreter Lock (GIL) poses challenges for parallel computing in high-request traffic scenarios. This thesis addresses the need for efficient and cost-effective Machine Learning (ML) inference …
-
Optimizing interactive analytics engines for heterogeneous clusters
… Compared to Getafix, Getafix-H improves the tail latency by 18% and reduces memory usage by up to 27% (2-3X improvement over Scarlett). In presence of stragglers, Getafix-H improves tail latency by 55% and reduces memory usage by upto 20% compared to Getafix. Getafix-H enables sysadmins to …
-
PerfDB + PerlML: Enabling Big Data-Driven Research On Fine-Grained Performance Phenomena
The long-tail latency problem is a well-known problem in large-scale system topologies like cloud platforms. Long-tail latency can lead to less predictable system performance, degraded quality of experience and potential economic loss. Previous research has focused on coarse- grained, symptomatic …
-
Service Boosters: Library Operating Systems For The Datacenter
… to stringent performance requirements. High tail latency — percentiles at the tail of the response time distribution — is a threat to these requirements. As little as 0.01% slow requests in one microservice can significantly degrade performance for the entire application. The conventional …
-
Multi-agent Learning for Cooperative Scheduling of Microsecond-scale Services at Rack Scale
… throughput while providing microsecond-scale tail latency and high availability is extremely challenging. To address this challenge, we design a fully distributed load-balancing framework. In this framework, servers cooperatively balance the load in the system. We model the interactions among …
-
Evaluating GossipSub for Data Availability Sampling Under Ethereum Consensus Deadlines
… completion-time distributions (with emphasis on tail latency), bandwidth consumption, and duplication overhead. The results show that segmentation and replication dominate performance and overhead: increasing SA from coarse to moderate values reduces duplication with diminishing returns beyond SA …
-
EFFICIENT AND AUTOMATED SCALING OF DISTRIBUTED AI INFRASTRUCTURE
… cost modeling (TAPAS). On serving, we reduce tail latency under long, variable outputs via predictive scheduling and overlapped KV offloading (Tetris). Collectively, these contributions turn brittle, hand-tuned scaling into principled, automated workflows across the training-serving lifecycle.
-
Towards High Performance Abstractions for Strong Geo-Replicated Systems
… services that meet the high throughput and low latency requirements of large-scale Internet applications sacrifice strong guarantees or generality in the application programming interface. This dissertation argues that geo-replicated services that provide strong guaranteescan meet the high …
-
Predictive Parallelization: A Framework for Reducing Tail Latencies of Web Search Queries
… fast responses to user queries, making the tail latency more important to reduce than the average latency. With modern multicore servers, intra-query parallelization becomes a desirable technique for reducing the query response time. Our workload characterization of commercial search engine …
-
Chasing the “tail at scale”: Toward cloud-native architectures
… of their infrastructure. However, the detailed characterization of cloud-native environments presented in this thesis shows that these workloads differ significantly from traditional monolithic applications. They execute services that run for short times, exhibit bursty invocation …
-
Lite-Falcon: Targeted Hardware Transport for Low-Latency Exchange-facing Environments
… derived from Falcon principles, targeting tail-latency-sensitive workloads such as high-frequency trading (HFT). Unlike prior work focused on datacenter-scale systems, this implementation isolates and realizes a minimal, single-connection transport architecture in synthesizable register …
-
OPTIMIZING SYSTEM PERFORMANCE BY USING NON-VOLATILE MEMORY
… to overcome the huge memory consumption, long tail latency, and long recovery time problems. As one of the important use cases of AI databases, we then explore the method of using NVM for the Deep learning recommendation models (DLRM) training process. We propose OpenEmbedding, which applies an …
-
UniNet: accelerating the container network data plane in IaaS clouds
… SmartNICs for enhanced performance and reduced latency, and (3) instituting an isolated control plane that separates VM- and container-level rule insertions, making it tenant-accessible. UniNet boosts CNI throughput by 7.08x on average, cuts tail latency by 41.6%, and reduces CPU usage by up to …
-
Private 5G and its Suitability for Industrial Networking
… 1 ms, real-time, and Ultra-Reliable and Low-Latency Communications (URLLC). This was partly intended to get the attention of vertical industries to become new customers for mobile networks, which shall be deployed in their factories. With the allowance of federal agencies, companies deployed …
-
Enabling QoS Controls in Modern Distributed Storage Platforms
… service, as well as providing differentiated tail latency guarantees to the clients. In this thesis, we present novel approaches for providing bandwidth allocation and response time QoS in distributed storage platforms. For bandwidth allocation QoS, we develop a token-based scheduling …
-
PERFORMANCE AND ENDURANCE CONTROL IN EMERGING STORAGE TECHNOLOGIES
… the cloud and de- mands high performance in low latency and high throughput. Facebook reported that 3.3 billion people monthly and 2.6 billion people daily use their data centers over the network. Many emerging user-facing applications require strict control over the stor- age latency’s tail to …
-
Lost in translation : giving SMR drives a second chance
… I/O performance. However, there are no detailed root cause analyses of this degradation. This shallow evidence has led to the misconception that SMR drives are inherently inferior to their CMR counterparts and must only be used with applications that write sequentially. This dissertation …
Page 1 of 3