Back to search

Boston University

Efficient navigation of performance unpredictability in cloud through automated analytics systems

Abstract

dc:description.abstract

Performance unpredictability of the cloud hinders widespread adoption of cloud systems and adversely impacts costs and revenue. To mitigate this challenge, cloud systems typically incorporate monitoring and tracing mechanisms to collect a diverse set of metrics on applications' state to facilitate the analysis of performance fluctuations. Drawing on this collected data, engineers devote considerable effort to diagnosing performance issues and expediting the delivery of superior-quality software to enhance performance, aligning with changing demands. To capture unanticipated performance problems, engineers utilize state-of-the-art diagnostic systems to meticulously trace and record behavior of distributed applications running on cloud. However, this level of detailed tracing incurs considerable costs in terms of storage, computation, and network overheads. Even after engineers have resolved these performance problems, they may face challenges in deploying new code to the cloud. Gradual deployment approaches are available to mitigate risk by enabling faulty versions to be rolled back, but these systems lack the necessary statistical sophistication to accurately assess and compare application versions, potentially leading to further performance issues. This thesis argues that integrating automated, statistically-driven methods is imperative to achieve substantial improvements in efficiency when diagnosing application performance and delivering new code in the cloud. This vision has the potential to enable efficient and proactive performance management beyond the state-of-the-art by reducing time, effort, and cost spent on diagnosis and code delivery. To support this vision, the thesis makes two specific contributions. First, we demonstrate that dynamically adjusting instrumentation using statistically-driven techniques significantly enhances diagnosis efficiency. Our distributed tracing approach enables accurate tracing of sources of performance issues using only a small fraction of the available tracing instrumentation. Second, we demonstrate an online learning-based approach that intelligently adjusts the user traffic split among competing deployments, substantially improves code delivery efficiency. Our online experimentation approach reduces performance variations by directing user traffic to the optimal deployment during code delivery.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Electrical & Computer Engineering
Grantor
Boston University
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Toslali, Mert
Advisor dc:contributor.advisor
  • Coskun, Ayse K.

Subjects

dc:subject × 1

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/2144/46255

Chain of custody

source
Harvested from
Boston University
Base URL
open.bu.edu/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Toslali, Mert. Efficient navigation of performance unpredictability in cloud through automated analytics systems. doctoral thesis, Boston University, 2023. https://hdl.handle.net/2144/46255