Back to search

Georgia Institute of Technology

Performance Analysis of Large-Scale Load Balancing Systems

Abstract

dc:description.abstract

Advanced cloud computing platforms, such as AWS, Azure, and Google Cloud, handle millions of requests per second. Efficiently assigning tasks across servers using a load balancing algorithm is critical for the seamless functioning of these systems. This dissertation focuses on performance analysis of large-scale load balancing systems. First, we analyze the JSQ policy in the super-Halfin-Whitt scaling window. We have shown that the centered and scaled process of total number of tasks in the system converges to a certain Bessel process. Also, its stationary distribution converges to a Gamma distribution. Then, we consider a heterogeneous model with the constraint of data locality and implement JSQ(d) policy. In this work, we investigate the graph structure with which the vanilla JSQ(d) policy can achieve the throughput optimality and improve the system performance greatly compared with the random assignment. In the third project, we extend our analysis to a more general heterogeneous system where the service rate depends on both types of servers and dispatchers. We proposed a new framework for analyzing the fully heterogeneous systems and designed two simple scalable delay-optimal routing policies. In the end, we discussed an application of the load balancing concept in the EV charging networks.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Industrial and Systems Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhao, Zhisheng
Advisor dc:contributor.advisor
  • Mukherjee, Debankur
Committee members dc:contributor.committeemember
  • Foley, Robert
  • Theja Maguluri, Siva
  • Atar, Rami
  • Righter, Rhonda

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/76977

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhao, Zhisheng. Performance Analysis of Large-Scale Load Balancing Systems. Doctoral thesis, Georgia Institute of Technology, 2024. https://hdl.handle.net/1853/76977