Back to search

Georgia Institute of Technology

Sequential Decision Making at Scale: Theory and Applications

Abstract

dc:description.abstract

This thesis bridges the gap between traditional online optimization and adjacent decision-making literatures to solve complex resource allocation problems in large-scale systems. Novel methodologies are introduced by integrating stochastic optimal control, spectral perturbation analysis, decentralized optimization and game-theoretic frameworks into online decision-making problems that face massive reconfiguration penalties. Algorithms derived from these techniques yield robust, distribution-agnostic performance guarantees across centralized and multi-agent settings. Furthermore, these approaches are shown to achieve substantial real-world gains in critical domains like decentralized dynamic network slicing and learning-augmented scheduling for AI workloads. Spread across six chapters, the first three focus on online convex optimization with unbounded metric switching costs, with the fourth chapter demonstrating operational gains in the network slicing domain. The next two chapters shift focus to the online workload scheduling problem, first presenting state-of-the-art robustness guarantees and then applying them to public cloud services to realize real cost savings. Together, these results present a principled approach for handling reconfiguration overheads in dynamic large-scale systems.

Degree

thesis:*
Name thesis:degree_name
Machine Learning, PhD
Department thesis:degree_department
Industrial and Systems Engineering
Grantor
Georgia Institute of Technology
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Bhuyan, Neelkamal
Advisor dc:contributor.advisor
  • Mukherjee, Debankur
Committee members dc:contributor.committeemember
  • Maguluri, Siva Theja
  • Muthukumar, Vidya
  • Wierman, Adam
  • Dhara, Souvik
ORCID person:identifier.orcid

Rights

Language dc:language.iso
English

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/82171

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Bhuyan, Neelkamal. Sequential Decision Making at Scale: Theory and Applications. Georgia Institute of Technology, 2026. https://hdl.handle.net/1853/82171