Back to search

Georgia Institute of Technology

Distributed services with elastic container memory abstractions for big data clouds

Abstract

dc:description.abstract

Big data powered distributed services and applications have become an integral part of many products and services today. Yet, they suffer large performance loss when their working sets memory no longer fully fit in container memory and they cannot leverage unused host and remote memory even in the presence of large imbalance in memory utilization across containers and across cluster. They also suffer from limited scalability when the application logic deals with traffic from many nodes in the cluster due to limited resources in a host node(e.g., RAM, network). This dissertation research focuses on addressing these problems by developing distributed services with elastic container memory abstraction, enabling container runtime to utilize free memory on the same host and in remote nodes of a cluster with four unique contributions. (1) A transparent and elastic host memory abstraction to allow cross-container memory sharing based on dynamic and transient memory demands of container runtime. (2) An elastic remote network memory abstraction on top of RDMA to reduce the performance gap between local and remote memory. Several RDMA optimizations are introduced to provide efficient communication fabrics for enabling containers to leverage our cross-node memory abstraction and achieve maximum throughput. (3) A transparent network memory storage for container execution to allow cross-container and cross-node memory sharing. This enables containers to flexibly expand its memory demand to remote memory in the cluster in response to the unexpected demand on the working set memory when the host memory is insufficient to accommodate the demand. (4) Resilient decentralized communication protocols to support two types of distributed services with no inherent bottleneck and high connectivity and reachability to the overlay network: scalable and fault tolerant network memory sharing system and federated learning system.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Bae, Juhyun
Advisors dc:contributor.advisor
  • Liu, Ling
  • Pu, Calton
Committee members dc:contributor.committeemember
  • Lofstead, Jay
  • Arulaj, Joy
  • Mohamed Tawfik Issa, Said

Subjects

dc:subject × 2

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/72456

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Bae, Juhyun. Distributed services with elastic container memory abstractions for big data clouds. Doctoral thesis, Georgia Institute of Technology, 2022. https://hdl.handle.net/1853/72456