Back to search

Georgia Institute of Technology

End-to-end Support for In-network Acceleration of Dynamically Chained Parametric Tasks

Abstract

dc:description.abstract

Modern cloud infrastructure faces a fundamental inefficiency: while modern software scales through shared resources—from dynamically linked libraries to containerized microservices— SmartNICs allocate dedicated hardware-accelerator resources per tenant, evoking the preDLL era where common functions were duplicated in every program. This wastes precious hardware resources in multi-tenant environments where applications often need the same computations (AES encryption, Kalman filters) with different parameters. This is particularly problematic for streaming-data applications, where large numbers of concurrent sources—organized into topic hierarchies—run identical processing chains that differ only in their per-source parameters. This thesis introduces parametric Compute Unit (CU) sharing—enabling multiple tenants to share hardware accelerators just as software shares libraries. The key challenges are twofold: managing parameters at line rate, without trading off the benefits that SmartNIC offload provides; and doing so without undue burden on programmers, without major disruption to established programming frameworks. We present two systems that together address these challenges. Vazado addresses parameter delivery at line rate: through hardware-compiler co-design, it dynamically chains CUs with incompatible signatures, extending CU sharing to parametric tasks that prior dedicatedpipeline systems cannot share—while matching the >100 Gbps throughput of systems like PANIC on just 10% of FPGA resources. ErdTree addresses programmer burden: a domainaware compiler that automatically translates familiar high-level streaming programs into a correct, efficient implementation of the CU chain and its parameter layout across the accelerator’s memory hierarchy—retaining throughput comparable to hand-optimized fixedparameter offloads while reducing memory footprint by 52% and supporting GB-scale off-chip state. Together, these systems demonstrate that efficient multi-tenant acceleration is achievable without sacrificing programmability—enabling SmartNICs to finally deliver on their promise of scalable, shared acceleration for cloud infrastructure.

Degree

thesis:*
Name thesis:degree_name
Computer Science, PhD
Department thesis:degree_department
Computer Science
Grantor
Georgia Institute of Technology
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Oliveira, Rafael Henrique Ribeiro
Advisor dc:contributor.advisor
  • Gavrilovska, Ada
Committee members dc:contributor.committeemember
  • Pande, Santosh
  • Daglis, Alexandros
  • Pu, Calton
  • Esmaeilzadeh. Hadi

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/82146

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Oliveira, Rafael Henrique Ribeiro. End-to-end Support for In-network Acceleration of Dynamically Chained Parametric Tasks. Georgia Institute of Technology, 2026. https://hdl.handle.net/1853/82146