Georgia Institute of Technology
End-to-end Support for In-network Acceleration of Dynamically Chained Parametric Tasks
Abstract
dc:description.abstractModern cloud infrastructure faces a fundamental inefficiency: while modern software scales through shared resources—from dynamically linked libraries to containerized microservices— SmartNICs allocate dedicated hardware-accelerator resources per tenant, evoking the preDLL era where common functions were duplicated in every program. This wastes precious hardware resources in multi-tenant environments where applications often need the same computations (AES encryption, Kalman filters) with different parameters. This is particularly problematic for streaming-data applications, where large numbers of concurrent sources—organized into topic hierarchies—run identical processing chains that differ only in their per-source parameters. This thesis introduces parametric Compute Unit (CU) sharing—enabling multiple tenants to share hardware accelerators just as software shares libraries. The key challenges are twofold: managing parameters at line rate, without trading off the benefits that SmartNIC offload provides; and doing so without undue burden on programmers, without major disruption to established programming frameworks. We present two systems that together address these challenges. Vazado addresses parameter delivery at line rate: through hardware-compiler co-design, it dynamically chains CUs with incompatible signatures, extending CU sharing to parametric tasks that prior dedicatedpipeline systems cannot share—while matching the >100 Gbps throughput of systems like PANIC on just 10% of FPGA resources. ErdTree addresses programmer burden: a domainaware compiler that automatically translates familiar high-level streaming programs into a correct, efficient implementation of the CU chain and its parameter layout across the accelerator’s memory hierarchy—retaining throughput comparable to hand-optimized fixedparameter offloads while reducing memory footprint by 52% and supporting GB-scale off-chip state. Together, these systems demonstrate that efficient multi-tenant acceleration is achievable without sacrificing programmability—enabling SmartNICs to finally deliver on their promise of scalable, shared acceleration for cloud infrastructure.
Degree
thesis:*- Name thesis:degree_name
- Computer Science, PhD
- Department thesis:degree_department
- Computer Science
- Grantor
- Georgia Institute of Technology
- Year dc:date.issued
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Oliveira, Rafael Henrique Ribeiro
- Advisor dc:contributor.advisor
-
- Gavrilovska, Ada
- Committee members dc:contributor.committeemember
-
- Pande, Santosh
- Daglis, Alexandros
- Pu, Calton
- Esmaeilzadeh. Hadi
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/82146