Back to search

Cornell University

Analytical Modeling and Efficient Implementation for Specialized Hardware Acceleration of Sparse Applications

Abstract

dc:description.abstract

Sparse linear algebra (SLA) underpins a wide range of critical applications, including data analytics, graph processing, deep learning, and transformers. In light of the growing footprints of sparse processing and diminishing benefits of generalpurpose scaling, recent years have seen an active body of research on accelerating sparse kernels using specialized hardware. However, the diverse characteristics of inputs across different sparse applications– such as variations in dimensions, density, and non-zero value distributions– necessitate tailored architectural configurations and components, resulting in an extensive design space for exploration. To efficiently develop SLA accelerators, designers must rapidly explore the complex design and configuration space, making traditional, time-consuming simulation-based approaches unsuitable. This dissertation presents our recent research on analytical modeling for rapid design space exploration (DSE) and the efficient implementation of sparse accelerators. First, we introduce a novel and comprehensive analytical model capable of estimating the performance of various compute patterns for SLA kernels, factoring in the characteristics of input matrices and specific architecture configurations. Next, by leveraging the rapid DSE enabled by this analytical model, we develop Vesper, a versatile sparse accelerator equipped with High Bandwidth Memory (HBM) to efficiently handle datasets of varying dimensions and density. Vesper accelerates four key SLA kernels: sparse-matrix dense-vector multiplication (SpMV), sparse-matrix dense-matrix multiplication (SpMM), sparse-matrix sparse vector multiplication (SpMSpV), and sparse-matrix sparse-matrix multiplication (SpGEMM). Guided by the analytical model, Vesper is designed to be configurable and resource-efficient, supporting diverse compute patterns and kernels while achieving throughput comparable to or exceeding state-of-the-art sparse accelerators. Finally, we present GraphAxe, the first format-architecture co-designed hardware accelerator tailored for processing ultrascale (out-of-core) graphs using solid-state drives (SSDs). Specifically, we introduce a quantization-based doubly compressed sparse column (QDCSC) format to reduce SSD traffic. To further maximize bandwidth utilization, we implement SSD-aware mechanisms, including dynamic payload size adjustment and scoreboard-based coordination. Compared to the state-of-the-art CPU-based out-of-core graph computing system, GraphAxe delivers a 2.20x geometric mean runtime improvement and a 154.16x increase in energy efficiency.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Electrical and Computer Engineering
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Electrical and Computer Engineering
Grantor
Cornell University
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Jin, Hanchen
Chair dc:contributor.chair
  • Zhang, Zhiru
Committee members dc:contributor.committeemember
  • Suh, Gookwon Edward
  • Albonesi, David

Subjects

dc:subject × 6

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16938283
Dc Identifier Other
ProQuest Submission ID: 14880
ProQuest Publication ID: 31994595

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Jin, Hanchen. Analytical Modeling and Efficient Implementation for Specialized Hardware Acceleration of Sparse Applications. Doctor of Philosophy thesis, Cornell University, 2025. https://hdl.handle.net/1813/117514