Back to search

Georgia Institute of Technology

Tuned and asynchronous stencil kernels for CPU/GPU systems

Abstract

dc:description.abstract

We describe heterogeneous multi-CPU and multi-GPU implementations of Jacobi's iterative method for the 2-D Poisson equation on a structured grid, in both single- and double-precision. Properly tuned, our best implementation achieves 98% of the empirical streaming GPU bandwidth (66% of peak) on a NVIDIA C1060. Motivated to find a still faster implementation, we further consider "wildly asynchronous" implementations that can reduce or even eliminate the synchronization bottleneck between iterations. In these versions, which are based on the principle of a chaotic relaxation (Chazan and Miranker, 1969), we simply remove or delay synchronization between iterations, thereby potentially trading off more flops (via more iterations to converge) for a higher degree of asynchronous parallelism. Our relaxed-synchronization implementations on a GPU can be 1.2-2.5x faster than our best synchronized GPU implementation while achieving the same accuracy. Looking forward, this result suggests research on similarly "fast-and-loose" algorithms in the coming era of increasingly massive concurrency and relatively high synchronization or communication costs.

Degree

thesis:*
Department dc:contributor.department
Computing
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2009

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Venkatasubramanian, Sundaresan
Advisor dc:contributor.advisor
  • Vuduc, Richard
Committee members dc:contributor.committeemember
  • Stentz, Anthony
  • Christensen, Henrik I.
  • Egerstedt, Magnus
  • Arkin, Ronald

Subjects

dc:subject × 23

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/29728

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Venkatasubramanian, Sundaresan. Tuned and asynchronous stencil kernels for CPU/GPU systems. Georgia Institute of Technology, 2009. http://hdl.handle.net/1853/29728