Back to search

Georgia Institute of Technology

Data services: bringing I/O processing to petascale

Abstract

dc:description.abstract

The increasing size of high performance computing systems and the associated increase in the volume of generated data, has resulted in an I/O bottleneck for these applications. This bottleneck is further exacerbated by the imbalance in the growth of processing capability compared to storage capability, due mainly to the power and cost requirements of scaling the storage. This thesis introduces data services, a new abstraction which provides significant benefits for data intensive applications. Data services combine low overhead data movement with flexible placement of data manipulation operations, to address the I/O challenges of leadership class scientific applications. The impact of asynchronous data movement on application runtime is minimized by utilizing novel server side data movement schedulers to avoid contention related jitter in application communication. Additionally, the JITStager component is presented. Utilizing dynamic code generation and flexible code placement, the JITStager allows data services to be executed as a pipeline extending from the application to storage. It is shown in this thesis that data services can add new functionality to the application without having an significant negative impact on performance.

Degree

thesis:*
Department dc:contributor.department
Computing
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2011

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Abbasi, Mohammad Hasan
Advisor dc:contributor.advisor
  • Schwan, Karsten
Committee members dc:contributor.committeemember
  • Wolf, Matthew
  • Vuduc, Richard
  • Oldfield, Ron
  • Klasky, Scott

Subjects

dc:subject × 13

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/42694

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Abbasi, Mohammad Hasan. Data services: bringing I/O processing to petascale. Georgia Institute of Technology, 2011. http://hdl.handle.net/1853/42694