Clemson University
Analyzing an In-line Compression Management System for Improved Performance in a High-Performance Computing Environment
Abstract
dc:description.abstractHigh-performance computing (HPC) has enabled advancements in computation speed and resource cost by utilizing all available server resources and using parallelization for speedup. This computation scheme encourages simulation model development, massive data collection, and AI computation models, all of which store and compute on massive amounts of data. Data compression has enhanced the performance of storing and transferring this HPC application data to enable acceleration, but the benefits of data compression can also be transferred to the active allocated memory used by the application. In-line compression is a compression method that keeps the application memory compressed in allocated memory, decompressing content as the data is needed by the algorithm. The actively decompressed data size in allocated memory can be limited by grouping and compressing the data into blocks informed by the application's computational kernel's data access patterns and a selected compressor. Several factors are considered to tune an in-line compression scheme for a kernel. This research explores factors such as block size and compressor choice on the runtime and memory usage of the Matrix Multiplication kernel (MM). Matrix multiplication is a fundamental algorithm in most HPC kernels that computes a linear transformation on a set of vectors. MM kernels provide a baseline for evaluating in-line compression due to MM's row-based data access patterns and the usage of several matrices to compute the resulting matrix. Like traditional data compression, trade-offs between memory size and the runtime necessary for compression necessitate tuned parameters for each kernel. The results of this research demonstrate essential parameter trends, trade-offs, and the importance of locality in the kernel's data access patterns.
Degree
thesis:*- Name thesis:degree_name
- Master of Science (MS)
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Electrical and Computer Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Platt, Steven
- Contributors dc:contributor
-
- Jon C. Calhoun
- Melissa Smith
- Tao Wei
Subjects
dc:subject × 6Identifiers
dc:identifier.*- Repository record dc:identifier
- https://open.clemson.edu/all_theses/4241