Georgia Institute of Technology
Understanding The Challenges with Using Hardware Pre-Fetchers for CPU-Based Matrix Multiply Units
Abstract
dc:description.abstractMany advancements in the machine learning field have led to Graphics Processing Unit (GPU) being the de facto standard of large scale matrix computation accelerator. This work aims to answer questions about how difficult it is to use the traditional Central Processing Unit (CPU) with matrix accelerators and prefetching hardware integrated into the core instruction set for Artificial Intelligence (AI)- and Large Language Model (LLM)-like workloads. Specifically, this work focuses on the usage of stream prefetchers to optimize the performance of tile multiply instructions on Intel’s Sapphire Rapids Processors, referred to as the Advanced Matrix Extensions (AMX) instruction set.
Degree
thesis:*- Level thesis:degree_level
- Masters
- Department dc:contributor.department
- Computer Science
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Goldstein, Michael
- Advisor dc:contributor.advisor
-
- Kim, Hyesoon
- Committee members dc:contributor.committeemember
-
- Hao, Callie
- Krishna, Tushar
Subjects
dc:subject × 6Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/76878