Back to search

Georgia Institute of Technology

Understanding The Challenges with Using Hardware Pre-Fetchers for CPU-Based Matrix Multiply Units

Abstract

dc:description.abstract

Many advancements in the machine learning field have led to Graphics Processing Unit (GPU) being the de facto standard of large scale matrix computation accelerator. This work aims to answer questions about how difficult it is to use the traditional Central Processing Unit (CPU) with matrix accelerators and prefetching hardware integrated into the core instruction set for Artificial Intelligence (AI)- and Large Language Model (LLM)-like workloads. Specifically, this work focuses on the usage of stream prefetchers to optimize the performance of tile multiply instructions on Intel’s Sapphire Rapids Processors, referred to as the Advanced Matrix Extensions (AMX) instruction set.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Goldstein, Michael
Advisor dc:contributor.advisor
  • Kim, Hyesoon
Committee members dc:contributor.committeemember
  • Hao, Callie
  • Krishna, Tushar

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/76878

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Goldstein, Michael. Understanding The Challenges with Using Hardware Pre-Fetchers for CPU-Based Matrix Multiply Units. Masters thesis, Georgia Institute of Technology, 2024. https://hdl.handle.net/1853/76878