Back to search

University of British Columbia

Shared load-store unit for instruction-based accelerators : case study with soft multicore and multithreaded RISC-V vector processors

Abstract

dc:description

The end of Moore's Law and Dennard Scaling has shifted computing systems toward specialized accelerators to increase performance and lower power-per-operation. Accelerators are special-purpose hardware optimized to perform specific functions within general-purpose computing systems, and modern SoCs combine many general-purpose processors with a growing number of accelerators. Accelerators achieve higher performance and power efficiency by prioritizing specialization and heterogeneity over generality and homogeneity. When specialization reduces the cost of processing low enough, accelerators become memory-limited. High-performance accelerators typically access memory directly or through caches to circumvent throughput bottlenecks from accessing data only through the processor's register file. However, direct access to shared memory introduces coherence and consistency issues, both challenging aspects of modern processor design. As accelerators proliferate in shared-memory heterogeneous SoCs, ensuring coherence and consistency in each accelerator adds significant design complexity. This thesis proposes a novel shared load-store unit (LSU) to address these challenges collectively for all accelerators. The shared LSU specifically targets instruction-based accelerators integrated into the processor's instruction set architecture. Sharing an LSU consolidates LSU logic, buffering, multiple memory access ports, and coherence and consistency logic into a single unit. It can also enable automatic dependence checking, leading to improved performance. The shared LSU aims to alleviate the burden on designers who typically create accelerator-specific LSUs. Its platform-independent design is written in standard SystemVerilog HDL and uses open-source communication protocols to facilitate hardware reuse. It also offers programmers a simplified programming model featuring custom, accelerator-based, fine-grain fences. A case study demonstrates a shared LSU that replaces individual vector LSUs in high-performance soft RISC-V vector cores integrated into a single scalar core. Each vector core enables simplified multithreading of single-threaded programs using contexts. Many of these vector cores form a novel multicore and multithreaded vector architecture that further enhances performance. The shared LSU seamlessly integrates with the vector cores in an SoC implemented on the AMD ZCU104 evaluation kit. In this system, a single-threaded program using two vector cores and two contexts achieves a 2.66x speedup on rgba2luma, effectively hiding memory latency and pipeline stalls.

Degree

thesis:*
Name thesis:degree_name
Master of Applied Science - MASc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Electrical and Computer Engineering
Grantor dc:publisher
University of British Columbia
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Maheshe, Joseph
Contributors dc:contributor
  • Lemieux, Guy

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/90088

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Maheshe, Joseph. Shared load-store unit for instruction-based accelerators : case study with soft multicore and multithreaded RISC-V vector processors. master's thesis, University of British Columbia, 2024. http://hdl.handle.net/2429/90088