{"id":{"repo_id":"mcmaster","oai_identifier":"oai:macsphere.mcmaster.ca:11375/32807"},"canonical_url":"https://search.ndltd.org/etd/mcmaster/oai:macsphere.mcmaster.ca:11375/32807","repository":{"repo_id":"mcmaster","name":"McMaster University","base_url":"https://macsphere.mcmaster.ca/server/oai/request"},"display":{"title":"Stream-Based Intelligent Memory Architectures for High-Performance and Predictable Real-Time Systems","abstract":"Emerging cyber-physical platforms such as autonomous vehicles and unmanned aerial systems increasingly integrate high-throughput workloads (e.g., perception and machine learning) with safety-critical real-time control on the same multicore, multi-channel Dynamic Random Access Memory (DRAM)-based system. While processor cores continue to scale, the memory system remains a major bottleneck: conventional hardware prefetchers and memory controllers are largely oblivious to program structure, leading to poor bandwidth utilization, high energy, and highly variable memory access latency that undermines real-time guarantees. This dissertation proposes a unified Hardware/Software (HW/SW) interface that leverages software-provided information, known prior to execution, to describe future memory access behavior to the hardware. A stream defines the underlying large, array-like data structure over which this access behavior, whether regular or irregular, occurs. Using compact stream descriptors, the software communicates future access sequences to a centralized hardware engine, which tags last-level cache misses and coordinates stream-aware optimizations across the memory hierarchy. Leveraging this interface, the thesis introduces three architectures: First, InterStellar and its multi-channel extension InterStellar 2.0 implement stream-aware DRAM controllers that perform intelligent page management and proactive DRAM-aware batching, substantially improving effective bandwidth and reducing row conflicts. Second, InterStellarRT adapts the same principles to real-time systems by forming analyzable real-time batches and applying a predictable scheduling policy, enabling tight worst-case memory-latency bounds for stream-based memory patterns. Third, COMPASS co-designs a stream-aware last-level cache prefetcher with a stream-aware memory controller, coordinating prefetch issuance with DRAM batching to reduce effective miss latency while sustaining high throughput. Evaluated across a broad set of scientific and high-performance computing workloads, these three architectures deliver substantial performance and energy improvements over state-of-the-art baselines. InterStellarRT, in addition, provides significantly tighter and formally analyzable worst-case latency bounds compared to contemporary real-time memory controllers. Collectively, the contributions demonstrate that stream-based memory intelligence is an effective approach to mitigating the memory-system vibottleneck in modern multicore platforms that integrate cache prefetching mechanisms and multi-channel DRAM subsystems The implementations of InterStellar 2.0, InterStellarRT, and COMPASS are available in the project repository: https://gitlab.com/fanosteam/fanosgem5. Each architecture is provided in a separate branch: 1) InterStellar 2.0 : https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellar-2.0 2) InterStellarRT https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellarRT 3) COMPASS https://gitlab.com/fanosteam/fanosgem5/-/tree/COMPASS","abstract_html":"Emerging cyber-physical platforms such as autonomous vehicles and unmanned aerial systems increasingly integrate high-throughput workloads (e.g., perception and machine learning) with safety-critical real-time control on the same multicore, multi-channel Dynamic Random Access Memory (DRAM)-based system. While processor cores continue to scale, the memory system remains a major bottleneck: conventional hardware prefetchers and memory controllers are largely oblivious to program structure, leading to poor bandwidth utilization, high energy, and highly variable memory access latency that undermines real-time guarantees. This dissertation proposes a unified Hardware/Software (HW/SW) interface that leverages software-provided information, known prior to execution, to describe future memory access behavior to the hardware. A stream defines the underlying large, array-like data structure over which this access behavior, whether regular or irregular, occurs. Using compact stream descriptors, the software communicates future access sequences to a centralized hardware engine, which tags last-level cache misses and coordinates stream-aware optimizations across the memory hierarchy. Leveraging this interface, the thesis introduces three architectures: First, InterStellar and its multi-channel extension InterStellar 2.0 implement stream-aware DRAM controllers that perform intelligent page management and proactive DRAM-aware batching, substantially improving effective bandwidth and reducing row conflicts. Second, InterStellarRT adapts the same principles to real-time systems by forming analyzable real-time batches and applying a predictable scheduling policy, enabling tight worst-case memory-latency bounds for stream-based memory patterns. Third, COMPASS co-designs a stream-aware last-level cache prefetcher with a stream-aware memory controller, coordinating prefetch issuance with DRAM batching to reduce effective miss latency while sustaining high throughput. Evaluated across a broad set of scientific and high-performance computing workloads, these three architectures deliver substantial performance and energy improvements over state-of-the-art baselines. InterStellarRT, in addition, provides significantly tighter and formally analyzable worst-case latency bounds compared to contemporary real-time memory controllers. Collectively, the contributions demonstrate that stream-based memory intelligence is an effective approach to mitigating the memory-system vibottleneck in modern multicore platforms that integrate cache prefetching mechanisms and multi-channel DRAM subsystems The implementations of InterStellar 2.0, InterStellarRT, and COMPASS are available in the project repository: https://gitlab.com/fanosteam/fanosgem5. Each architecture is provided in a separate branch: 1) InterStellar 2.0 : https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellar-2.0 2) InterStellarRT https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellarRT 3) COMPASS https://gitlab.com/fanosteam/fanosgem5/-/tree/COMPASS","abstract_has_math":false,"creators":["Abotaleb, Abdelrhman Mohamed Ibrahim Sayed"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026","date_published":"2026","updated_at":"2026-11-18T19:32:58Z","subjects":[],"languages":["en"],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://doi.org/10.71548/12940"],"render_values":[{"text":"https://doi.org/10.71548/12940","href":"https://doi.org/10.71548/12940","code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/11375/32807","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/11375/32807","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://macsphere.mcmaster.ca/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Amacsphere.mcmaster.ca%3A11375%2F32807","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Abotaleb, Abdelrhman Mohamed Ibrahim Sayed"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-01-28T21:10:45Z"]},{"key":"dc:date.issued","label":"Date","values":["2026"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/11375/32807","https://doi.org/10.71548/12940"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Emerging cyber-physical platforms such as autonomous vehicles and unmanned aerial systems increasingly integrate high-throughput workloads (e.g., perception and machine learning) with safety-critical real-time control on the same multicore, multi-channel Dynamic Random Access Memory (DRAM)-based system. While processor cores continue to scale, the memory system remains a major bottleneck: conventional hardware prefetchers and memory controllers are largely oblivious to program structure, leading to poor bandwidth utilization, high energy, and highly variable memory access latency that undermines real-time guarantees. This dissertation proposes a unified Hardware/Software (HW/SW) interface that leverages software-provided information, known prior to execution, to describe future memory access behavior to the hardware. A stream defines the underlying large, array-like data structure over which this access behavior, whether regular or irregular, occurs. Using compact stream descriptors, the software communicates future access sequences to a centralized hardware engine, which tags last-level cache misses and coordinates stream-aware optimizations across the memory hierarchy. Leveraging this interface, the thesis introduces three architectures: First, InterStellar and its multi-channel extension InterStellar 2.0 implement stream-aware DRAM controllers that perform intelligent page management and proactive DRAM-aware batching, substantially improving effective bandwidth and reducing row conflicts. Second, InterStellarRT adapts the same principles to real-time systems by forming analyzable real-time batches and applying a predictable scheduling policy, enabling tight worst-case memory-latency bounds for stream-based memory patterns. Third, COMPASS co-designs a stream-aware last-level cache prefetcher with a stream-aware memory controller, coordinating prefetch issuance with DRAM batching to reduce effective miss latency while sustaining high throughput. Evaluated across a broad set of scientific and high-performance computing workloads, these three architectures deliver substantial performance and energy improvements over state-of-the-art baselines. InterStellarRT, in addition, provides significantly tighter and formally analyzable worst-case latency bounds compared to contemporary real-time memory controllers. Collectively, the contributions demonstrate that stream-based memory intelligence is an effective approach to mitigating the memory-system vibottleneck in modern multicore platforms that integrate cache prefetching mechanisms and multi-channel DRAM subsystems The implementations of InterStellar 2.0, InterStellarRT, and COMPASS are available in the project repository: https://gitlab.com/fanosteam/fanosgem5. Each architecture is provided in a separate branch: 1) InterStellar 2.0 : https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellar-2.0 2) InterStellarRT https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellarRT 3) COMPASS https://gitlab.com/fanosteam/fanosgem5/-/tree/COMPASS"]},{"key":"dc:title","label":"Title","values":["Stream-Based Intelligent Memory Architectures for High-Performance and Predictable Real-Time Systems"]},{"key":"others:access_status","label":"Others Access Status","values":["open.access"]}]}],"canonical_facts":{"dc:creator":["Abotaleb, Abdelrhman Mohamed Ibrahim Sayed"],"dc:date.accessioned":["2026-01-28T21:10:45Z"],"dc:date.issued":["2026"],"dc:description.abstract":["Emerging cyber-physical platforms such as autonomous vehicles and unmanned aerial systems increasingly integrate high-throughput workloads (e.g., perception and machine learning) with safety-critical real-time control on the same multicore, multi-channel Dynamic Random Access Memory (DRAM)-based system. While processor cores continue to scale, the memory system remains a major bottleneck: conventional hardware prefetchers and memory controllers are largely oblivious to program structure, leading to poor bandwidth utilization, high energy, and highly variable memory access latency that undermines real-time guarantees. This dissertation proposes a unified Hardware/Software (HW/SW) interface that leverages software-provided information, known prior to execution, to describe future memory access behavior to the hardware. A stream defines the underlying large, array-like data structure over which this access behavior, whether regular or irregular, occurs. Using compact stream descriptors, the software communicates future access sequences to a centralized hardware engine, which tags last-level cache misses and coordinates stream-aware optimizations across the memory hierarchy. Leveraging this interface, the thesis introduces three architectures: First, InterStellar and its multi-channel extension InterStellar 2.0 implement stream-aware DRAM controllers that perform intelligent page management and proactive DRAM-aware batching, substantially improving effective bandwidth and reducing row conflicts. Second, InterStellarRT adapts the same principles to real-time systems by forming analyzable real-time batches and applying a predictable scheduling policy, enabling tight worst-case memory-latency bounds for stream-based memory patterns. Third, COMPASS co-designs a stream-aware last-level cache prefetcher with a stream-aware memory controller, coordinating prefetch issuance with DRAM batching to reduce effective miss latency while sustaining high throughput. Evaluated across a broad set of scientific and high-performance computing workloads, these three architectures deliver substantial performance and energy improvements over state-of-the-art baselines. InterStellarRT, in addition, provides significantly tighter and formally analyzable worst-case latency bounds compared to contemporary real-time memory controllers. Collectively, the contributions demonstrate that stream-based memory intelligence is an effective approach to mitigating the memory-system vibottleneck in modern multicore platforms that integrate cache prefetching mechanisms and multi-channel DRAM subsystems The implementations of InterStellar 2.0, InterStellarRT, and COMPASS are available in the project repository: https://gitlab.com/fanosteam/fanosgem5. Each architecture is provided in a separate branch: 1) InterStellar 2.0 : https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellar-2.0 2) InterStellarRT https://gitlab.com/fanosteam/fanosgem5/-/tree/InterStellarRT 3) COMPASS https://gitlab.com/fanosteam/fanosgem5/-/tree/COMPASS"],"dc:identifier.uri":["https://hdl.handle.net/11375/32807","https://doi.org/10.71548/12940"],"dc:language.iso":["en"],"dc:title":["Stream-Based Intelligent Memory Architectures for High-Performance and Predictable Real-Time Systems"],"dc:type":["Thesis"],"others:access_status":["open.access"]},"updated_at":"2026-11-18T19:32:58Z"}