Back to search

University of Waterloo

Fair and Efficient Resource Scheduling in Heterogeneous Multi-Agent Systems

Abstract

dc:description.abstract

The performance of machine-learning applications heavily relies on the choice of the underlying hardware architecture, encompassing factors such as computational power, scalability, memory, and storage capabilities. These hardware choices significantly impact the efficiency and effectiveness of machine-learning systems. Resource-intensive programs can lead to competition for system resources, causing delays, while inefficient resource usage can saturate resources and harm user experience. To address resource variation among applications, resource sharing is implemented, allowing applications to dynamically allocate resources as needed, promoting efficient resource utilization. However, resource-allocation strategies often prioritize performance, potentially overlooking fairness among users or applications, especially in shared environments. Balancing performance optimization and fair resource-allocation is a complex challenge, requiring mechanisms that encourage resource sharing, prevent envy, and ensure a fair distribution of resources. Incorporating these characteristics promotes collaboration, minimizes negative emotions, and prioritizes the well-being of all participants in the system. This research introduces an innovative resource-allocation mechanism that addresses shortcomings in traditional methods. Our method prioritizes both fairness and efficiency in resource distribution, utilizing a token-based mechanism to ensure fairness and implementing individual preferences based on learned thresholds through an Actor-Critic method to improve efficiency. A computer simulation involving 40 accelerators and 20 agents in different environments demonstrates a performance improvement 1.28× compared to standard approaches. This study contributes by shedding light on the complex challenges of resource- allocation in heterogeneous systems and providing a practical solution with our approach.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Omidi, Mohammadhadi
Advisors dc:contributor.advisor
  • Kapre, Nachiket
  • Zahedi, Seyed Majid

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/10012/20362

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Omidi, Mohammadhadi. Fair and Efficient Resource Scheduling in Heterogeneous Multi-Agent Systems. University of Waterloo, 2024. http://hdl.handle.net/10012/20362