Return to search

Resource allocation and scheduling strategies using utility and the knapsack problem on computational grids

Computational grids are distributed systems composed of heterogeneous computing resources which are distributed geographically and administratively. These highly scalable systems are designed to meet the large computational demands of many users from scientific and business orientations. This dissertation address problems related to the allocation of the computing resources which compose a grid.

First, the design of a pan-Canadian grid is presented. The design exploits the maturing stability of grid deployment toolkits, and introduces novel services for efficiently allocating the grids resources. The challenges faced by this grid deployment motivate further exploration in optimizing grid resource allocations.

The primary contribution of this dissertation is one such technique for allocating grid resources. By applying a utility model to the grid allocation options, it is possible to quantify the relative merits of the various possible scheduling decisions. Indeed, a number of utility heuristics are derived to provide quality-of-service policies on the grid; these implement scheduling policies which favour efficiency and also allow users to intervene with urgent tasks. Using this model, the allocation problem is then formulated as a knapsack problem. Formulation in this manner allows for rapid solution times and results in nearly optimal allocations.

The combined utility/knapsack approach to grid resource allocation is first presented in the allocation of single resource type, processors. By evaluating the approach with novel utility heuristics using both random and real workloads, it is shown to result in efficient schedules which have characteristics that match the intended policies.

Additionally, two design and analysis techniques are performed to optimize the design of the utility/knapsack scheduler; these techniques play a significant role in practical adoption of the approach.

Next, the utility/knapsack approach is extended to the allocation of multiple resource types. This extension generalizes the grid allocation solution a wider variety of resources, including processors, disk storage, and network bandwidth. The general technique, when combined with new heuristics for the varied resource types, is shown to result in improved performance against reference strategies.

This dissertation concludes with a novel application of the utility/knapsack approach to fault-tolerant task scheduling. Computational grids typically feature many techniques for providing fault tolerance to the grid tasks, including retrying failed tasks or replicating running tasks. By applying the utility/knapsack approach, the relative merits of these varied techniques can be quantified, and the overall number of failures can be decreased subject to resource cost considerations.

  1. http://hdl.handle.net/1828/328
  2. A. Agarwal, M. Ahmed, A. Berman, B. Caron, A. Charbonneau, D. Deatrich, R. Desmarais, A. Dimopoulos, I. Gable, L. Groer, R. Haria, R. Impey, L. Klektau, C. Lindsay, G. Mateescu, Q. Matthews, A. Norton, W. Podaima, D. Quesnel, R. Simmonds, R. Sobie, B. S. Arnaud, C. Usher, D. Vanderster, M. Vetterli, R. Walker, and M. Yuen, "GridX1: A Canadian computational grid," Future Generation Computer Systems, vol. 23, pp. 680–687, June 2007.
  3. D.C. Vanderster, N.J. Dimopoulos, R.J. Sobie. "Intelligent Selection of Fault Tolerance Techniques on the Grid". Proceedings of the 3rd IEEE International Conference on e-Science and Grid Computing, Bangalore, India, Dec. 2007.
  4. D.C. Vanderster, N.J. Dimopoulos, R.J. Sobie. "Improved Grid Metascheduler Design using the Plackett-Burman Methodology". 21st International Symposium on High-Performance Computing and Applications (HPCS 2007). Saskatoon, Canada, May 2007.
  5. D.C. Vanderster, N.J. Dimopoulos, R.J. Sobie. "Metascheduling Multiple Resource Types using the MMKP". Proceedings of The 7th IEEE/ACM International Conference on Grid Computing, Barcelona, September 2006.
  6. D.C. Vanderster, N.J. Dimopoulos. "Sensitivity Analysis of Knapsack-based Task Scheduling on the Grid". Proceedings of The 20th ACM International Conference on Supercomputing, Cairns, Australia, June 28-July 1, 2006.
  7. D.C. Vanderster, N.J. Dimopoulos, R. Parra-Hernandez. "Evaluation of Knapsack-based Scheduling using the NPACI JOBLOG". Proceedings of The 20th International Symposium on High Performance Computing Systems and Applications (HPCS 2006), St. John's, May 14-17, 2006.
  8. R. Parra-Hernandez, D. Vanderster, and N.J. Dimopoulos, "Resource Management and Knapsack Formulations on the Grid", Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing, pp. 94–101, IEEE Computer Society, 2004.
Identiferoai:union.ndltd.org:uvic.ca/oai:dspace.library.uvic.ca:1828/328
Date25 March 2008
CreatorsVanderster, Daniel Colin
ContributorsDimopoulos, Nikitas J., Sobie, Randall J.
Source SetsUniversity of Victoria
LanguageEnglish, English
Detected LanguageEnglish
TypeThesis
RightsAvailable to the World Wide Web

Page generated in 0.0033 seconds