Many modern web applications run on distributed cloud systems, which allows them to
scale their resources to match performance requirements. Scaling of resources at industry
scales, however, is a financially-expensive operation, and therefore one that should
involve a business justification rooted in customer quality-of-service metrics over more
commonly-used utilization metrics. Additionally, changing the resources available to such a system is non-instantaneous, and thus a reasonable effort should be made to predict system performance at varying resource allocations and at various expected workloads.
Common performance monitoring solutions look at general metrics such as CPU utilization or available memory. These metrics are at best an indirect means of evaluating
customer experience, and at worst may provide no information as to whether users of a
commercial application are satisfied with the product they have paid for. Instead, the use
of application-specific metrics that accurately reflect the experience of system users,
combined with research into how these metrics are affected by various tunable parameters, allows a company to make accurate decisions as to the desired performance
perceived by their users versus the costs associated with providing that level of performance.
This thesis uses a real-world software-as-a-service product as a case study in the
development of quality-of-service metrics and the use of those metrics to determine
business cases and costing packages for customers. The product used for this work is
Phoenix, a state-of-the-art social media aggregation and analytics software-as-a-service
web platform developed by Echosec Systems, Ltd. The product will be tested under realworld conditions on cloud hardware with a minimal test harness to ensure a realistic
depiction of live production conditions. / Graduate
Identifer | oai:union.ndltd.org:uvic.ca/oai:dspace.library.uvic.ca:1828/10803 |
Date | 30 April 2019 |
Creators | Turner, Nicholas James Nickerson |
Contributors | Neville, Stephen William, Darcie, Thomas Edward |
Source Sets | University of Victoria |
Language | English, English |
Detected Language | English |
Type | Thesis |
Format | application/pdf |
Rights | Available to the World Wide Web |
Page generated in 0.0021 seconds