Back to search

University of Waterloo

Dynamic Control of Multiclass Multi-Episode Service Systems with Waiting Time Dependent Transitions

Abstract

dc:description.abstract

Motivated by rehabilitation services, this thesis studies a service system with multiple heterogeneous customer classes and servers in which customers may require multiple episodes of service to achieve a desired outcome. After each episode, the service outcome is observed, and customers who do not achieve the desired outcome transition to another class for additional service. Empirical evidence indicates that prolonged waiting can worsen service outcomes and increase future congestion. The model therefore allows service outcomes and class transitions to depend jointly on the service rate employed and the waiting time experienced. The system manager makes joint dynamic scheduling, service-rate, and customer-rejection decisions to minimize a long-run average expected cost comprising waiting, service, abandonment, rejection, and outcome-related transition costs, subject to firm throughput-time deadlines. Because the resulting stochastic control problem is analytically intractable, the thesis develops a Brownian approximation in a heavy-traffic regime. Under complete resource pooling, the Brownian control problem is reduced to a one-dimensional workload formulation. Its optimal solution is characterized as a two-sided barrier policy with a state-dependent drift rate and workload configuration. The workload solution is translated into a tractable control policy for the original service system. A comprehensive simulation study shows that the proposed policy substantially outperforms static and myopic benchmarks. The results demonstrate that explicitly accounting for waiting-time-dependent outcomes is essential: policies that ignore these effects can perform poorly because they optimize immediate costs without accounting for the effect of current waiting on future congestion. The analysis yields several structural insights. Scheduling and service-rate control affect congestion through distinct mechanisms and perform best when used jointly. Scheduling priorities balance immediate costs against downstream congestion effects, shifting toward classes whose waiting times most strongly amplify future congestion as the system becomes more congested. Service-rate control exhibits a regime-switching structure: under low congestion it emphasizes service outcomes, whereas under high congestion it emphasizes congestion mitigation. Finally, although abandonment is costly, it can partially offset the adverse congestion effects of waiting-time-dependent transitions and therefore acts as a partial substitute for dynamic service-rate control.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • MARSHALPIRGHEYBI, AMIRMOHAMMAD

Subjects

dc:subject × 8

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/10012/24057

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

MARSHALPIRGHEYBI, AMIRMOHAMMAD. Dynamic Control of Multiclass Multi-Episode Service Systems with Waiting Time Dependent Transitions. University of Waterloo, 2026. https://hdl.handle.net/10012/24057