Back to search

University of South Florida

Efficient Methods and Algorithms for Analyzing Stochastic Systems

Abstract

dc:description

This dissertation addresses the challenges of stochastic analysis of safety-critical systems with biological components, where unexpected behavior can lead to catastrophic events. Two fundamental challenges hinder the analysis of such systems: their typically large or infinite state spaces, and the extreme rarity of error states of interest. While Monte Carlo simulation can analyze biochemical systems without storing the state space, accurately estimating rare event probabilities becomes computationally prohibitive. Conversely, probabilistic model checking excels at analyzing extremely low probability events but becomes impractical for systems with large or infinite state spaces due to memory constraints.This work proposes two main contributions to address these distinct challenges. To handle models with infinite state spaces, a property-guided state-space truncation method is proposed that preserves states with high contribution to error probability while reducing the state space to a size amenable to model checking. To address the rare event problem, this dissertation evaluates variance reduction methods that improve Monte Carlo simulation performance in analyzing rare events, and introduces a reinforcement learning approach to automate the parameter selection process. The performance of these frameworks is validated through case studies of biochemical systems with infinite state spaces and rare events, demonstrating improvements in both computational efficiency and automation over existing analysis methods. The results show the effectiveness of the proposed approach in addressing the dual challenges of infinite state spaces and extremely rare probabilities in stochastic system analysis.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ahmadi, Mohammad
Contributors dc:contributor
  • Hao Zheng, Ph.D.
  • Srinivas Katkoori, Ph.D.
  • Mehran Mozaffari Kermani, Ph.D.
  • Qing Lu, Ph.D.
  • Chris Myers, Ph.D.

Subjects

dc:subject × 7

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/10838

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Ahmadi, Mohammad. Efficient Methods and Algorithms for Analyzing Stochastic Systems. Dissertation thesis, University of South Florida, 2025. https://digitalcommons.usf.edu/etd/10838