Back to search

University of South Florida

A Reinforcement Learning Approach To Obtain Treatment Strategies In Sequential Medical Decision Problems

Abstract

dc:description

Medical decision problems are extremely complex owing to their dynamic nature, large number of variable factors, and the associated uncertainty. Decision support technology entered the medical field long after other areas such as the airline industry and the manufacturing industry. Yet, it is rapidly becoming an indispensable tool in medical decision making problems including the class of sequential decision problems. In these problems, physicians decide on a treatment plan that optimizes a benefit measure such as the treatment cost, and the quality of life of the patient. The last decade saw the emergence of many decision support applications in medicine. However, the existing models have limited applications to decision problems with very few states and actions. An urgent need is being felt by the medical research community to expand the applications to more complex dynamic problems with large state and action spaces. This thesis proposes a methodology which models the class of sequential medical decision problems as a Markov decision process, and solves the model using a simulation based reinforcement learning (RL) algorithm. Such a methodology is capable of obtaining near optimal treatment strategies for problems with large state and action spaces. This methodology overcomes, to a large extent, the computational complexity of the value-iteration and policy-iteration algorithms of dynamic programming. An average reward reinforcement-learning algorithm is developed. The algorithm is applied on a sample problem of treating hereditary spherocytosis. The application demonstrates the ability of the proposed methodology to obtain effective treatment strategies for sequential medical decision problems.

Degree

thesis:*
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Industrial Engineering
Grantor
University of South Florida
Year dc:date
2003

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Poolla, Radhika
Contributors dc:contributor
  • Tapas K. Das, Ph.D.
  • Jose L. Zayas-Castro, Ph.D.
  • Deepak K. Agrawal, Ph.D.

Subjects

dc:subject × 8

Rights

Language dc:language
EN-US

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/1450

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Poolla, Radhika. A Reinforcement Learning Approach To Obtain Treatment Strategies In Sequential Medical Decision Problems. Thesis thesis, University of South Florida, 2003. https://digitalcommons.usf.edu/etd/1450