Back to search

University of South Florida

Risk-Aware Deep Reinforcement Learning in Portfolio Optimization

Abstract

dc:description

Portfolio optimization is important in investment, with the purpose of maximizing profit whilemanaging risk. The traditional portfolio optimization method, Modern Portfolio Theory, is based on the assumption that returns are normally distributed, which is always violated in practical financial market settings. In addition, traditional approaches to portfolio optimization are mostly designed as static optimizations and fail to account for the nonlinearity and non-stationarity of contemporary financial markets. Recent developments in deep reinforcement learning have attracted considerable attention for treating portfolio optimization as a sequential decision-making process. Traditional portfolio optimization methods usually evaluate risk based on the variance of the returns. Deep reinforcement learning methods can integrate the entropic risk measure, which accounts for uncertainty, into the action selection mechanism. We developed a risk-aware deep reinforcement learning method by integrating an entropic risk measure into the actor and critic networks of Deep Deterministic Policy Gradient to enhance the robustness of portfolio optimization under uncertainty. Furthermore, we extend the proposed approach by adding episodic memory to the deep reinforcement learning paradigm. Episodic memory stores past information and utilizes high-reward experiences during learning. However, online exploration in deep reinforcement learning can be risky due to the possibility of suffering financial losses caused by poor exploratory actions. Although offline reinforcement learning methods rely on historical data and avoid interaction with the environment, they suffer from distributional shift and exhibit poor online adaptation to environmental changes. We developed offline-online deep reinforcement learning methods that obtain a pre-trained policy from an offline dataset and adapt it to a new policy when an online dataset becomes available.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Mathematics and Statistics
Grantor
University of South Florida
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhang, Shimin
Contributors dc:contributor
  • Kandethody M. Ramachandran, Ph.D.
  • Lu Lu, Ph.D.
  • Christos P. Tsokos, Ph.D.
  • Tapas K. Das, Ph.D.

Subjects

dc:subject × 7

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/11455

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhang, Shimin. Risk-Aware Deep Reinforcement Learning in Portfolio Optimization. Dissertation thesis, University of South Florida, 2026. https://digitalcommons.usf.edu/etd/11455