University of South Florida
Risk-Aware Deep Reinforcement Learning in Portfolio Optimization
Abstract
dc:descriptionPortfolio optimization is important in investment, with the purpose of maximizing profit whilemanaging risk. The traditional portfolio optimization method, Modern Portfolio Theory, is based on the assumption that returns are normally distributed, which is always violated in practical financial market settings. In addition, traditional approaches to portfolio optimization are mostly designed as static optimizations and fail to account for the nonlinearity and non-stationarity of contemporary financial markets. Recent developments in deep reinforcement learning have attracted considerable attention for treating portfolio optimization as a sequential decision-making process. Traditional portfolio optimization methods usually evaluate risk based on the variance of the returns. Deep reinforcement learning methods can integrate the entropic risk measure, which accounts for uncertainty, into the action selection mechanism. We developed a risk-aware deep reinforcement learning method by integrating an entropic risk measure into the actor and critic networks of Deep Deterministic Policy Gradient to enhance the robustness of portfolio optimization under uncertainty. Furthermore, we extend the proposed approach by adding episodic memory to the deep reinforcement learning paradigm. Episodic memory stores past information and utilizes high-reward experiences during learning. However, online exploration in deep reinforcement learning can be risky due to the possibility of suffering financial losses caused by poor exploratory actions. Although offline reinforcement learning methods rely on historical data and avoid interaction with the environment, they suffer from distributional shift and exhibit poor online adaptation to environmental changes. We developed offline-online deep reinforcement learning methods that obtain a pre-trained policy from an offline dataset and adapt it to a new policy when an online dataset becomes available.
Degree
thesis:*- Name thesis:degree_name
- Doctor of Philosophy (Ph.D.)
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Mathematics and Statistics
- Grantor
- University of South Florida
- Year dc:date
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Zhang, Shimin
- Contributors dc:contributor
-
- Kandethody M. Ramachandran, Ph.D.
- Lu Lu, Ph.D.
- Christos P. Tsokos, Ph.D.
- Tapas K. Das, Ph.D.
Subjects
dc:subject × 7Identifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.usf.edu/etd/11455