Back to search

University of Waterloo

Numerical Methods for Hamilton-Jacobi-Bellman Equations with Applications

Abstract

dc:description.abstract

Hamilton-Jacobi-Bellman (HJB) equations are nonlinear controlled partial differential equations (PDEs). In this thesis, we propose various numerical methods for HJB equations arising from three specific applications. First, we study numerical methods for the HJB equation coupled with a Kolmogorov-Fokker-Planck (KFP) equation arising from mean field games. In order to solve the nonlinear discretized systems efficiently, we propose a multigrid method. The main novelty of our approach is that we subtract artificial viscosity from the direct discretization coarse grid operators, such that the coarse grid error estimations are more accurate. The convergence rate of the proposed multigrid method is mesh-independent and faster than the existing methods in the literature. Next, we investigate numerical methods for the HJB formulation that arises from the mass transport image registration model. We convert the PDE of the model (a Monge-Ampère equation) to an equivalent HJB equation, propose a monotone mixed discretization, and prove that it is guaranteed to converge to the viscosity solution. Then we propose multigrid methods for the mixed discretization, where we set wide stencil points as coarse grid points, use injection at wide stencil points as the restriction, and achieve a mesh-independent convergence rate. Moreover, we propose a novel periodic boundary condition for the image registration PDE, such that when two images are related by a combination of a translation and a non-rigid deformation, the numerical scheme recovers the underlying transformation correctly. Finally, we propose a deep neural network framework for the HJB equations emerging from the study of American options in high dimensions. We convert the HJB equation to an equivalent Backward Stochastic Differential Equation (BSDE), introduce the least squares residual of the BSDE as the loss function, and propose a new neural network architecture that utilizes the domain knowledge of American options. Our proposed framework yields American option prices and deltas on the entire spacetime, not only at a given point. The computational cost of the proposed approach is quadratic in dimension, which addresses the curse of dimensionality issue that state-of-the-art approaches suffer.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Chen, Yangang
Advisor dc:contributor.advisor
  • Wan, Justin

Subjects

dc:subject × 7

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/10012/14947

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Chen, Yangang. Numerical Methods for Hamilton-Jacobi-Bellman Equations with Applications. University of Waterloo, 2019. http://hdl.handle.net/10012/14947