Back to search

University of Waterloo

The determination of structured Hessian matrices via automatic differentiation

Abstract

dc:description.abstract

In using automatic differentiation (AD) for Hessian computation, efficiency can be achieved by exploiting the sparsity existing in the derivative matrix. However, in the case where the Hessian is dense, this cannot be done and the space requirements to compute the Hessian can become very large. But if the underlying function can be expressed in a structured form, a “deeper” sparsity can be exploited to minimize the space requirement. In this thesis, we provide a summary of automatic differentiation (AD) techniques, as applied to Jacobian and Hessian matrix determination, as well as the graph coloring techniques involved in exploiting their sparsity. We then discuss how structure in the underlying function can be used to greatly improve efficiency in gradient/Jacobian computation. We then propose structured methods for Hessian computation that substantially reduce the space required. Finally, we propose a method for Hessian computation where the structure of the function is not provided.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2014

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Embaye, Samuel

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/10012/8850

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Embaye, Samuel. The determination of structured Hessian matrices via automatic differentiation. University of Waterloo, 2014. http://hdl.handle.net/10012/8850