Back to search

Georgia Institute of Technology

Learning and Optimization on Geodesic Metric Spaces

Abstract

dc:description.abstract

There has been growing interest in designing optimization algorithms with convergence guarantees when the parameter space is not a Euclidean set but a Riemannian manifold. This has attracted considerable attention because it allows for the encoding of constraints, and in many cases, it addresses the non-convexity of both the feasible set and the objective function. But thus far, this has primarily focused on vanilla convex optimization and first-order methods, and there has been far less research in the online setting as well as in minimax problems, which is the focus of the present work. In the first part, we explore minimizing dynamic regret on Riemannian manifolds. We introduce optimistic mirror descent on manifolds in the online improper learning setting and apply the technique to establish adaptive dynamic regret bounds. In the second part, we consider projection-free (online) optimization on Riemannian manifolds. We illustrate how to design algorithms that rely solely on a linear optimization oracle or a separation oracle to achieve sub-linear regret on manifolds. Lastly, we consider the last-iterate convergence of Riemannian extragradient-type methods, which can be provably employed to tackle Riemannian minimax problems. The result in Euclidean space, achieved by extragradient, is $O\left(\frac{1}{\sqrt{T}}\right)$. We propose Riemannian extragradient and Riemannian past extragradient, showing both of them exhibit an analogous behavior.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Hu, Zihao
Advisor dc:contributor.advisor
  • Abernethy, Jacob
Committee members dc:contributor.committeemember
  • Vempala, Santosh
  • Tao, Molei
  • Muthukumar, Vidya
  • Wibisono, Andre

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/76821

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Hu, Zihao. Learning and Optimization on Geodesic Metric Spaces. Doctoral thesis, Georgia Institute of Technology, 2023. https://hdl.handle.net/1853/76821