Back to search

University of British Columbia

On some deterministic properties of stochastic gradient descent and random projection sequences

Abstract

dc:description

This thesis investigates deterministic properties of random algorithms, focusing on boundedness and a property related to the convergence rate of sequences generated by stochastic gradient and random projection methods in both finite and infinite-dimensional Hilbert spaces. We begin by revisiting classical stochastic gradient descent methods and show that the sequence of iterates remains bounded under the mild assumption of coercivity, generalizing previous results that required strong convexity of the component functions. We then extend boundedness results for random projection algorithms, originally established by Meshulam for affine subspaces in ℝⁿ, to polyhedral sets in infinite-dimensional Hilbert spaces. We also note that certain assumptions are necessary to guarantee boundedness for affine subspaces in infinite-dimensional spaces. To address this problem, we introduce the so-called innate regularity assumption and prove that it ensures boundedness of the iterates. Finally, we generalize the Güntürk-Thao theorem, which characterizes summability properties of successive differences for sequences projected onto a finite collection of innately regular closed subspaces, to the case of polyhedral cones. We provide examples illustrating the sharpness of these results, demonstrating the importance of the innate regularity and the polyhedral cone assumption.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Mathematics
Grantor dc:publisher
University of British Columbia
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Tran, Thanh Tung
Contributors dc:contributor
  • Bauschke, Heinz H.

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/94681

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Tran, Thanh Tung. On some deterministic properties of stochastic gradient descent and random projection sequences. master's thesis, University of British Columbia, 2026. http://hdl.handle.net/2429/94681