Back to search

Georgia Institute of Technology

Manifold Learning of Neural Representations for Efficient Machine Learning Systems

Abstract

dc:description.abstract

Deep learning systems have exhibited tremendous capabilities in decision-making tasks by learning neural representations. To achieve performance, these representations are often expected to implicitly learn invariances from large-scale training datasets, but often fail to generalize task-relevant and task-irrelevant features of data. As an alternative to implicitly learning this structure, the manifold hypothesis suggests that such representations should parameterize task-relevant features of each category with a few degrees of freedom, while separating representations of different categories. Motivated by this hypothesis, we propose techniques to incorporate a generative manifold model into neural representations by learning a dictionary of Lie group operators in the latent space of a deep neural network. We first discuss training techniques to learn this dictionary in an unsupervised manner, allowing for sampling, interpolation, and extrapolation along the manifold. We then discuss approaches in variational sparse coding, which dramatically increase the computational efficiency of the model in train and test time. Finally, we propose a contrastive learning algorithm which incorporates manifold feature augmentations to increase label efficiency. To make this possible, we learn local manifold statistics, allowing for sampled augmentations which preserve identity for a given input data point.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Electrical and Computer Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Fallah, Kion
Advisor dc:contributor.advisor
  • Rozell, Christopher J.
Committee members dc:contributor.committeemember
  • Davenport, Mark
  • Kira, Zsolt
  • Aghazadeh, Amirali
  • Charles, Adam

Subjects

dc:subject × 8

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/73093

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Fallah, Kion. Manifold Learning of Neural Representations for Efficient Machine Learning Systems. Doctoral thesis, Georgia Institute of Technology, 2023. https://hdl.handle.net/1853/73093