Back to search

Virginia Commonwealth University

Invariance and Invertibility in Deep Neural Networks

Abstract

dc:description.abstract

Machine learning is concerned with computer systems that learn from data instead of being explicitly programmed to solve a particular task. One of the main approaches behind recent advances in machine learning involves neural networks with a large number of layers, often referred to as deep learning. In this dissertation, we study how to equip deep neural networks with two useful properties: invariance and invertibility. The first part of our work is focused on constructing neural networks that are invariant to certain transformations in the input, that is, some outputs of the network stay the same even if the input is altered. Furthermore, we want the network to learn the appropriate invariance from training data, instead of being explicitly constructed to achieve invariance to a pre-defined transformation type. The second part of our work is centered on two recently proposed types of deep networks: neural ordinary differential equations and invertible residual networks. These networks are invertible, that is, we can reconstruct the input from the output. However, there are some classes of functions that these networks cannot approximate. We show how to modify these two architectures to provably equip them with the capacity to approximate any smooth invertible function.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Computer Science

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Zhang, Han
  • <p>https://orcid.org/0000-0002-7923-7005</p>
Contributors dc:contributor
  • Tomasz Arodz
  • Mikhail Dozmorov
  • Vojislav Kecman
  • Dayanjan S Wijesinghe
  • Tarynn M Witten

Subjects

dc:subject × 4

Rights

dc:rights
Statement dc:rights
  • © The Author

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Virginia Commonwealth University
Base URL
scholarscompass.vcu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhang, Han; <p>https://orcid.org/0000-0002-7923-7005</p>. Invariance and Invertibility in Deep Neural Networks. Dissertation thesis, https://doi.org/10.25772/5CSY-T114