Back to search

University of Washington

Sparse deep neural networks for modeling physical and biological systems

Abstract

dc:description.abstract

Characterizing the relationship between network performance and its parameters is an active area of investigation within the fields of deep learning and complex network science. In this thesis, sparse deep neural networks (DNNs) are explored as tools for modeling physical and biological systems and the functional complexity of trained, sparse DNNs is characterized using tools from complex network theory, namely network motif theory. Neural network pruning is used to find a sparse computational model for controlling a biological motor task. Using a sequential, magnitude-based pruning algorithm, as many as 93\% of network parameters can be removed from a DNN without compromising performance. Through quantifying the distribution of network motifs in the remaining sparse network, we visualize the change in network complexity throughout the pruning process and across networks. We find that, despite the random initialization of network parameters before training, enforced sparsity causes DNNs to converge to similar non-random connectivity patterns as characterized by their network motif significance. Furthermore, we find that network motifs become more significant through the sparsification process. In summary, we find that through using a simple selection process to determine parameter importance, the number of parameters in a trained DNN model can be reduced dramatically and results in a non-trivial network topology.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zahn, Olivia Tessa
Advisor dc:contributor.advisor
  • Kutz, J. Nathan

Subjects

dc:subject × 8

Rights

dc:rights
Statement dc:rights
  • none
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1773/51243

Chain of custody

source
Harvested from
University of Washington
Base URL
digital.lib.washington.edu/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Zahn, Olivia Tessa. Sparse deep neural networks for modeling physical and biological systems. 2024. http://hdl.handle.net/1773/51243