Back to search

Georgia Institute of Technology

Statistical Learning Theory of Deep Neural Networks: A Generalization Viewpoint

Abstract

dc:description.abstract

This thesis investigates the mathematical foundations of deep learning, focusing on the statistical guarantees of deep neural networks in regression, classification, and anomaly detection. Specifically, it seeks to understand when and how neural networks effectively generalize to unseen data in these tasks. By uncovering the statistical and computational mechanisms that drive the success of deep learning, this thesis aims to further improve the robustness and accuracy of systems that rely on these technologies. Chapter 1 of the thesis studies the phenomenon of benign overfitting among convolutional neural networks (CNN), an important class of neural networks designed to efficiently learn spatial hierarchies of features. It demonstrates that the generalization rate of a CNN architecture remains unchanged, even with a substantial increase in model and parameter sizes. Chapter 2 of the thesis studies the classification of unbounded data generated from Gaussian Mixture Models using fully-connected neural network. For the first time, we obtain non-asymptotic upper bounds and convergence rates of the excess risk without restrictions on model parameters. Chapter 3 develops a mathematical framework and theory-grounded tools for unsupervised anomaly detection, with a focus on its practice in cybersecurity. It establishes the first optimality result for anomaly detection, and quantifies the amount of synthetic anomalies needed to achieve high accuracy. Finally, chapter 4 explores the use of deep learning in functional data analysis, focusing on the approximation of nonlinear functionals mapping from a reproducing kernel Hilbert space to \RR.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Industrial and Systems Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhou, Tian-Yi
Advisor dc:contributor.advisor
  • Huo, Xiaoming
Committee members dc:contributor.committeemember
  • Koltchinskii, Vladimir
  • Liao, Wenjing
  • Cheng, Guang
  • Kang, Sung Ha

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/77871

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zhou, Tian-Yi. Statistical Learning Theory of Deep Neural Networks: A Generalization Viewpoint. Doctoral thesis, Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/77871