Georgia Institute of Technology
Learning with Less: Low-rank Dynamics, Communication, and Introspection in Machine Learning
Abstract
dc:description.abstractThe enclosed research is a focused empirical and theoretical analysis of the optimization methods in machine learning, and the underlying role that the matrix rank of utilized learning statistics plays in these algorithms. We show that this new perspective on machine learning optimization provides benefits in terms of communication-efficient federated learning algorithms, as well as novel insights in terms of model introspection and theory of learning dynamics. In applications to the complex domain of Neuroimaging data analysis, we show that this rank-focused frame of reference allows for unique insights into how models perform on particular populations.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Computational Science and Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2023
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Baker, Bradley Thomas
- Advisors dc:contributor.advisor
-
- Calhoun, Vince D.
- Plis, Sergey
- Committee members dc:contributor.committeemember
-
- Smith, Robyn
- Zhang, Xiuwei
- Zhang, Chao
Subjects
dc:subject × 6Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/73108