Georgia Institute of Technology
Novel Tensor Factorization Algorithms and Applications
Abstract
dc:description.abstractAs our capacity to collect and generate data continues to outpace our capacity to store and analyze said data, low-rank tensor factorizations offer a solution to alleviate this issue for tensorized data. The process of computing low-rank tensor factorizations is computationally expensive and requires efficiently leveraging computational resources to enable feasibility. This thesis proposes several novel algorithms for low-rank tensor factorizations to enable interpretable analysis and compression of massive multiway datasets. To this end, we focus on three overarching themes: efficiently leveraging computational resources to compute large-scale tensor decompositions, efficiently enforcing nonnegativity constraints to improve interpretability, and incorporating additional information into the factorization to improve solution quality. We start by proposing the Fused In-place Sequentially Truncated Higher Order Singular Value Decomposition (FIST-HOSVD) algorithm as the first in-place method for computing the dense Tucker decomposition, increasing the problem size that can be factorized by up to 3x. We demonstrate the effectiveness of the proposed FIST-HOSVD algorithm by decreasing the auxiliary memory consumption by over 135x when computing the dense Tucker decomposition on two combustion simulation compression applications. We then provide an in-depth study of several state-of-the-art methods for Nonnegative Matrix Factorization (NMF). As part of this, we provide a comprehensive survey of Nonnegative Least Squares (NNLS) solvers used to enforce the nonnegativity of the factors. In doing so, we propose a Fast Active-Set Thresholding NNLS (FAST-NNLS) solver which outperforms existing NNLS methods for broad classes of problems. We then introduce a GPU-accelerated Hierarchical NMF K-Means initialization method for large-scale protein clustering on commodity-grade hardware. We then propose the Low Rank Approximations with Constraints at Exascale (LORACX) framework for computing large-scale distributed NMF. We demonstrate that LORACX yields unprecedented performance and scalability by achieving 0.67 exaflops in double-precision on 8,192 nodes of the Frontier supercomputer when computing NMF of a 2.1 petabyte matrix. We then extend the NMF objective function to incorporate additional multiway data, culminating in a Joint Nonnegative Coupled Matrix-Tensor Factorization (Joint-NCMTF) framework. We demonstrate that the proposed Joint-NCMTF method yields improved clustering quality and additional dimensions of insight relative to traditional matrix-based methods.
Degree
thesis:*- Name thesis:degree_name
- Computer Science, PhD
- Department thesis:degree_department
- Computational Science and Engineering
- Grantor
- Georgia Institute of Technology
- Year dc:date.issued
- 2026
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Cobb, Benjamin Myers
- Advisor dc:contributor.advisor
-
- Vuduc, Richard
- Committee members dc:contributor.committeemember
-
- Park, Haesun
- Chow, Edmond
- Kannan, Ramakrishnan
- Ballard, Grey
- ORCID person:identifier.orcid
Rights
- Language dc:language.iso
- English
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/82199