Back to search

Georgia Institute of Technology

Novel Tensor Factorization Algorithms and Applications

Abstract

dc:description.abstract

As our capacity to collect and generate data continues to outpace our capacity to store and analyze said data, low-rank tensor factorizations offer a solution to alleviate this issue for tensorized data. The process of computing low-rank tensor factorizations is computationally expensive and requires efficiently leveraging computational resources to enable feasibility. This thesis proposes several novel algorithms for low-rank tensor factorizations to enable interpretable analysis and compression of massive multiway datasets. To this end, we focus on three overarching themes: efficiently leveraging computational resources to compute large-scale tensor decompositions, efficiently enforcing nonnegativity constraints to improve interpretability, and incorporating additional information into the factorization to improve solution quality. We start by proposing the Fused In-place Sequentially Truncated Higher Order Singular Value Decomposition (FIST-HOSVD) algorithm as the first in-place method for computing the dense Tucker decomposition, increasing the problem size that can be factorized by up to 3x. We demonstrate the effectiveness of the proposed FIST-HOSVD algorithm by decreasing the auxiliary memory consumption by over 135x when computing the dense Tucker decomposition on two combustion simulation compression applications. We then provide an in-depth study of several state-of-the-art methods for Nonnegative Matrix Factorization (NMF). As part of this, we provide a comprehensive survey of Nonnegative Least Squares (NNLS) solvers used to enforce the nonnegativity of the factors. In doing so, we propose a Fast Active-Set Thresholding NNLS (FAST-NNLS) solver which outperforms existing NNLS methods for broad classes of problems. We then introduce a GPU-accelerated Hierarchical NMF K-Means initialization method for large-scale protein clustering on commodity-grade hardware. We then propose the Low Rank Approximations with Constraints at Exascale (LORACX) framework for computing large-scale distributed NMF. We demonstrate that LORACX yields unprecedented performance and scalability by achieving 0.67 exaflops in double-precision on 8,192 nodes of the Frontier supercomputer when computing NMF of a 2.1 petabyte matrix. We then extend the NMF objective function to incorporate additional multiway data, culminating in a Joint Nonnegative Coupled Matrix-Tensor Factorization (Joint-NCMTF) framework. We demonstrate that the proposed Joint-NCMTF method yields improved clustering quality and additional dimensions of insight relative to traditional matrix-based methods.

Degree

thesis:*
Name thesis:degree_name
Computer Science, PhD
Department thesis:degree_department
Computational Science and Engineering
Grantor
Georgia Institute of Technology
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Cobb, Benjamin Myers
Advisor dc:contributor.advisor
  • Vuduc, Richard
Committee members dc:contributor.committeemember
  • Park, Haesun
  • Chow, Edmond
  • Kannan, Ramakrishnan
  • Ballard, Grey
ORCID person:identifier.orcid

Rights

Language dc:language.iso
English

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/82199

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Cobb, Benjamin Myers. Novel Tensor Factorization Algorithms and Applications. Georgia Institute of Technology, 2026. https://hdl.handle.net/1853/82199