Back to search

Georgia Institute of Technology

Hierarchical and Hardware-Aware Optimization for Enhancing AI Model Efficiency: From Bits to Modules to Models

Abstract

dc:description.abstract

Despite the remarkable advancements of AI foundation models, such as large language models (LLMs), in numerous tasks and applications, deploying these powerful models on everyday devices remains challenging due to their growing computational and memory demands. This challenge hinders the realization of immersive and interactive user experiences that require real-time AI processing on resource-constrained devices. This PhD thesis aims to bridge this gap by performing hierarchical and hardware-aware optimization of AI models, maximizing accuracy-efficiency trade-offs to enable ubiquitous edge intelligence. Specifically, this thesis addresses redundancy at the bit, module, and model levels and leverages hardware characteristics to achieve real-device speed-ups. The proposed techniques include cyclic precision training (CPT) for efficient and accurate bit-level quantization, DepthShrinker and AmoebaLLM for delivering real-hardware-efficient LLMs through module-level optimization, and a new language model architecture, Hymba, for efficient language processing, as well as Omni-Recon for efficient 3D understanding at the model level. These techniques collectively enable real-time execution of complex AI models on everyday devices, advancing the development of efficient AI solutions for ubiquitous edge intelligence.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Fu, Yonggan
Advisor dc:contributor.advisor
  • Lin, Yingyan (Celine)
Committee members dc:contributor.committeemember
  • Chau, Duen Horng
  • Dai, Bo
  • Zhang, Chao
  • Krishna, Tushar
  • Zhang, Yang

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/77951

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Fu, Yonggan. Hierarchical and Hardware-Aware Optimization for Enhancing AI Model Efficiency: From Bits to Modules to Models. Doctoral thesis, Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/77951