Georgia Institute of Technology
Hierarchical and Hardware-Aware Optimization for Enhancing AI Model Efficiency: From Bits to Modules to Models
Abstract
dc:description.abstractDespite the remarkable advancements of AI foundation models, such as large language models (LLMs), in numerous tasks and applications, deploying these powerful models on everyday devices remains challenging due to their growing computational and memory demands. This challenge hinders the realization of immersive and interactive user experiences that require real-time AI processing on resource-constrained devices. This PhD thesis aims to bridge this gap by performing hierarchical and hardware-aware optimization of AI models, maximizing accuracy-efficiency trade-offs to enable ubiquitous edge intelligence. Specifically, this thesis addresses redundancy at the bit, module, and model levels and leverages hardware characteristics to achieve real-device speed-ups. The proposed techniques include cyclic precision training (CPT) for efficient and accurate bit-level quantization, DepthShrinker and AmoebaLLM for delivering real-hardware-efficient LLMs through module-level optimization, and a new language model architecture, Hymba, for efficient language processing, as well as Omni-Recon for efficient 3D understanding at the model level. These techniques collectively enable real-time execution of complex AI models on everyday devices, advancing the development of efficient AI solutions for ubiquitous edge intelligence.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Computer Science
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2025
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Fu, Yonggan
- Advisor dc:contributor.advisor
-
- Lin, Yingyan (Celine)
- Committee members dc:contributor.committeemember
-
- Chau, Duen Horng
- Dai, Bo
- Zhang, Chao
- Krishna, Tushar
- Zhang, Yang
Subjects
dc:subject × 3Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/77951