Back to search

Georgia Institute of Technology

Leveraging neuro-inspired mechanisms for adaptive and efficient deep learning

Abstract

dc:description.abstract

Deep Neural Networks (DNNs) have transformed artificial intelligence, yet their success remains heavily dependent on large, static datasets, rigid architectures, and computationally intensive training processes. In contrast, biological brains excel in dynamic, resource-constrained environments. This thesis explores how principles from neuroscience can be abstracted and adapted to improve the adaptability and efficiency of modern deep learning systems. We propose three neuro-inspired methods that address key challenges in real-world machine learning: continual learning and data efficiency. First, we introduce NISPA, a method inspired by the brain's sparse dynamic connectivity and synaptic stability. Designed for task-incremental continual learning, NISPA preserves previously acquired knowledge by dynamically rewiring a sparse network and selectively freezing crucial connections. This approach significantly outperforms existing methods while requiring up to ten times fewer parameters. Second, we present NICE, a method inspired by adult neurogenesis and contextual memory encoding in the hippocampus. NICE eliminates the need for data replay in class-incremental learning by grouping neurons according to their integration time into the network’s function and using context detection to route inputs appropriately. Without storing or replaying past data, NICE matches—and often exceeds—the performance of popular replay-based methods while avoiding their computational overhead. Finally, we address efficient learning from streaming data with PEAKS, a method inspired by the brain’s top-down attention mechanisms. PEAKS incrementally selects informative training samples based on prediction errors and kernel similarity, effectively filtering out noisy or redundant data. Our experiments show that PEAKS achieves competitive accuracy using as little as one-fourth the data compared to random selection. Collectively, these approaches demonstrate how neuro-inspired mechanisms—such as synaptic rewiring, contextual memory encoding, and attentional filtering—can substantially enhance the adaptability and efficiency of deep learning systems. They represent a step toward AI systems that are not only accurate but also resource-efficient, context-aware, and capable of lifelong learning.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gurbuz, Mustafa Burak
Advisor dc:contributor.advisor
  • Dovrolis, Constantine
Committee members dc:contributor.committeemember
  • Kira, Zsolt
  • Mussmann, Stephen
  • Varma, Sashank
  • Mocanu, Decebal C.

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/78646

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Gurbuz, Mustafa Burak. Leveraging neuro-inspired mechanisms for adaptive and efficient deep learning. Doctoral thesis, Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/78646