Back to search

Georgia Institute of Technology

Efficient processing of temporally asynchronous and spatially unstructured event-based camera data

Abstract

dc:description.abstract

This thesis addresses the challenge of efficiently processing ultra-high-speed (microsecond-level temporal resolution) event-based camera data. Due to their asynchronous, sparse, and spatially unordered nature, traditional frame-based image processing methods are ineffective for handling such data streams. To overcome these limitations, we propose Eventformer, a novel event-based representation learning framework. Eventformer employs a self-attention mechanism to effectively model spatial interactions among events and incorporates an associative memory-augmented recurrent module to dynamically store and retrieve latent states specifically at event locations. This approach substantially reduces computational costs while preserving high performance on standard event-based object recognition benchmarks. Expanding upon the Eventformer framework, we develop a more comprehensive spatiotemporal representation learning framework tailored specifically for event-based dense prediction tasks, which require precise pixel-level associations. Our method uniquely manages sparse and asynchronous event streams by projecting them into hierarchical, multi-level latent memory structures through an attention-based spatial association. Additionally, a data-adaptive memory update mechanism selectively refreshes memory structures only when significant new information is identified, significantly reducing latency and computational overhead while maintaining competitive performance. Furthermore, we demonstrate the practicality and robustness of our proposed framework in complex, real-world scenarios such as high-speed autonomous navigation and obstacle avoidance, integrating compute-adaptive perception and control. In summary, this research introduces a novel memory-augmented representation learning pipeline that significantly enhances the efficiency and effectiveness of real-time processing of event-based camera data, supporting a variety of perception and control applications with notable improvements in computational efficiency and reduced latency.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Electrical and Computer Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Kamal, Uday
Advisor dc:contributor.advisor
  • Mukhopadhyay, Saibal
Committee members dc:contributor.committeemember
  • Romberg , Justin
  • Hao, Callie
  • Datta, Suman
  • Lin, Yingyan (Celine)

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/81568

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Kamal, Uday. Efficient processing of temporally asynchronous and spatially unstructured event-based camera data. Doctoral thesis, Georgia Institute of Technology, 2025. https://hdl.handle.net/1853/81568