Georgia Institute of Technology
Object-Centric Scene Understanding via Lidar-Based 3D Object Detection
Abstract
dc:description.abstract3D scene understanding is a fundamental challenge in designing autonomous systems that navigate in the real world. With applications in autonomous driving to warehouse robotics, effective 3D understanding has the ability to revolutionize a number of industries. Understanding complex scenes requires having large amounts of diverse data with models that can efficiently determine where objects of interest are located in the 3D environments. This dissertation argues that (1) current on-road autonomy datasets lack capturing a diverse set of objects and behaviors, and (2) lidar-based 3D object detection models, particularly in the range view, are the starting point for building a robust understanding of complex 3D scenes. In this dissertation, I introduce three original contributions which focus on developing diverse datasets and lidar-based 3D object detection models for autonomy. I first present Argoverse 2: three large-scale datasets that capture complex behaviors in multiple sensor modalities. Second, I introduce a set of straightforward techniques for 3D object detection in native lidar representation, the range view, which makes this class of methods competitive with bird's-eye view and voxel-based models. Lastly, I extend range view 3D object detection to hybrid architectures which combine multiview representations, multimodal projections, and temporal reasoning.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Computer Science
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Wilson, Benjamin
- Advisor dc:contributor.advisor
-
- Hays, James
- Committee members dc:contributor.committeemember
-
- Batra, Dhruv
- Shi, Humphrey
- Hoffman, Judy
- Ramanan, Deva
Subjects
dc:subject × 2Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/76937