Back to search

University of Waterloo

Towards Domain Invariant Real-time Point Cloud Perception

Abstract

dc:description.abstract

In recent years, autonomous driving has witnessed substantial advancements, owing in part to the rapid advancement of 3D sensor technologies, particularly Light Detection and Ranging (LiDAR) sensors.Despite these advancements, the challenge of open-world autonomous driving remains a pressing issue that requires resolution. This encompasses the need for dependable and resilient 3D perception across a multitude of environments. Particularly, point cloud is irregular, unordered, and continuous with large data size, which presents unique challenges for its real-time processing. Another major challenge came from the perception system’s inability to adapt to different environments, known as the domain adaptation problem. This is due in part to a lack of diverse and representative datasets, and in part to existing models’ insufficient generalization ability. To tackle this challenge, this dissertation conducts a thorough investigation into the domain adaptation challenges associated with real-time point cloud perception. This dissertation addresses these challenges associated with the deployment and train- ing of point cloud perception systems in a self-contained manner.To ensure sufficient real- time capability during deployment, a novel approach called task-attentive 3D perception is proposed. It incorporates HD-map, vehicle states, and emergency breaking distance to dynamically remove task un-related point cloud for driving safety and computation effi- ciency. Furthermore, this thesis looks at the problem of driving in varied domains from both the data and the model standpoint. First, a novel method for creating the target real- world domains in the simulator using real-world prior is presented. Using this method, a noval large-scale multi-task dataset called Domains-3D is developed, which comprises both real-world and synthetic domains. Finally, using this dataset, a novel Plug-and-Play (PnP) domain adaptation algorithm for 3D point clouds that minimizes domain shifts is presented. This algorithm improves a model’s performance for both cross-scene domain adaptation and intra-domain 3D object detection.

Degree

thesis:*
Grantor dc:publisher
University of Waterloo
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Cui, Yaodong
Advisor dc:contributor.advisor
  • Khajepour, Amir

Subjects

dc:subject × 4

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/10012/19482

Chain of custody

source
Harvested from
University of Waterloo
Base URL
dspacemainprd01.lib.uwaterloo.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Cui, Yaodong. Towards Domain Invariant Real-time Point Cloud Perception. University of Waterloo, 2023. http://hdl.handle.net/10012/19482