Back to search

University of North Texas

Fusion Based Object Detection for Autonomous Driving Systems

Abstract

dc:description

Object detection in autonomous driving systems is a critical functionality demanding precise implementation. However, existing solutions often rely on single-sensor systems, leading to insufficient data representation and diminished accuracy and speed in object detection. Our research addresses these challenges by integrating fusion-based object detection frameworks and augmentation techniques, incorporating both camera and LiDAR sensor data. Firstly, we introduce Sniffer Faster R-CNN (SFR-CNN), a novel fusion framework that enhances regional proposal generation by refining proposals from both LiDAR and image-based sources, thereby accelerating detection speed. Secondly, we propose Sniffer Faster R-CNN++, a late fusion network that integrates pre-trained single-modality detectors, improving detection accuracy while reducing computational complexity. Our approach employs enhanced proposal refinement algorithms to enhance the detection of distant objects, resulting in significant improvements in accuracy on challenging datasets like KITTI and nuScenes. Finally, to address the sparsity inherent in LiDAR data, we introduce a novel method that generates virtual LiDAR points from camera images, augmented with semantic labels to detect sparsely distributed and occluded objects effectively and integration of distance-aware data augmentation (DADA) further enhances the model's ability to recognize distant objects, leading to significant improvements in detection accuracy overall.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Dhakal, Sudip
Contributors dc:contributor
  • Yang, Qing
  • Fu, Song (Computer science and engineering researcher)
  • Morozov, Kirill
  • Zhao, Hui

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Public
  • Dhakal, Sudip
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_3751
https://digital.library.unt.edu/ark:/67531/metadc2332584/
ark: ark:/67531/metadc2332584

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Dhakal, Sudip. Fusion Based Object Detection for Autonomous Driving Systems. University of North Texas, 2024. https://doi.org/10.12794/metadc2332584