Rowan University
GENERATING REAL-TIME SYNTHETIC DATASETS TO IMPROVE AERIAL OBJECT DETECTION
Abstract
dc:description.abstractThe widespread use of unmanned aerial vehicles (UAVs) across civilian and military applications has necessitated the advancement of real-time drone detection and tracking capabilities. Machine Learning (ML) addresses these requirements, however, to train a robust and generalizable model requires large and diverse video datasets. Curating these real-world datasets is often time-consuming and cost-prohibitive. Here, we present DyViR, a real-time customizable rendering application capable of automatically generating highly realistic synthetic, multi-modal video of aerial objects, digital environments, and automatic generation and labeling of bounding boxes. Synthetic data, coupled with real-world training sets, augment the ML training process, leading to increased performance and detection accuracy. DyViR is designed to enable non-technical users to generate datasets containing 47 different aerial objects, 4 flight patterns, and 8 environments. To verify the benefits of using synthetic data to augment existing real-world datasets, the YOLOv7-tiny model was employed to evaluate a fully real-world dataset and one augmented with synthetically generated data from DyViR, resulting in a 60.4% increase in mean average precision. This research demonstrates the potential of synthetic datasets, especially when it would be impossible or cost-prohibitive to obtain, opening the door to broader applications where data acquisition is challenging.
Degree
thesis:*- Name thesis:degree_name
- Master of Science (M.S.)
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Electrical and Computer Engineering
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Williams, Garrett
- Contributors dc:contributor
-
- George Lecakes, PhD
- Nidhal Bouaynaya, PhD
- Amanda Almon, MFA, CMI
Subjects
dc:subject × 3Identifiers
dc:identifier.*- Repository record dc:identifier
- https://rdw.rowan.edu/etd/3326