Back to search

Georgia Institute of Technology

Robust Deep Vision-based Planning and Control Algorithms with Probabilistic Learning

Abstract

dc:description.abstract

Decision making for safety-critical systems is challenging due to performance requirements with significant consequences in the event of failure. Data-driven planning and control methods, e.g. using deep neural networks, are generally not used for safety-critical systems as they can behave in unexpected ways in response to novel or corrupted inputs. This thesis studies how to safely deploy deep learning-based path planning and control algorithms to safety-critical systems (e.g. autonomous cars and drones). This thesis investigates the robot learning from demonstration paradigm, mainly imitation learning and inverse reinforcement learning. A novel system identification approach is also proposed to learn the dynamics of the optical flow for vision-based high-speed navigation. By combining computer vision, probabilistic deep learning, and model predictive control, we can 1) detect uncertain situations and stop the system before it fails, 2) quantify the uncertainty of the deep neural network model's prediction to plan a safer path for the system, and 3) optimize a trajectory to achieve more visual information and more robust state estimation. The proposed algorithms are tested in challenging environments including offroad racing tracks and a simulated dense traffic highway for autonomous driving and a photorealistic sensor simulated environment for drone racing.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Electrical and Computer Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Lee, Keuntaek
Advisors dc:contributor.advisor
  • Theodorou, Evangelos A.
  • Vela, Patricio A.
Committee members dc:contributor.committeemember
  • Rehg, James
  • AlRegib, Ghassan
  • Coogan, Samuel
  • Vamvoudakis, Kyriakos

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/66599

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Lee, Keuntaek. Robust Deep Vision-based Planning and Control Algorithms with Probabilistic Learning. Doctoral thesis, Georgia Institute of Technology, 2022. http://hdl.handle.net/1853/66599