Georgia Institute of Technology
Of Priors and Particles: Structured and Distributed Approaches to Robot Perception and Control
Abstract
dc:description.abstractApplications of robotic systems have expanded significantly in their scope, moving beyond the caged predictability of industrial automation and towards more open, unstructured environments. These agents must learn to reliably perceive their surroundings, efficiently integrate new information and quickly adapt to dynamic perturbations. To accomplish this, we require solutions which can effectively incorporate prior knowledge while maintaining the generality of learned representations. These systems must also contend with uncertainty in both their perception of the world and in predicting possible future outcomes. Efficient methods for probabilistic inference are then key to realizing robust, adaptive behavior. This thesis will first examine data-driven approaches for learning and combining perceptual models for both visual and tactile sensor modalities, common in robotics. Modern variational inference methods will then be examined in the context of online optimization and stochastic optimal control. Specifically, this thesis will contribute (1) data-driven visual and tactile perceptual models leveraging kinematic and dynamic priors, (2) a framework for joint inference with visuo-tactile sensing, (3) a family of particle-based, variational model predictive control and planning algorithms, and (4) a distributed inference scheme for online model adaptation.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Electrical and Computer Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2021
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Lambert, Alexander
- Advisor dc:contributor.advisor
-
- Boots, Byron
- Committee members dc:contributor.committeemember
-
- Hutchinson, Seth
- Chernova, Sonia
- Gombolay, Matthew
- Ramos, Fabio
Subjects
dc:subject × 19- Robotics
- Machine learning
- Optimization
- Bayesian inference
- Variational inference
- Planning
- Optimal control
- State estimation
- Online adaptation
- Tactile sensing
- Visual prediction
- Manipulation
- Particle methods
- Stein method
- Filtering
- Inductive biases
- Domain knowledge
- Model predictive control
- Stochastic optimal control
Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- http://hdl.handle.net/1853/65082