Back to search

University of Washington

Automating Stochastic Optimal Control

Abstract

dc:description.abstract

Stochastic Optimal Control is an elegant and general framework for specifying and solving control problems. However, a number of issues have impeded its adoption in practical situations. In this thesis, we describe algorithmic and theoretical developments that address some of these issues. In the first part of the thesis, we address the problem of designing cost functions for control tasks. For many tasks, the appropriate cost functions are difficult to specify and high-level cost functions may not be amenable to numerical optimization. We adopt a data-driven approach to solving this problem and develop a convex optimization based algorithm for learning costs given demonstrations of desirable behavior. The next problem we tackle is modelling risk-aversion. We develop a general theory of linearly solvable optimal control capable of modelling all these preferences in a computationally tractable manner. We then study the problem of optimizing parameterized control policies. The study presents the first convex formulation of control policy optimization for arbitrary dynamical systems. Using algorithms for stochastic convex optimization, this approach leads to algorithms that are guaranteed to find the optimal policy efficiently. We describe applications of these ideas to multiple problems arising in energy systems. Finally, we outline some future possibilities for combining policy optimization and cost-learning into an integrated data-driven cost shaping framework.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Dvijotham, Krishnamurthy
Advisor dc:contributor.advisor
  • Todorov, Emanuil V

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Copyright is held by the individual authors.
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1773/25359

Chain of custody

source
Harvested from
University of Washington
Base URL
digital.lib.washington.edu/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Dvijotham, Krishnamurthy. Automating Stochastic Optimal Control. 2014. http://hdl.handle.net/1773/25359