The Markov Decision Problem (MDP) is a widely applied mathematical model useful for describing a wide array of real world decision problems ranging from navigation to scheduling to robotics. Existing methods for solving MDPs scale poorly when applied to large domains where there are many components and factors to consider. In this dissertation, I study the use of non-tabular representations and human input as scaling techniques. I will show that the joint approach has desirable optimality and convergence guarantees, and demonstrates several orders of magnitude speedup over conventional tabular methods. Empirical studies of speedup were performed using several domains including a clone of the classic video game, Super Mario Bros. In the course of this work, I will address several issues including: how approximate representations can be used without losing convergence and optimality properties, how human input can be solicited to maximize speedup and user engagement, and how that input should be used so as to insulate against possible errors.

Univ., Diss.--Freiburg (Breisgau), 2006.

Thesis (Ph. D.)--University of Missouri-Columbia, 1999. / Typescript. Vita. Includes bibliographical references (leaves 97-98). Also available on the Internet.

Thesis (Ph. D.)--University of Missouri-Columbia, 1999. / Typescript. Vita. Includes bibliographical references (leaves 122-127). Also available on the Internet.

Thesis (Ph. D.)--University of Missouri-Columbia, 1999. / Typescript. Vita. Includes bibliographical references (leaves 122-127). Also available on the Internet.

Thesis (Ph. D.)--University of Missouri-Columbia, 1999. / Typescript. Vita. Includes bibliographical references (leaves 97-98). Also available on the Internet.

Thesis (Ph. D.)--University of Oregon, 2003. / Typescript. Includes vita and abstract. Includes bibliographical references (leaves 139-142). Also available for download via the World Wide Web; free to University of Oregon users.

Thesis (Ph. D.)--University of Washington, 2001. / Vita. Includes bibliographical references (p. 100-105).

Thesis (M.S.)--Mississippi State University. Department of Computer Science. / Title from title screen. Includes bibliographical references.

Thesis (Ph.D)--Industrial and Systems Engineering, Georgia Institute of Technology, 2010. / Committee Co-Chair: John H. Vande Vate; Committee Co-Chair: Shi-Jie Deng; Committee Member: Anton J. Kleywegt; Committee Member: Hayriye Ayhan; Committee Member: Mark E. Ferguson. Part of the SMARTech Electronic Thesis and Dissertation Collection.