Return to search

Combining dynamic abstractions in large MDPs

One of the reasons that it is difficult to plan and act in real-worlddomains is that they are very large. Existing research generallydeals with the large domain size using a static representation andexploiting a single type of domain structure. In this paper, wecreate a framework that encapsulates existing and new abstraction andapproximation methods into modules, and combines arbitrary modulesinto a system that allows for dynamic representation changes. We showthat the dynamic changes of representation allow our framework tosolve larger and more interesting domains than were previouslypossible, and while there are no optimality guarantees, suitablemodule choices gain tractability at little cost to optimality.

Identiferoai:union.ndltd.org:MIT/oai:dspace.mit.edu:1721.1/30496
Date21 October 2004
CreatorsSteinkraus, Kurt, Kaelbling, Leslie Pack
Source SetsM.I.T. Theses and Dissertation
Languageen_US
Detected LanguageEnglish
Format12 p., 9975204 bytes, 424481 bytes, application/postscript, application/pdf
RelationMassachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory

Page generated in 0.0029 seconds