{"id":{"repo_id":"cornell","oai_identifier":"oai:ecommons.cornell.edu:1813/116454"},"canonical_url":"https://search.ndltd.org/etd/cornell/oai:ecommons.cornell.edu:1813/116454","repository":{"repo_id":"cornell","name":"Cornell University","base_url":"https://ecommons.cornell.edu/server/oai/request"},"display":{"title":"Optimally Navigating a Piecewise-deterministic World","abstract":"We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager's objective on the predicted optimal behavior. We close by studying a class of \"occasionally observed\" PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes.","abstract_html":"We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager&#x27;s objective on the predicted optimal behavior. We close by studying a class of &quot;occasionally observed&quot; PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes.","abstract_has_math":false,"creators":["Gee, Marissa"],"institution":"Cornell University","degree_name":"Ph. D., Applied Mathematics","degree_level":"Doctor of Philosophy","degree_discipline":"Applied Mathematics","degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":["Vladimirsky, Alexander"],"committee_members":["Damle, Anil","Strogatz, Steven","Ellner, Stephen"],"year":2024,"date_issued":"2024-08","date_published":"2024-08","updated_at":"2026-11-19T03:11:32Z","subjects":["Numerical Analysis","Optimal Control","Path Planning","Switched Systems"],"languages":["en"],"rights":["Attribution-NonCommercial-ShareAlike 4.0 International"],"rights_urls":["https://creativecommons.org/licenses/by-nc-sa/4.0/"],"identifier_entries":[{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.7298/68sq-ch97"],"render_values":[{"text":"https://doi.org/10.7298/68sq-ch97","href":"https://doi.org/10.7298/68sq-ch97","code":true}]},{"key":"dc:identifier.bibid","label":"Dc Identifier Bibid","values":["16611674"],"render_values":[{"text":"16611674","href":null,"code":true}]},{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["ProQuest Submission ID: 14450","ProQuest Publication ID: 31482980"],"render_values":[{"text":"ProQuest Submission ID: 14450","href":null,"code":true},{"text":"ProQuest Publication ID: 31482980","href":null,"code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1813/116454","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/1813/116454","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://ecommons.cornell.edu/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aecommons.cornell.edu%3A1813%2F116454","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.chair","label":"Chair","values":["Vladimirsky, Alexander"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Damle, Anil","Strogatz, Steven","Ellner, Stephen"]},{"key":"dc:creator","label":"Author","values":["Gee, Marissa"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-01-14T19:59:22Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-01-14T19:59:22Z"]},{"key":"dc:date.issued","label":"Date","values":["2024-08"]},{"key":"dc:relation.uri","label":"Dc Relation URI","values":["https://newcatalog.library.cornell.edu/catalog/16611674"]},{"key":"dc:type","label":"Dc Type","values":["dissertation or thesis"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Applied Mathematics"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Doctor of Philosophy"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph. D., Applied Mathematics"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Cornell University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Numerical Analysis","Optimal Control","Path Planning","Switched Systems"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution-NonCommercial-ShareAlike 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["https://creativecommons.org/licenses/by-nc-sa/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.bibid","label":"Dc Identifier Bibid","values":["16611674"]},{"key":"dc:identifier.doi","label":"DOI","values":["https://doi.org/10.7298/68sq-ch97"]},{"key":"dc:identifier.other","label":"Dc Identifier Other","values":["ProQuest Submission ID: 14450","ProQuest Publication ID: 31482980"]},{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1813/116454"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"cerif:openaire","label":"Cerif Openaire","values":["<Publication xmlns=\"https://www.openaire.eu/cerif-profile/1.1/\" id=\"0f2779cb-2353-43ab-a313-8fe3f4d6a166\"> <Type xmlns=\"https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types\">http://purl.org/coar/resource_type/c_1843</Type> <Language>en</Language> <Title>Optimally Navigating a Piecewise-deterministic World</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2024-08</PublicationDate> <DOI>https://doi.org/10.7298/68sq-ch97</DOI> <Authors> <Author> <DisplayName>Gee, Marissa</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <License>https://creativecommons.org/licenses/by-nc-sa/4.0/</License> <Keyword>Numerical Analysis</Keyword> <Keyword>Optimal Control</Keyword> <Keyword>Path Planning</Keyword> <Keyword>Switched Systems</Keyword> <Abstract>We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager's objective on the predicted optimal behavior. We close by studying a class of \"occasionally observed\" PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes.</Abstract> <Access xmlns=\"http://purl.org/coar/access_right\" > </Access> </Publication>"]},{"key":"cris:virtual.author","label":"Cris Virtual Author","values":["Gee, Marissa"]},{"key":"cris:virtualsource.collection","label":"Cris Virtualsource Collection","values":["5893a6ea-7af3-41d7-abc6-04bcd26ab5df"]},{"key":"dc:description","label":"Description","values":["155 pages"]},{"key":"dc:description.abstract","label":"Abstract","values":["We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager's objective on the predicted optimal behavior. We close by studying a class of \"occasionally observed\" PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes."]},{"key":"dc:description.collection","label":"Dc Description Collection","values":["Cornell Theses and Dissertations"]},{"key":"dc:format.mimetype","label":"Dc Format Mimetype","values":["application/pdf"]},{"key":"dcterms:license","label":"Dcterms License","values":["https://hdl.handle.net/1813/59810.2"]},{"key":"dc:title","label":"Title","values":["Optimally Navigating a Piecewise-deterministic World"]},{"key":"dspace:entity.type","label":"Dspace Entity Type","values":["Publication"]},{"key":"others:access_status","label":"Others Access Status","values":["open.access"]}]}],"canonical_facts":{"cerif:openaire":["<Publication xmlns=\"https://www.openaire.eu/cerif-profile/1.1/\" id=\"0f2779cb-2353-43ab-a313-8fe3f4d6a166\"> <Type xmlns=\"https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types\">http://purl.org/coar/resource_type/c_1843</Type> <Language>en</Language> <Title>Optimally Navigating a Piecewise-deterministic World</Title> <PublishedIn> <Publication> </Publication> </PublishedIn> <PublicationDate>2024-08</PublicationDate> <DOI>https://doi.org/10.7298/68sq-ch97</DOI> <Authors> <Author> <DisplayName>Gee, Marissa</DisplayName> <Affiliation> <OrgUnit> </OrgUnit> </Affiliation> </Author> </Authors> <Editors> </Editors> <Publishers> <Publisher> <OrgUnit /> </Publisher> </Publishers> <License>https://creativecommons.org/licenses/by-nc-sa/4.0/</License> <Keyword>Numerical Analysis</Keyword> <Keyword>Optimal Control</Keyword> <Keyword>Path Planning</Keyword> <Keyword>Switched Systems</Keyword> <Abstract>We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager's objective on the predicted optimal behavior. We close by studying a class of \"occasionally observed\" PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes.</Abstract> <Access xmlns=\"http://purl.org/coar/access_right\" > </Access> </Publication>"],"cris:virtual.author":["Gee, Marissa"],"cris:virtualsource.collection":["5893a6ea-7af3-41d7-abc6-04bcd26ab5df"],"dc:contributor.chair":["Vladimirsky, Alexander"],"dc:contributor.committeemember":["Damle, Anil","Strogatz, Steven","Ellner, Stephen"],"dc:creator":["Gee, Marissa"],"dc:date.accessioned":["2025-01-14T19:59:22Z"],"dc:date.available":["2025-01-14T19:59:22Z"],"dc:date.issued":["2024-08"],"dc:description":["155 pages"],"dc:description.abstract":["We consider various problems arising in optimal control of piecewise-deterministic Markov processes (PDMPs), with an emphasis on path planning problems where a randomly switching mode impacts the dynamics and optimization objective. We introduce two application-driven modeling frameworks, each formulated as a piecewise-deterministic path planning problem. The first framework models a vehicle that may experience breakdowns of varying severity at random times as it navigates a domain. We present an efficient iterative solver to recover the mode-dependent value functions and optimal policies for this problem. The second proposes a model of optimal foraging in a continuous domain while subject to predation. We present numerical experiments to demonstrate the impact of a forager's objective on the predicted optimal behavior. We close by studying a class of \"occasionally observed\" PDMPs, in which the planner is not notified when a mode switch occurs, but may occasionally have access to observations of the current mode. We state sufficient assumptions under which it is possible to represent the resulting belief over the modes as an explicit function of time. We present efficient dynamic programming algorithms for computing value functions and optimal policies for a variety of horizon types and observation schemes."],"dc:description.collection":["Cornell Theses and Dissertations"],"dc:format.mimetype":["application/pdf"],"dc:identifier.bibid":["16611674"],"dc:identifier.doi":["https://doi.org/10.7298/68sq-ch97"],"dc:identifier.other":["ProQuest Submission ID: 14450","ProQuest Publication ID: 31482980"],"dc:identifier.uri":["https://hdl.handle.net/1813/116454"],"dc:language.iso":["en"],"dc:relation.uri":["https://newcatalog.library.cornell.edu/catalog/16611674"],"dc:rights":["Attribution-NonCommercial-ShareAlike 4.0 International"],"dc:rights.uri":["https://creativecommons.org/licenses/by-nc-sa/4.0/"],"dc:subject":["Numerical Analysis","Optimal Control","Path Planning","Switched Systems"],"dcterms:license":["https://hdl.handle.net/1813/59810.2"],"dc:title":["Optimally Navigating a Piecewise-deterministic World"],"dc:type":["dissertation or thesis"],"dspace:entity.type":["Publication"],"others:access_status":["open.access"],"thesis:degree_discipline":["Applied Mathematics"],"thesis:degree_level":["Doctor of Philosophy"],"thesis:degree_name":["Ph. D., Applied Mathematics"],"thesis:institution_name":["Cornell University"]},"updated_at":"2026-11-19T03:11:32Z"}