Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 142 for “"Partially Observable Markov Decision Process"”.
-
PREDICTIVE MAINTENANCE USING GPU-ACCELERATED PARTIALLY OBSERVABLE MARKOV DECISION PROCESS
… framework that can aid the industries to make decisions about maintenance scheduling. This thesis proposes a method to aid industries to make maintenance scheduling decisions that can be adopted in a distributed factory environment. Partially Observable Markov Decision Processes (POMDPs) are …
-
OPTIMIZATION OF MOVING TARGET DEFENSE USING A PARTIALLY OBSERVABLE MARKOV DECISION PROCESS AND DETERMINIZED SPARSE PARTIALLY OBSERVABLE TREE
… formulates an attack/defense scenario as a partially observable Markov decision process (POMDP) to facilitate optimal MTD of a host. We develop a system in which service and IP reconfigurations can be employed as defense against a five-stage attack to maximize system availability and …
-
Incorporating expert judgement into condition based maintenance decision support using a coupled hidden markov model and a partially observable markov decision process
… the cost of preventive maintenance by supporting decisions on performing maintenance actions, based on information reflecting a system's health condition. In practice, the condition related information can be obtained in various ways, including continuous condition monitoring performed by sensors, …
-
Manufacturing Technology Adoption in Dynamic Product Environments
… of the technology investment problem: Stochastic Processes in the form of a Partially Observable Markov Decision Process, Non-Linear Mathematical Programming, and Computer Simulation integrated with a Multi-attribute Model based on measurement theory.
-
Applying partially observable Markov decision processes to anesthesia control: A simulated study.
… have a better controller, this research applies Partially Observable Markov Decision Process (POMDP) framework to achieve better drug delivery policy, even when there is incomplete information about a patients' current states during a general anesthesia. In this dissertation, a robust POMDP …
-
Using POMDP-based Reinforcement Learning for Online Optimization of Teaching Strategies in an Intelligent Tutoring System
… optimal teaching strategy. We cast an ITS as a partially observable Markov decision process (POMDP), and apply a reinforcement learning (RL) algorithm to learn the optimal teaching strategy through interactions between the system and the students. The optimal teaching strategy is chosen …
-
Autonomous UAV control and testing methods utilizing partially observable Markov decision processes
… is proposed for implementation on any UAV. A Partially Observable Markov Decision Process algorithm for tracking moving targets is developed for fixed field of view sensors while providing an approach for more fuel efficient operations. Finally, an approach for testing autonomous algorithms …
-
An integrated performance model learning and planning approach for optimal infrastructure facility maintenance under partial observability
Infrastructure inspection and maintenance decision making is a stochastic and partially observable problem. This thesis presents a learning and decision-making approach for developing optimal joint inspection and maintenance policies for civil infrastructure facilities under performance model …
-
AUTONOMOUS DRIVING IN MIXED TRAFFIC: MODELS AND ALGORITHM
… real-world datasets. We then embed GAMMA into a partially observable Markov decision process (POMDP) to plan optimal vehicle control under uncertainty. We proposed IS-DESPOT for solving the POMDP. Our autonomous driving system enables safe, smooth, and efficient driving both on a real scooter and …
-
TRUST AND INTENTION IN HUMAN-ROBOT INTERACTION: A POMDP FRAMEWORK
… (i) human behavior modeling, and (ii) robot decision making. When modeling human behaviors, we draw insights from previous works in psychology and social science, and identify trust and intention as the key mental states that help to understand human behaviors. Motivated by earlier works, we …
-
Spanning sensor resource management
… All of the included applications are posed as decision control problems formulated in the rigorous framework of a partially observable Markov decision process (POMDP) and solution methods based on Bellman's equation are exercised, generating adaptive control policies for action selections in …
-
Probability-Based Context-Aware Robotic System
… robotic tracking and following. The Monte Carlo partially observable Markov decision process is enhanced in terms of belief state augmentation, value function computation based on direct sampling, and non-greedy action execution, for the task of path planning. Experimental results are carried out …
-
Active Sensing for Partially Observable Markov Decision Processes
… a model for active sensor selection within decision-making processes, in which observational features are selected based on longer-term impact on the decisions made by the smart phone. This thesis formulates the problem as a partially observable Markov decision process (POMDP), and proposes …
-
Structural Estimation of Partially Observable Markov Decision Processes and Partially Observable Stochastic Games: Theory and Applications
Partially observable Markov decision process (POMDP, for single agent) and partially observable stochastic game (POSG, for multiple agents) are two well-known classes of models that study the optimal decision making of a rational agent under uncertainty, where the state of the world is hidden and …
-
Efficient Solving Methods for POMDP-based Threat Defense Environments on Bayesian Attack Graphs
… to formulate a threat defense environment as a Partially Observable Markov Decision Process (POMDP) that allows for fast approximate defense algorithms against multiple attackers. It is done through an action extension, coined the Inspect action, which allows the agent to reveal the true state …
-
Tactical Decision-Making for Highway Driving
… search (MCTS) algorithms for optimizing tactical decision-making during highway driving. The optimization problem was expressed in a partially observable Markov decision process (POMDP) framework, where the behaviors of the surrounding vehicles were modeled as nonobservable variables. The motion …
-
MULTI-ROBOT RELIABLE NAVIGATION IN UNCERTAIN TOPOLOGICAL ENVIRONMENTS WITH GRAPH ATTENTION NETWORKS
… the challenge, we reformulate the problem into a Partially Observable Markov Decision Process framework and introduce the Dynamic Adaptive Graph Embedding method to capture the evolving nature of the navigation task. We further enhance each robot's policy learning process by integrating deep …
-
Probabilistic roadmaps in uncertain environments
… of some edges are unknown. This is modelled as a decision-theoretic planning problem described through a partially observable Markov Decision Process (POMDP). It is shown that the optimal policy can depend on accounting for the value of information from observations. The model scalability and the …
-
Reactive, Autonomous, Markovian Sensor Tasking in Communication Starved Environments
… for evaluating these techniques. A suboptimal partially observable Markov decision process (POMDP) was used as the simulation framework to test various reward functions and decision algorithms while enabling autonomous, reactive sensor tasking. The goal of this work was used the developed …
-
Financial Compliance Risk Management Using Knowledge-Based Systems and Analytics
… study and improve manual client review process and automated client risk rating. Both methodologies are developed to address real-world cases using real-world data with practical applications in financial institutions. In the first study, we develop a novel knowledge-based decision …
Page 1 of 8