Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 95 for “"Bellman equation"”.

  1. Hamilton-Jacobi-Bellman equation for stochastic optimal control: Applications to spacecraft attitude control

    … through formulation of the Hamilton-Jacobi-Bellman equation associated with a stochastic differential equation. The solution to the Hamilton-Jacobi-Bellman partial differential equation is approximated through the method of Al’brekht [1]. Extension of Albrekht method for a stochastic system …

    uiuc Repository record for Hamilton-Jacobi-Bellman equation for stochastic optimal control: Applications to spacecraft attitude control (opens in a new tab)

  2. Value function approximation methods for Linearly-solvable Markov Decision Process

    … methods are directly or indirectly based on the Bellman equation, which originates from dynamical programming. Finding the solution of Bellman equation, the value function, or cost-to-go function, suffers from multiple difficulties, including the curse of dimensionality. In the linearly-solvable …

    washington Repository record for Value function approximation methods for Linearly-solvable Markov Decision Process (opens in a new tab)

  3. Deterministic and Stochastic Bellman's Optimality Principles on Isolated Time Domains and Their Applications in Finance

    … late 1949, mostly during the 1950s, by Richard Bellman to describe decision making problems. By 1952, he refined this to the modern meaning, referring specifically to nesting smaller decision problems inside larger decisions. Also, the Bellman equation, one of the basic concepts in dynamic …

    wku-diss Repository record for Deterministic and Stochastic Bellman's Optimality Principles on Isolated Time Domains and Their Applications in Finance (opens in a new tab)

  4. Analysis of New Methods for Inference in Markov Decision Processes

    … the mean of posterior optimal values of the Bellman optimality equation within large state space Markov decision processes under a Bayesian framework, something that becomes analytically tractable with the use of the mean field theory. Existing methods for computing value function statistics …

    adelaide Repository record for Analysis of New Methods for Inference in Markov Decision Processes (opens in a new tab)

  5. Superreplication method for multi-asset barrier options.

    … standard arguments we derive the Hamilton-Jacobi-Bellman equation for the value function. We show that the value function is a unique viscosity solution of the Hamilton-Jacobi-Bellman equation. Then we define the super price and superhedging strategy for the barrier options and show equivalence …

    unsw Repository record for Superreplication method for multi-asset barrier options. (opens in a new tab)

  6. Mean Field Optimal Control and Related Problems

    … by a mean field backward stochastic differential equation. This leads to the value function to be random. Last but not the least, the backward stochastic differential equation we considered is of McKean-Vlasov form. The appearance of the distribution of its solution Y at time s leads to a new …

    ucf Repository record for Mean Field Optimal Control and Related Problems (opens in a new tab)

  7. Topics in dynamic programming

    … optimization problems to a class of functional equations, the Bellman equations, which can be solved via appropriate mathematical tools. One of the most important tools is the contraction mapping theorem, a fixed point theorem that can be used to solve the Bellman equation under the usual …

    anu Repository record for Topics in dynamic programming (opens in a new tab)

  8. Essays on estimating dynamic discrete choice models: methods and applications

    … Solving the DP model involves solving the Bellman equation. Even with a limited set of state variables solving the Bellman equation can be time consuming. Conventional structural estimation requires repeatedly solving the Bellman equation. High computational cost limits applications of …

    missouri Repository record for Essays on estimating dynamic discrete choice models: methods and applications (opens in a new tab)

  9. The optimal control of a Lévy process

    … the partial integro-differential Hamilton-Jacobi-Bellman equation for the value function admits classical solutions and that control policies exist in feedback form. We then explore the class of Lévy processes that satisfy the requirements of the theorem, and find connections between the uniform …

    texas Repository record for The optimal control of a Lévy process (opens in a new tab)

  10. Control of a nonlinear multivariable system with adaptive critic designs

    … of the cost-to-go function from the Bellman equation of dynamic programming or some function related to it, and then find the optimal solution of the problem by applying a reinforcement learning technique. In ACD we have two networks called critic and action (a substitute name for …

    ttu Repository record for Control of a nonlinear multivariable system with adaptive critic designs (opens in a new tab)

  11. Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models

    … used are the Fokker-Planck partial differential equation for evolution of probability densities, the Hamilton-Jacobi-Bellman equation of optimal control and the adjoint optimization principle from optimal control theory. The focus is on developing computational schemes for the solution of the …

    ottawa-retro Repository record for Parameter Estimation, Optimal Control and Optimal Design in Stochastic Neural Models (opens in a new tab)

  12. Convergence analysis for out-of-core temporal difference learning

    … converge to the unique solution of the empirical Bellman equation. We establish a convergence rate of O(m^-(1-γ)) in the L_∞ norm, where m is the number of passes through the dataset and γ is the discount factor. Finally, we show that this analysis extends to TD(0), n-step TD, and Q-Learning, …

    texas Repository record for Convergence analysis for out-of-core temporal difference learning (opens in a new tab)

  13. PRESCRIPTIVE ANALYTICS WITH INTERNET OF THINGS

    … a deep Q-network (DQN) and is trained using the Bellman equation which uses a greedy policy for optimality. The use of DQL has shown significant improvements over past research based on cumulative reward and downtime.

    nus Repository record for PRESCRIPTIVE ANALYTICS WITH INTERNET OF THINGS (opens in a new tab) Download file for PRESCRIPTIVE ANALYTICS WITH INTERNET OF THINGS (opens in a new tab)

  14. Model-free Reinforcement Learning Technique for Nonlinear Systems

    … optimal control policy, by using the Bellman equation and set-based least-squares estimation, which avoids the dual parameterization of the actor-critic methodology for RL. The Lie bracket approximations for ESC is used to approximate the optimal state feedback controller, which …

    queens Repository record for Model-free Reinforcement Learning Technique for Nonlinear Systems (opens in a new tab)

  15. INVESTIGATION OF MANIFOLDS AND OPTIMIZED TRAJECTORIES IN THE THREE-BODY PROBLEM

    … restricted three-body problem (CR3BP). CR3BP equations were used to generate two-dimensional stable and unstable manifolds. Optimized trajectory solutions were found using the Hamilton-Jacobi-Bellman equation applied to the third body traveling from L1 toward m2. Three sets of optimal …

    maryland Repository record for INVESTIGATION OF MANIFOLDS AND OPTIMIZED TRAJECTORIES IN THE THREE-BODY PROBLEM (opens in a new tab)

  16. Merton Problem in Insurance

    … with solving the problem by Hamilton- Jacobi-Bellman equation. Finally, we show some simulation results based on the calibration on data from insurance companies in Germany and their interpretations.

    calgary Repository record for Merton Problem in Insurance (opens in a new tab)

  17. A shadow-price approach of the problem of optimal investment/consumption with proportional transaction costs and utilities of power type

    … we reformulate and reduce the Hamilton-Jacobi-Bellman equation for this singular stochastic control problem to a non-standard free-boundary problem for a first-order ODE with an integral constraint. Having shown that the free boundary problem has a smooth solution, we use it to construct the …

    texas Repository record for A shadow-price approach of the problem of optimal investment/consumption with proportional transaction costs and utilities of power type (opens in a new tab)

  18. On the Optimality of the Greedy Policy for Battery Limited Energy Harvesting Communications

    … iteration method is applied for solving the Bellman equation to obtain the optimal power allocation policy. The optimal policy is analyzed for several examples.

    mcmaster Repository record for On the Optimality of the Greedy Policy for Battery Limited Energy Harvesting Communications (opens in a new tab)

Page 1 of 5