<p>Brownian motion has met growing interest in mathematics, physics and particularly in finance since it was introduced in the beginning of the twentieth century. Stochastic processes generalizing Brownian motion have influenced many research fields theoretically and practically. Moreover, along with more refined techniques in measure theory and functional analysis more stochastic processes were constructed and studied. Lévy processes, with Brownian motionas a special case, have been of major interest in the recent decades. In addition, Lévy processes include a number of other important processes as special cases like Poisson processes and subordinators. They are also related to stable processes.</p><p>In this thesis we generalize a result by S. Chandrasekhar [2] and Edward Nelson who gave a detailed proof of this result in his book in 1967 [12]. In Nelson’s first result standard Ornstein-Uhlenbeck processes are studied. Physically this describes free particles performing a random and irregular movement in water caused by collisions with the water molecules. In a further step he introduces a nonlinear drift in the position variable, i.e. he studies the case when these particles are exposed to an external field of force in physical terms.</p><p>In this report, we aim to generalize the result of Edward Nelson to the case of α-stable Lévy processes. In other words we replace the driving noise of a standard Ornstein-Uhlenbeck process by an α-stable Lévy noise and introduce a scaling parameter uniformly in front of all vector fields in the cotangent space, even in front of the noise. This corresponds to time being sent to infinity. With Chandrasekhar’s and Nelson’s choice of the diffusion constant the stationary state of the velocity process (which is approached as time tends to infinity) is the Boltzmann distribution of statistical mechanics.The scaling limits we obtain in the absence and presence of a nonlinear drift term by using the scaling property of the characteristic functions and time change, can be extended to other types of processes rather than α-stable Lévy processes.</p><p>In future, we will consider to generalize this one dimensional result to Euclidean space of arbitrary finite dimension. A challenging task is to consider the geodesic flow on the cotangent bundle of a Riemannian manifold with scaled drift and scaled Lévy noise. Geometrically the Ornstein-Uhlenbeck process is defined on the tangent bundle of the real line and the driving Lévy noise is defined on the cotangent space.</p>

Brownian motion has met growing interest in mathematics, physics and particularly in finance since it was introduced in the beginning of the twentieth century. Stochastic processes generalizing Brownian motion have influenced many research fields theoretically and practically. Moreover, along with more refined techniques in measure theory and functional analysis more stochastic processes were constructed and studied. Lévy processes, with Brownian motionas a special case, have been of major interest in the recent decades. In addition, Lévy processes include a number of other important processes as special cases like Poisson processes and subordinators. They are also related to stable processes. In this thesis we generalize a result by S. Chandrasekhar [2] and Edward Nelson who gave a detailed proof of this result in his book in 1967 [12]. In Nelson’s first result standard Ornstein-Uhlenbeck processes are studied. Physically this describes free particles performing a random and irregular movement in water caused by collisions with the water molecules. In a further step he introduces a nonlinear drift in the position variable, i.e. he studies the case when these particles are exposed to an external field of force in physical terms. In this report, we aim to generalize the result of Edward Nelson to the case of α-stable Lévy processes. In other words we replace the driving noise of a standard Ornstein-Uhlenbeck process by an α-stable Lévy noise and introduce a scaling parameter uniformly in front of all vector fields in the cotangent space, even in front of the noise. This corresponds to time being sent to infinity. With Chandrasekhar’s and Nelson’s choice of the diffusion constant the stationary state of the velocity process (which is approached as time tends to infinity) is the Boltzmann distribution of statistical mechanics.The scaling limits we obtain in the absence and presence of a nonlinear drift term by using the scaling property of the characteristic functions and time change, can be extended to other types of processes rather than α-stable Lévy processes. In future, we will consider to generalize this one dimensional result to Euclidean space of arbitrary finite dimension. A challenging task is to consider the geodesic flow on the cotangent bundle of a Riemannian manifold with scaled drift and scaled Lévy noise. Geometrically the Ornstein-Uhlenbeck process is defined on the tangent bundle of the real line and the driving Lévy noise is defined on the cotangent space.

Quantifying uncertainties in large-scale forward and inverse PDE simulations has emerged as a central challenge facing the field of computational science and engineering. The promise of modeling and simulation for prediction, design, and control cannot be fully realized unless uncertainties in models are rigorously quantified, since this uncertainty can potentially overwhelm the computed result. While statistical inverse problems can be solved today for smaller models with a handful of uncertain parameters, this task is computationally intractable using contemporary algorithms for complex systems characterized by large-scale simulations and high-dimensional parameter spaces. In this dissertation, I address issues regarding the theoretical formulation, numerical approximation, and algorithms for solution of infinite-dimensional Bayesian statistical inverse problems, and apply the entire framework to a problem in global seismic wave propagation. Classical (deterministic) approaches to solving inverse problems attempt to recover the “best-fit” parameters that match given observation data, as measured in a particular metric. In the statistical inverse problem, we go one step further to return not only a point estimate of the best medium properties, but also a complete statistical description of the uncertain parameters. The result is a posterior probability distribution that describes our state of knowledge after learning from the available data, and provides a complete description of parameter uncertainty. In this dissertation, a computational framework for such problems is described that wraps around the existing forward solvers, as long as they are appropriately equipped, for a given physical problem. Then a collection of tools, insights and numerical methods may be applied to solve the problem, and interrogate the resulting posterior distribution, which describes our final state of knowledge. We demonstrate the framework with numerical examples, including inference of a heterogeneous compressional wavespeed field for a problem in global seismic wave propagation with 10⁶ parameters.

Optimization problems involving uncertainties are common in a variety of engineering disciplines such as transportation systems, manufacturing, communication networks, healthcare and finance. The large number of input variables and the lack of a system model prohibit a precise analytical solution and a viable alternative is to employ simulation-based optimization. The idea here is to simulate a few times the stochastic system under consideration while updating the system parameters until a good enough solution is obtained. Formally, given only noise-corrupted measurements of an objective function, we wish to end a parameter which minimises the objective function. Iterative algorithms using statistical methods search the feasible region to improve upon the candidate parameter. Stochastic approximation algorithms are best suited; most studied and applied algorithms for funding solutions when the feasible region is a continuously valued set. One can use information on the gradient/Hessian of the objective to aid the search process. However, due to lack of knowledge of the noise distribution, one needs to estimate the gradient/Hessian from noisy samples of the cost function obtained from simulation. Simple gradient search schemes take much iteration to converge to a local minimum and are heavily dependent on the choice of step-sizes. Stochastic Newton methods, on the other hand, can counter the ill-conditioning of the objective function as they incorporate second-order information into the stochastic updates. Stochastic Newton methods are often more accurate than simple gradient search schemes. We propose enhancements to the Hessian estimation scheme used in two recently proposed stochastic Newton methods, based on the ideas of random directions stochastic approximation (2RDSA) [21] and simultaneous perturbation stochastic approximation (2SPSA-31) [6], respectively. The proposed scheme, inspired by [29], reduces the error in the Hessian estimate by (i) Incorporating a zero-mean feedback term; and (ii) optimizing the step-sizes used in the Hessian recursion. We prove that both 2RDSA and 2SPSA-3 with our Hessian improvement scheme converges asymptotically to the true Hessian. The key advantage with 2RDSA and 2SPSA-3 is that they require only 75% of the simulation cost per-iteration for 2SPSA with improved Hessian estimation (2SPSA-IH) [29]. Numerical experiments show that 2RDSA-IH outperforms both 2SPSA-IH and 2RDSA without the improved Hessian estimation scheme.