Yes / This paper presents a novel minimum entropy filter design for a class of stochastic nonlinear systems which are subjected to non-Gaussian noises. Motivated by stochastic distribution control, an output entropy model is developed using RBF neural network while the parameters of the model can be identified by the collected data. Based upon the presented model, the filtering problem has been investigated while the system dynamics have been represented. As the model output is the entropy of the estimation error, the optimal nonlinear filter is obtained based on the Lyapunov design which makes the model output minimum. Moreover, the entropy assignment problem has been discussed as an extension of the presented approach. To verify the presented design procedure, a numerical example is given which illustrates the effectiveness of the presented algorithm. The contributions of this paper can be included as 1) an output entropy model is presented using neural network; 2) a nonlinear filter design algorithm is developed as the main result and 3) a solution of entropy assignment problem is obtained which is an extension of the presented framework.

Yes / In this paper, a novel control algorithm is presented to enhance the performance of the tracking property for a class of nonlinear and dynamic stochastic systems subjected to non-Gaussian noises. Although the existing standard PI controller can be used to obtain the basic tracking of the systems, the desired tracking performance of the stochastic systems is difficult to achieve due to the random noises. To improve the tracking performance, an enhanced performance loop is constructed using the EKF-based state estimates without changing the existing closed loop with a PI controller. Meanwhile, the gain of the enhanced performance loop can be obtained based upon the entropy optimization of the tracking error. In addition, the stability of the closed loop system is analyzed in the mean-square sense. The simulation results are given to illustrate the effectiveness of the proposed control algorithm. / This work was supported in part by the PNNL Control of Complex Systems Initiative and in part by the National Natural Science Foundation of China under Grants 61621004,61573022 and 61333007.

Yes / In this paper, a performance enhancement scheme has been investigated for a class of stochastic nonlinear systems via set-point adjustment. Considering the practical industrial processes, the multi-layer systematic structure has been adopted to achieve the control design requirements subjected to random noise. The basic loop control is given by PID design while the parameters have been fixed after the design phase. Alternatively, we can consider that there exists an unadjustable loop control. Then, the additional loop is designed for performance enhancement in terms of the tracking accuracy. In particular, a novel approach has been presented to dynamically adjust the set-points using the estimated states of the systems through extended Kalman filter (EKF). Minimising the entropy criterion, the parameters of the set-point adjustment controller can be optimised which will enhance the performance of the entire closed-loop systems. Based upon the presented scheme, the stochastic stability analysis has been given to demonstrate that the closed-loop tracking errors are bounded in probability one. To indicate the effectiveness of the presented control scheme, the numerical examples have been given and the simulation results imply that the designed systems are bounded and the tracking performance can be enhanced simultaneously. In summary, a new framework for system performance enhancement has been presented even if the loop control is unadjustable which forms the main contribution of this paper.

The estimation problem of stochastic nonlinear parametric models is recognized to be very challenging due to the intractability of the likelihood function. Recently, several methods have been developed to approximate the maximum likelihood estimator and the optimal mean-square error predictor using Monte Carlo methods. Albeit asymptotically optimal, these methods come with several computational challenges and fundamental limitations. The contributions of this thesis can be divided into two main parts. In the first part, approximate solutions to the maximum likelihood problem are explored. Both analytical and numerical approaches, based on the expectation-maximization algorithm and the quasi-Newton algorithm, are considered. While analytic approximations are difficult to analyze, asymptotic guarantees can be established for methods based on Monte Carlo approximations. Yet, Monte Carlo methods come with their own computational difficulties; sampling in high-dimensional spaces requires an efficient proposal distribution to reduce the number of required samples to a reasonable value. In the second part, relatively simple prediction error method estimators are proposed. They are based on non-stationary one-step ahead predictors which are linear in the observed outputs, but are nonlinear in the (assumed known) input. These predictors rely only on the first two moments of the model and the computation of the likelihood function is not required. Consequently, the resulting estimators are defined via analytically tractable objective functions in several relevant cases. It is shown that, under mild assumptions, the estimators are consistent and asymptotically normal. In cases where the first two moments are analytically intractable due to the complexity of the model, it is possible to resort to vanilla Monte Carlo approximations. Several numerical examples demonstrate a good performance of the suggested estimators in several cases that are usually considered challenging. / <p>QC 20171128</p>