Dynamical systems are mathematical models characterized by a set of differential or difference equations. Due to the increasing demand for more accuracy, the number of equations involved may reach the order of thousands and even millions. With so many equations, it often becomes computationally cumbersome to work with these large-scale dynamical systems. Model reduction aims to replace the original system with a reduced system of significantly smaller dimension which will still describe the important dynamics of the large-scale model. Interpolation is one method used to obtain the reduced order model. This requires that the reduced order model interpolates the full order model at selected interpolation points. Reduced order models are obtained through the Krylov reduction process, which involves solving a sequence of linear systems. The Iterative Rational Krylov Algorithm (IRKA) iterates this Krylov reduction process to obtain an optimal Η₂ reduced model. Especially in the large-scale setting, these linear systems often require employing inexact solves. The aim of this thesis is to investigate the impact of inexact solves on interpolatory model reduction. We considered preconditioning the linear systems, varying the stopping tolerances, employing GMRES and BiCG as the inexact solvers, and using different initial shift selections. For just one step of Krylov reduction, we verified theoretical properties of the interpolation error. Also, we found a linear improvement in the subspace angles between the inexact and exact subspaces provided that a good shift selection was used. For a poor shift selection, these angles often remained of the same order regardless of how accurately the linear systems were solved. These patterns were reflected in Η₂ and Η∞ errors between the inexact and exact subspaces, since these errors improved linearly with a good shift selection and were typically of the same order with a poor shift. We found that the shift selection also influenced the overall model reduction error between the full model and inexact model as these error norms were often several orders larger when a poor shift selection was used. For a given shift selection, the overall model reduction error typically remained of the same order for tolerances smaller than 1 x 10^-3, which suggests that larger tolerances for the inexact solver may be used without necessarily augmenting the model reduction error. With preconditioned linear systems as well as BiCG, we found smaller errors between the inexact and exact models while the order of the overall model reduction error remained the same. With IRKA, we observed similar patterns as with just one step of Krylov reduction. However, we also found additional benefits associated with using an initial guess in the inexact solve and by varying the tolerance of the inexact solve. / Master of Science

Dynamical systems and their numerical simulation are very important for investigating physical and technical problems. The more accuracy is desired, the more equations are needed to reach the desired level of accuracy. This leads to large-scale dynamical systems. The problem is that computations become infeasible due to the limitations on time and/or memory in large-scale settings. Another important issue is numerical ill-conditioning. These are the main reasons for the need of model reduction, i.e. replacing the original system by a reduced system of much smaller dimension. Then one uses the reduced models in order to simulate or control processes. The main goal of this thesis is to investigate an interpolation-based approach to the weighted-H2 model reduction problem. Nonetheless, first we will discuss the regular (unweighted) H2 model reduction problem. We will re-visit the interpolation conditions for H2-optimality, also known as Meier-Luenberger conditions, and discuss how to obtain an optimal reduced order system via projection. After having introduced the H2-norm and the unweighted-H2 model reduction problem, we will introduce the weighted-H2 model reduction problem. We will first derive a new error expression for the weighted-H2 model reduction problem. This error expression illustrates the significance of interpolation at the mirror images of the reduced system poles and the original system poles, as in the unweighted case. However, in the weighted case this expression yields that interpolation at the mirror images of the poles of the weighting system is also significant. Finally, based on the new weighted-H2 error expression, we will propose an iteratively corrected interpolation-based algorithm for the weighted-H2 model reduction problem. Moreover we will present new optimality conditions for the weighted-H2 approximation. These conditions occur as structured orthogonality conditions similar to those for the unweighted case which were derived by Antoulas, Beattie and Gugercin. We present several numerical examples to illustrate the effectiveness of the proposed approach and compare it with the frequency-weighted balanced truncation method. We observe that, for virtually all of our numerical examples, the proposed method outperforms the frequency-weighted balanced truncation method. / Master of Science

Numerical methods based on rational Krylov spaces have become an indispensable tool of scientific computing. In this thesis we study rational Krylov spaces by considering rational Krylov decompositions; matrix relations which, under certain conditions, are associated with these spaces. We investigate the algebraic properties of such decompositions and present an implicit Q theorem for rational Krylov spaces. We derive standard and harmonic Ritz extraction strategies for approximating the eigenpairs of a matrix and for approximating the action of a matrix function onto a vector. While these topics have been considered previously, our approach does not require the last pole to be infinite, which makes the extraction procedure computationally more efficient. Typically, the computationally most expensive component of the rational Arnoldi algorithm for computing a rational Krylov basis is the solution of a large linear system of equations at each iteration. We explore the option of solving several linear systems simultaneously, thus constructing the rational Krylov basis in parallel. If this is not done carefully, the basis being orthogonalized may become poorly conditioned, leading to numerical instabilities in the orthogonalization process. We introduce the new concept of continuation pairs which gives rise to a near-optimal parallelization strategy that allows to control the growth of the condition number of this non orthogonal basis. As a consequence we obtain a more accurate and reliable parallel rational Arnoldi algorithm. The computational benefits are illustrated using our high performance C++ implementation. We develop an iterative algorithm for solving nonlinear rational least squares problems. The difficulty is in finding the poles of a rational function. For this purpose, at each iteration a rational Krylov decomposition is constructed and a modified linear problem is solved in order to relocate the poles to new ones. Our numerical results indicate that the algorithm, called RKFIT, is well suited for model order reduction of linear time invariant dynamical systems and for optimisation problems related to exponential integration. Furthermore, we derive a strategy for the degree reduction of the approximant obtained by RKFIT. The rational function obtained by RKFIT is represented with the aid of a scalar rational Krylov decomposition and an additional coefficient vector. A function represented in this form is called an RKFUN. We develop efficient methods for the evaluation, pole and root finding, and for performing basic arithmetic operations with RKFUNs. Lastly, we discuss RKToolbox, a rational Krylov toolbox for MATLAB, which implements all our algorithms and is freely available from http://rktoolbox.org. RKToolbox also features an extensive guide and a growing number of examples. In particular, most of our numerical experiments are easily reproducible by downloading the toolbox and running the corresponding example files in MATLAB.

Small signal stability has always been an important concern for analog designers. Recent advances such as the Loop Finder algorithm allows designers to detect and identify local, potentially unstable return loops without the need to identify and add breakpoints. However, this method suffers from extremely high time and memory complexity and thus cannot be scaled to very large analog circuits. In this research work, we first take an in-depth look at the loop finder algorithm so as to identify certain key enhancements that can be made to overcome these shortcomings. We next propose pole discovery and impedance computation methods that address these shortcomings by exploring only a certain region of interest in the s-plane. The reduced time and memory complexity obtained via the new methodology allows us to extend automatic stability checking to much larger circuits than was previously possible.

We provide a unifying projection-based framework for structure-preserving interpolatory model reduction of parameterized linear dynamical systems, i.e., systems having a structured dependence on parameters that we wish to retain in the reduced-order model. The parameter dependence may be linear or nonlinear and is retained in the reduced-order model. Moreover, we are able to give conditions under which the gradient and Hessian of the system response with respect to the system parameters is matched in the reduced-order model. We provide a systematic approach built on established interpolatory $\mathcal{H}_2$ optimal model reduction methods that will produce parameterized reduced-order models having high fidelity throughout a parameter range of interest. For single input/single output systems with parameters in the input/output maps, we provide reduced-order models that are \emph{optimal} with respect to an $\mathcal{H}_2\otimes\mathcal{L}_2$ joint error measure. The capabilities of these approaches are illustrated by several numerical examples from technical applications.

Bilinear systems are a class of nonlinear dynamical systems that arise in a variety of applications. In order to obtain a sufficiently accurate representation of the underlying physical phenomenon, these models frequently have state-spaces of very large dimension, resulting in the need for model reduction. In this work, we introduce two new methods for the model reduction of bilinear systems in an interpolation framework. Our first approach is to construct reduced models that satisfy multipoint interpolation constraints defined on the Volterra kernels of the full model. We show that this approach can be used to develop an asymptotically optimal solution to the H_2 model reduction problem for bilinear systems. In our second approach, we construct a solution to a bilinear system realization problem posed in terms of constructing a bilinear realization whose kth-order transfer functions satisfy interpolation conditions in k complex variables. The solution to this realization problem can be used to construct a bilinear system realization directly from sampling data on the kth-order transfer functions, without requiring the formation of the realization matrices for the full bilinear system. / Ph. D.

The SHIRA method of Mehrmann and Watkins belongs among the structure preserving Krylov subspace methods for solving skew-Hamiltonian eigenvalue problems. It can also be applied to Hamiltonian eigenproblems by considering a suitable transformation. Structure induced shift-and-invert techniques are employed to steer the algorithm towards the interesting region of the spectrum. However, the shift cannot be altered in the middle of the computation without discarding the information that has been accumulated so far. This paper shows how SHIRA can be combined with ideas from Ruhe's Rational Krylov algorithm to yield a method that permits an adjustment of shift after every step of the computation, adding greatly to the flexibility of the algorithm. We call this new method rational SHIRA. A numerical example is presented to demonstrate its efficiency.

We provide a unifying projection-based framework for structure-preserving interpolatory model reduction of parameterized linear dynamical systems, i.e., systems having a structured dependence on parameters that we wish to retain in the reduced-order model. The parameter dependence may be linear or nonlinear and is retained in the reduced-order model. Moreover, we are able to give conditions under which the gradient and Hessian of the system response with respect to the system parameters is matched in the reduced-order model. We provide a systematic approach built on established interpolatory $\mathcal{H}_2$ optimal model reduction methods that will produce parameterized reduced-order models having high fidelity throughout a parameter range of interest. For single input/single output systems with parameters in the input/output maps, we provide reduced-order models that are \emph{optimal} with respect to an $\mathcal{H}_2\otimes\mathcal{L}_2$ joint error measure. The capabilities of these approaches are illustrated by several numerical examples from technical applications.

Die vorliegende Arbeit befasst sich mit der Fragestellung, inwiefern sich gegebene Verfahren zur Approximation von rationalen Krylow-Räumen zur Berechnung von Matrixfunktionen eignen. Als Modellproblem wird dazu eine 2.5D-Formulierung eines Problems aus der Gleichstrom-Geoelektrik mit finiten Elementen formuliert und dann mittels Matrixfunktionen auf rationalen Krylow-Unterräumen gelöst. Ein weiterer Teil beschäftigt sich mit dem Vergleich zweier Verfahren zur Transformation bestehender rationaler Krylow-Räume. Bei beiden Varianten werden die zugrunde liegenden Pole getauscht ohne dass ein explizites Invertieren von Matrizen notwendig ist. In dieser Arbeit werden die über mehrere Publikationen verteilten Grundlagen einheitlich zusammengetragen und fehlende Zusammenhänge ergänzt. Beide Verfahren eignen sich prinzipiell um rationale Krylow-Räume zu approximieren. Dies wird anhand mehrerer Beispiele gezeigt. Anhand des Modellproblems werden Beschränkungen der Methoden verdeutlicht.

Rational Krylov methods for model order reduction are studied. A dual rational Arnoldi method for model order reduction and a rational Krylov method for model order reduction and eigenvalue computation have been implemented. It is shown how to deflate redundant or unwanted vectors and how to obtain moment matching. Both methods are designed for generalised state space systems---the former for multiple-input-multiple-output (MIMO) systems from finite element discretisations and the latter for single-input-single-output (SISO) systems---and applied to relevant test problems. The dual rational Arnoldi method is designed for generating real reduced order systems using complex shift points and stabilising a system that happens to be unstable. For the rational Krylov method, a forward error in the recursion and an estimate of the error in the approximation of the transfer function are studie. A stability analysis of a heat exchanger model is made. The model is a nonlinear partial differential-algebraic equation (PDAE). Its well-posedness and how to prescribe boundary data is investigated through analysis of a linearised PDAE and numerical experiments on a nonlinear DAE. Four methods for generating reduced order models are applied to the nonlinear DAE and compared: a Krylov based moment matching method, balanced truncation, Galerkin projection onto a proper orthogonal decomposition (POD) basis, and a lumping method. / QC 20101013