<p dir="ltr">Constrained optimization plays a crucial role in numerous scientific and engineering fields, where solutions must satisfy specific constraints while optimizing an objective function. The complexity of these problems has driven the development of efficient algorithms. Primal-dual methods, particularly, have been a powerful class of algorithms capable of tackling constrained optimization problems. This dissertation introduces and analyzes new Lagrangian-based primal-dual methods, exploring their applications in the equilibrium computation of generalized Nash games and non-convex constrained optimization problems. </p><p dir="ltr">Generalized Nash games, also known as generalized Nash equilibrium problems, expand the concept of classical Nash games by incorporating coupled constraints, which substantially increase their computational complexity. These games are prevalent in a variety of real-world applications, such as electricity markets, economic markets, transportation networks, and various multi-agent systems, where decision-makers are required to engage in strategic actions while also considering coupled constraints. We develop a primal-dual first-order method for efficient computation of generalized Nash equilibrium, providing its theoretical foundations and practical implementation. </p><p dir="ltr">Non-convex constrained optimization problems often emerge across various application domains, presenting significant theoretical and computational challenges due to the presence of non-convex constraints and objective functions. To address these challenges, we propose and analyze novel Lagrangian-based primal-dual methods designed to manage non-convex constraints and establish their convergence properties. We perform extensive numerical experiments to demonstrate the practicality and versatility of our proposed methods. The results show the efficacy of our methods in tackling the computational challenges associated with generalized Nash games and non-convex constrained optimization.</p>

Dans le contexte de la vision par ordinateur cette thèse étudie le problème d’appariement d’images dans le cadre de la télédétection pour la géologie. Plus précisément, nous disposons dans ce travail de deux images de la même scène géographique, mais acquises à partir de deux points de vue différents et éventuellement à un autre moment. La tâche d’appariement est d'associer à chaque pixel de la première image un pixel de la seconde image.Bien que ce problème soit relativement facile pour les êtres humains, il reste difficile à résoudre par un ordinateur. De nombreuses approches pour traiter cette tâche ont été proposées. Les techniques les plus prometteuses formulent la tâche comme un problème d'optimisation numérique. Malheureusement, le nombre d'inconnues ainsi que la nature de la fonction à optimiser rendent ce problème extrêmement difficile à résoudre. Cette thèse étudie deux approches avec un schéma multi-échelle pour résoudre le problème numérique sous-jacent / This thesis studies the computer vision problem of image registration in the context of geological remote sensing surveys. More precisely we dispose in this work of two images picturing the same geographical scene but acquired from two different view points and possibly at a different time. The task of registration is to associate to each pixel of the first image its counterpart in the second image.While this problem is relatively easy for human-beings, it remains an open problem to solve it with a computer. Numerous approaches to address this task have been proposed. The most promising techniques formulate the task as a numerical optimization problem. Unfortunately, the number of unknowns along with the nature of the objective function make the optimization problem extremely difficult to solve. This thesis investigates two approaches along with a coarsening scheme to solve the underlying numerical problem

We propose a family of search directions based on primal-dual entropy in the context of interior point methods for linear programming. This new family contains previously proposed search directions in the context of primal-dual entropy. We analyze the new family of search directions by studying their primal-dual affine-scaling and constant-gap centering components. We then design primal-dual interior-point algorithms by utilizing our search directions in a homogeneous and self-dual framework. We present iteration complexity analysis of our algorithms and provide the results of computational experiments on NETLIB problems.

We propose a family of search directions based on primal-dual entropy in the context of interior point methods for linear programming. This new family contains previously proposed search directions in the context of primal-dual entropy. We analyze the new family of search directions by studying their primal-dual affine-scaling and constant-gap centering components. We then design primal-dual interior-point algorithms by utilizing our search directions in a homogeneous and self-dual framework. We present iteration complexity analysis of our algorithms and provide the results of computational experiments on NETLIB problems.

This thesis is a computational study of recently developed algorithms which aim to overcome degeneracy in the simplex method. We study the following algorithms: the non-negative least squares algorithm, the least-squares primal-dual algorithm, the least-squares network flow algorithm, and the combined-objective least-squares algorithm. All of the four algorithms use least-squares measures to solve their subproblems, so they do not exhibit degeneracy. But they have never been efficiently implemented and thus their performance has also not been proved. In this research we implement these algorithms in an efficient manner and improve their performance compared to their preliminary results. For the non-negative least-squares algorithm, we develop the basis update technique and data structure that fit our purpose. In addition, we also develop a measure to help find a good ordering of columns and rows so that we have a sparse and concise representation of QR-factors. The least-squares primal-dual algorithm uses the non-negative least-squares problem as its subproblem, which minimizes infeasibility while satisfying dual feasibility and complementary slackness. The least-squares network flow algorithm is the least-squares primal-dual algorithm applied to min-cost network flow instances. The least-squares network flow algorithm can efficiently solve much bigger instances than the least-squares primal-dual algorithm. The combined-objective least-squares algorithm is the primal version of the least-squares primal-dual algorithm. Each subproblem tries to minimize true objective and infeasibility simultaneously so that optimality and primal feasibility can be obtained together. It uses a big-M to minimize the infeasibility. We developed the techniques to improve the convergence rates of each algorithm: the relaxation of complementary slackness condition, special pricing strategy, and dynamic-M value. Our computational results show that the least-squares primal-dual algorithm and the combined-objective least-squares algorithm perform better than the CPLEX Primal solver, but are slower than the CPLEX Dual solver. The least-squares network flow algorithm performs as fast as the CPLEX Network solver.

Mémoire numérisé par la Direction des bibliothèques de l'Université de Montréal.

The minimum cost bipartite matching problem is a well-studied optimization problem in computer science and operations research, with wide-ranging applications in fields such as machine learning, economics, transportation, logistics and biology. A special instance of this problem is the computation of the p-Wasserstein distance which we define next. Given a complete bipartite graph with two disjoint sets of n points in d-dimensional Euclidean space and an integer p ≥ 1, let the cost of an edge be the p-th power of the Euclidean distance between its endpoints. The objective of this problem is to find a minimum-cost matching in this complete bipartite graph. The Hungarian algorithm is a classical method that solves this problem in O(n^3) time. There are many algorithms that have a run time better than that of the Hungarian algorithm if the graphs have non-negative integer edge costs bounded by C. Since the input points have real-valued coordinates and the Euclidean distances can be irrational, such algorithms only return an approximate matching. Thus, the Hungarian algorithm remains the fastest known algorithm to compute an exact matching. In this thesis, we implement a new algorithm in the divide and conquer framework that computes the exact p-Wasserstein distance and has a run time asymptotically better than the Hungarian algorithm for stochastic point sets. Inspired by the techniques used in the algorithm, we also design an alternate version of the Hungarian algorithm that uses a grid- based approach. Our experimental analysis shows that both of our algorithms significantly outperform the classical Hungarian algorithm. / Master of Science / Suppose we have two sets of equal number of items and a list of compatible pairs of items, where a pair is considered compatible if its items belong to different sets. A perfect matching is a subset of compatible pairs where each item is paired with exactly one other item. When trying to find a perfect matching, there may be multiple options, and minimizing the cost of the perfect matching is often desired. This is referred to as the minimum cost bipartite matching problem, which is extensively studied due to its importance in algorithmic theory and operations research. A special instance of this problem is the calculation of the p- Wasserstein distance. It has many practical applications in fields such as machine learning, economics, transportation, logistics and biology. The Hungarian algorithm is the only known algorithm that can compute the exact p-Wasserstein distance. Therefore, our focus is to develop exact algorithms for this problem that perform better than the Hungarian algorithm and can scale efficiently to large datasets.

Neste trabalho, os métodos de pontos interiores primal-dual e preditor corretor são estudados e desenvolvidos para o problema de minimização de custos na geração e perdas na transmissão do pré-despacho DC (fluxo de carga em corrente contínua) de um sistema de potência hidroelétrico, com base no modelo de fluxo em redes e no princípio do mínimo esforço. A estrutura matricial, resultante da simplificação do problema proposto pela inclusão do princípio do mínimo esforço, é estudada visando implementações eficientes. / In this work, the primal-dual and predictor corrector interior points methods are studied and developed for the predispatch DC problem that minimizes generation and transmission losses on hydroelectric power systems, on the basis of the network flow model and the minimum effort principle. The matrix structure, resulting of the simplification of the problem considered by inclusion of the minimum effort principle, is studied aiming efficient implementations. A disturbed primal-dual method is considered on the basis of a heuristic definition that determine the choice of the disturbance parameter. This method showed to be efficient in practice and converged in fewer iterations when compare with an existing implementation of the network flow model.

Neste trabalho, os métodos de pontos interiores primal-dual e preditor corretor são estudados e desenvolvidos para o problema de minimização de custos na geração e perdas na transmissão do pré-despacho DC (fluxo de carga em corrente contínua) de um sistema de potência hidroelétrico, com base no modelo de fluxo em redes e no princípio do mínimo esforço. A estrutura matricial, resultante da simplificação do problema proposto pela inclusão do princípio do mínimo esforço, é estudada visando implementações eficientes. / In this work, the primal-dual and predictor corrector interior points methods are studied and developed for the predispatch DC problem that minimizes generation and transmission losses on hydroelectric power systems, on the basis of the network flow model and the minimum effort principle. The matrix structure, resulting of the simplification of the problem considered by inclusion of the minimum effort principle, is studied aiming efficient implementations. A disturbed primal-dual method is considered on the basis of a heuristic definition that determine the choice of the disturbance parameter. This method showed to be efficient in practice and converged in fewer iterations when compare with an existing implementation of the network flow model.

Orientador: Edméa Cássia Baptista / Resumo: O problema de fluxo de potência ótimo reativo é representado matematicamente por um problema de otimização não linear, restrito, não convexo, de grande porte e com variáveis de controle contínuas e discretas. A representação dos taps dos transformadores em fase e das susceptâncias shunt dos bancos de capacitores/reatores do sistema como variáveis discretas, torna o problema mais próximo da realidade. Entretanto, problemas de otimização não linear com variáveis discretas apresentam dificuldades em sua resolução, as quais são impostas pelas variáveis discretas. Uma das técnicas para sua resolução consiste em utilizar funções penalidades para tratar as variáveis discretas. Desta forma, transforma-se o problema discreto em uma sequência de problemas contínuos, e o método primal-dual barreira logarítmica pode ser utilizado para resolver esses problemas. Neste trabalho o objetivo é analisar a convergência do método de penalidade para variáveis discretas aplicado ao problema de fluxo de potência ótimo reativo, ao se utilizar diferentes funções penalidade e a combinação delas. Testes computacionais foram realizados com um exemplo númérico e com os sistemas elétricos IEEE 14, 30 e 118 barras, utilizando o pacote de otimização KNITRO em interface com o software GAMS. Os resultados demonstram que a combinação de diferentes funções penalidade para o tratamento das variáveis discretas é promissora. / Abstract: The reactive optimal power flow problem is mathematically represented by a nonlinear, constrained, nonconvex, large scale optimization problem with continuous and discrete control variables. The representation of the in-phase transformers taps and/or the shunt susceptances of capacitor/reactor Banks of the system, as discrete variables, make the problem closer to reality. Nonlinear optimization problems with discrete variables are difficulty to solve, due to the discrete variables. One of the soluction techniques consist in using penalty functions to treat the discrete variables. Thus, the discrete problem is transformed in a sequence of continuous problems, and the primal dual logarithmic barrier method can be used to solve these problems. In this work the objective is to analyze the convergence of the penalty method for discrete variables applied to the reactive optimal power flow problem, by using different penalty functions and the mixture of them. Computational tests have been carried out with a numerical example and with the IEEE 14, 30 and 118 buses electrical systems, using the KNITRO optimization package in interface with the GAMS software. The results show that a mixture of different penalty functions for treatment of discrete variable is advantageous. / Mestre