This thesis focuses on optimization problems with generalized orthogonality constraints, which may also contains linear equality constraints. These problems appear in many areas, such as machine learning, signal processing, computer vision and so on.;Many problems in this form are NP hard. One challenge posed by generalized orthogonality constraints is local minimizers loaded by nonconvex constraints. More-over, the generalized orthogonality constraints are numerically expensive to preserve during iterations.;This thesis is mainly divided into two parts. The first part is focused on solving generalized orthogonality constrained optimization problems with differentiable objective functions. For this class of optimization problems, a generalized gradient.;This thesis is mainly divided into two parts. The first part is focused on solving generalized orthogonality constrained optimization problems with differentiable objective functions. For this class of optimization problems, a generalized gradient flow is proposed, which is contained on the constraints set if the initial condition satisfies generalized orthogonality constrains. The week convergence of the generalizedgradient flow is given. A discrete iterative scheme is also proposed to make the gradient flow method computable. In addition, we analyze the relationship between our discrete iteration scheme and some existing constraint preserving methods, and the relationship between our discrete iteration scheme and the inexact forward-backward method, respectively. Several problems which also can be solved by the generalized gradient flow are given. Furthermore, we also propose an optimal gradient flow by an alyzing the first order optimality condition.;The second part of this thesis is devoted to study of the generalized orthogonality constrained optimization problems with nondifferentiable objective functions. An approximate augmented Lagrangian method is used to deal with this class of problems. The global convergence is presented. We also extend the proximal alternating linearized minimization method (EPALM) to deal with the generalized orthogonality constraints appeared in the subproblem of the approximate augmented Lagrangian method. Moreover, to accelerate the EPALM method, an inertial proximal alternating linearized minimization method (IPALM) is proposed to deal with unconstrained nonconvex, nonsmooth problems with coupled objective functions.;Keywords: Generalized Orthogonality Constraints; Stiefel Manifold; Tangent Space;Gradient Flow; Approximate Augmented Lagrangian Method; Proximal Alternating Linearized Minimization Method.
| Identifer | oai:union.ndltd.org:hkbu.edu.hk/oai:repository.hkbu.edu.hk:etd_oa-1341 |
| Date | 08 July 2016 |
| Creators | Zhu, Hong |
| Publisher | HKBU Institutional Repository |
| Source Sets | Hong Kong Baptist University |
| Language | English |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | Open Access Theses and Dissertations |
Page generated in 0.002 seconds