National Technical University of Athens (NTUA)
Το νευρωνικό δίκτυο προσήμου για προβλήματα ελαχίστου χωρίς περιορισμούς
Abstract
dc:descriptionIn this Thesis, the sign dynamical system for unconstrained minimization of a continuously differentiable function f is examined. This dynamical system has a discontinuous right hand side and, in this Thesis, it is interpreted here as a reccurent neural network which we name the Sign Neural Network. By using Filippov’s approach, we first prove asymptotic convergence of the Sign Neural Network. Also, finite-time convergence of the solutions is established and an improved upper bound for convergence time is given. A first contribution of this Thesis is a detailed calculation of Filippov’s set-valued map for the Sign Neural Network in the general case, i.e. without any restrictive assumptions on the function f to be minimized. Convergence of the solutions to stationary points of f follows by using standard results, i.e. a generalized version of LaSalle’s invariance principle. Next, in order to prove finite-time convergence of solutions, the applicability of standard results is extended so that they can be applied to the Sign Neural Network. Finally, while establishing finite-time convergence, a novel proving procedure is introduced which (i) allows for milder assumptions to be made on the function f , and (ii) results in an improved upper bound for the convergence time. Numerical experiments confirm both the effectiveness and finite-time convergence of the Sign Neural Network.
Degree
thesis:*- Grantor dc:publisher
- National Technical University of Athens (NTUA)
- Year dc:date
- 2018
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Moraitis, Michail
- Μωραΐτης, Μιχαήλ
Subjects
dc:subject × 14- Ασαφές αναδρομικά νευρωνικά δίκτυα
- Μη - διαφορίσιμες διαφορικές εξισώσεις
- Μέθοδος Filippov
- Σύγκλιση πεπερασμένου χρόνου
- Προβλήματα ελαχίστου χωρίς περιορισμούς
- Recurrent neural networks
- Discontinuous ODE's
- Filippov’s method
- Finite - time convergence
- Uncostrained minimization problems
- Επιστήμες Μηχανικού και Τεχνολογία
- Επιστήμη Ηλεκτρολόγου Μηχανικού, Ηλεκτρονικού Μηχανικού, Μηχανικού Η/Υ
- Engineering and Technology
- Electrical Engineering, Electronic Engineering, Information Engineering
Rights
- Language dc:language
- gre
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/44907