Back to results

University of Central Florida

Stragglers-Robust First-Order Distributed Optimization Algorithms Over Networks Utilizing Gradient Coding

Abstract

dc:description.abstract

This dissertation considers distributed algorithms for centralized and decentralized networks that solve general convex optimization problems. First, a centralized algorithm is explored for parameter server networks robust to the straggler problem. It is proved that the server nodes' estimates converge to the minimizer of the global objective function with connections vulnerable to an allowed number of stragglers. We then show that convergence is also attained in other different cases: Either by using only the received local gradients scenario or the scenario of using delayed local gradients for the non received gradients. Concurrently, the convergence rates for the above aforementioned scenarios were established and verified using numerical simulations. Additionally, a synchronous distributed algorithm on distributed networks was designed that achieves better convergence rates through using an adequate coding scheme. Moreover, the convergence of the algorithm was proven in the case of static and time-varying networks consistent with the defined coding scheme. The convergence rate is found explicitly and analyzed with the defining criteria that influence its behavior. The algorithms' performance was also verified using the appropriate numerical simulations. Finally, we present another distributed algorithm which is a default-form algorithm for distributed coded gradient algorithms. Both convergence and convergence rate were analyzed to understand better the general behavior of such algorithms.

Degree

thesis:*
Grantor dc:publisher
University of Central Florida

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Atallah, Elie
Contributors dc:contributor
  • Rahnavard, Nazanin

Subjects

dc:subject × 1

Rights

Language dc:language
English

Identifiers

dc:identifier.*
Identifier
CFE0008073; DP0023212

Chain of custody

source
Harvested from
Central Florida
Base URL
stars.library.ucf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Atallah, Elie. Stragglers-Robust First-Order Distributed Optimization Algorithms Over Networks Utilizing Gradient Coding. University of Central Florida, https://stars.library.ucf.edu/etd/6843