Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 2 of 2 for “"analysis of stochastic gradient descent"”.

  1. Theoretical Analysis of Stochastic Gradient Descent in Stochastic Optimization

    Stochastic Gradient Descent (SGD) type algorithms have been widely applied to many stochastic optimization problems, such as machine learning. Despite its empirical success, there is still a lack of theoretical understanding of convergence properties of SGD and its variants. The major bottleneck …

    gatech Repository record for Theoretical Analysis of Stochastic Gradient Descent in Stochastic Optimization (opens in a new tab)

  2. Bidirectional TopK Sparsification for Distributed Learning

    … large neural networks requires a large amount of time. To speed up the process, distributed training is often used. One of the largest bottlenecks in distributed training is communicating gradients across different nodes. Different gradient compression techniques have been proposed to alleviate …

    waterloo Repository record for Bidirectional TopK Sparsification for Distributed Learning (opens in a new tab)