Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 2 of 2 for “"analysis of stochastic gradient descent"”.
-
Theoretical Analysis of Stochastic Gradient Descent in Stochastic Optimization
Stochastic Gradient Descent (SGD) type algorithms have been widely applied to many stochastic optimization problems, such as machine learning. Despite its empirical success, there is still a lack of theoretical understanding of convergence properties of SGD and its variants. The major bottleneck …
-
Bidirectional TopK Sparsification for Distributed Learning
… large neural networks requires a large amount of time. To speed up the process, distributed training is often used. One of the largest bottlenecks in distributed training is communicating gradients across different nodes. Different gradient compression techniques have been proposed to alleviate …