Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 2 of 2 for “"Local-SGD"”.
-
First-order distributed optimization methods for machine learning with linear speed-up
… and decentralized Stochastic Gradient Descent (SGD) and their communication requirements. Namely, (i) an algorithm for achieving consensus among a collection of agents is studied and its convergence to the average is shown, in the presence of link failures and delays. The new results improve …
-
Optimization in the Era of Large Language Models: Theory and Applications
… training by introducing Pseudo-Asynchronous Local SGD (PALSGD). This method elegantly regularizes local workers through pseudo-synchronization, allowing for larger synchronization intervals while maintaining strong empirical performance. Next, Chapter 4 enhances the reasoning capabilities of …