Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 3 of 3 for “"large learning rate"”.
-
Quantitative convergence analysis of dynamical processes in machine learning
… convergence of selected important machine learning processes, from a dynamical perspective, in order to understand and guide machine learning practices. Machine learning is becoming increasingly popular in various fields. Typical machine learning models consist of optimization and …
-
Understanding Modern Machine Learning Models through the Llens of High-dimensional Statistics
… common practice of overparameterization (i.e., large number of trainable parameters) seemingly goes against good generalization performance. The empirical success of deep learning has motivated the following important theoretical questions: 1. How does overparameterization interact with the …
-
Towards Transparent and Automatic Deep Learning: Advances in Interpretability and Learning-Rate-Free Optimization
Deep learning has indeed become the workhorse of artificial intelligence, achieving state-of-the-art performance across a wide range of domains, from computer vision to natural language processing. With the widespread deployment of deep learning and the rapid growth of model sizes, two fundamental …