Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 195 for “"NEURAL NETWORK TRAINING"”.
-
Efficient Sparse Neural Network Training
Developments in neural networks have led to advanced models requiring large amounts of training time and resources. To reduce the environmental impact and to decrease the training times of models, acceleration techniques have been developed. One method is neural network pruning, which removes …
-
Advancing Learnable Neural Network Training Algorithms
… has seen massive improvements with large-scale neural networks. In this thesis, we propose learnable algorithms to advance neural network training and make them practical along two axes: (1) learned optimization and (2) knowledge distillation. On the learned optimization axis, we meta-train a …
-
Efficient Large-Scale Graph Neural Network Training
This dissertation focuses on efficient training of graph neural networks (GNNs) on largescale graphs. Graphs and networks are ubiquitous in various domains, such as web graphs, social networks, and transportation networks. Mining graph-structured data and learning on graphs have been central to …
-
Swarm-based Algorithms for Neural Network Training
… intelligence algorithms when applied to the training of artificial neural networks. In order to compare the performance of the selected swarm intelligence algorithms both classification and regression datasets were chosen from the UCI Machine Learning repository. Swarm intelligence algorithms …
-
Faster convolutional neural network training via approximate memoization
Deep Convolutional Neural Networks have found wide application but their training time can be significant. We find that between successive epochs during training, many neurons compute nearly the same output when presented with the same input. This presents an opportunity to skip computation in the …
-
DropBack : continuous pruning during deep neural network training
In recent years, neural networks have regained popularity in a variety of fields such as image recognition and speech transcription. As deep neural networks grow more popular for solving everyday tasks, deployment on small embedded devices — such as phones — is becoming increasingly popular. …
-
Improving Deep Neural Network Training with Knowledge Distillation
… technique, has been widely used to reduce deep neural network (DNN) size for a variety of applications. However, in recent years, some research had found its potential for improving deep neural network performance. This dissertation focuses on further exploring its power to facilitate accurate …
-
On Patching Learning Discrepancies in Neural Network Training
Neural network's ability to model data patterns proved to be immensely useful in a plethora of practical applications. However, using the physical world's data can be problematic since it is often cluttered, crowded with scattered insignificant patterns, contain unusual compositions, and widely …
-
Implicit Regularization and Inductive Biases in Neural Network Training
… recent years, driven largely by the success of neural networks trained at unprecedented scale.A defining feature of these models is their scalability: as model size, data, and compute increase, performance often improves in a predictable manner, enabling the solution of increasingly complex …
-
Decentralized deep neural network training via distributed ledger technology
… Following the above directives, we could develop networks that: 1) They can approach (or even exceed) the total computing power of a big data center, by utilizing a large number of nodes. 2) They have no "single point of failure", since all participants have equal roles, meaning that the network …
-
Accelerating large scale Graph Neural Network training using SmartSSD
Graph Neural Network (GNN) is a type of neural network that processes data structured as graphs. It excels at capturing complex relationships and dependencies between nodes within the graph. GNNs are increasingly significant, with numerous applications in the real world, such as social network …
-
Efficient neural network training for 4D-CTA stroke imaging
Radboud University, 10 september 2024
-
Accelerating distributed neural network training with network-centric approach
Distributed training of Deep Neural Networks (DNN) is an important technique to reduce the training time of large DNNs for a wide range of applications. In existing distributed training approaches, however, the communication time to periodically exchange parameters (i.e., weights) and gradients …
-
Priority-based parameter propagation for distributed deep neural network training
Data parallel training is commonly used for scaling distributed Deep Neural Network ( DNN ) training. However, the performance benefits are often limited by the communication-heavy parameter synchronization step. In this work, we take advantage of the domain specific knowledge of DNN training and …
-
The development of VLSI implementation-related neural network training algorithms
Artificial neural networks are systems composed of interconnected simple computing units known as artificial neurons which simulate some properties of their biological counterparts. They have been developed and studied for understanding how brains function, and for computational purposes. Two kinds …
-
Learning Efficient Datatypes for Deep Neural Network Training and Inference
Neural networks can maintain state-of-the-art accuracy using smaller datatypes and fewer training samples. However, finding the best datatype configuration and determining unnecessary samples, without sacrificing accuracy, remains an unresolved challenge. Current approaches depend on user-driven …
Page 1 of 10