Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 37 for “"Distributed deep learning"”.
-
Novel Allreduce Algorithms for Distributed Deep Learning
To solve the most computationally challenging problems, scientists and engineers use HPC clusters. These massive-scale systems comprise thousands of servers, each containing multiple GPUs and CPUs, tied together with a web of interconnect technologies like PCIe, InfiniBand, and NVLink. As a result, …
-
COLLABORATIVE DISTRIBUTED DEEP LEARNING SYSTEMS ON THE EDGES
Deep learning has revolutionized a wide range of fields. In spite of its success, most deep learning systems are proposed in the cloud, where data are processed in a centralized manner with abundant compute and network resources. This raises a problem when deep learning is deployed on the edge …
-
Elastic Synchronization for Efficient and Effective Distributed Deep Learning
Training deep neural networks (DNNs) using a large-scale cluster with an efficient distributed paradigm significantly reduces the training time. However, a distributed paradigm developed only from system engineering perspective is most likely to hindering the model from learning due to the …
-
Quality Attributes of Data in Distributed Deep Learning Architectures
… challenges related with data quality of a distributed deep learning system. The challenges are identified by conducing interviews with five experts from autonomous driving domain as well as through literature review. The challenges and their severity are validated using a survey. After …
-
A TRAINING FRAMEWORK AND ARCHITECTURAL DESIGN OF DISTRIBUTED DEEP LEARNING
Deep learning has recently gained a lot of attention on account of its incredible success in many complex data-driven applications, such as image classification. However, deep learning is quite user-hostile and is thus difficult to apply. For example, it is tricky and slow to train a large model …
-
A practical evaluation of parallel and distributed deep learning frameworks
… to be processed contributed to researchers in deep learning update their models to use distributed train ing. Distributed Deep Learning (DDL) is essential for solving large-scale problems faster and accurately using multiple devices to run the model in parallel. This strategy brings challenges …
-
Towards a Resource Efficient Framework for Distributed Deep Learning Applications
Distributed deep learning has achieved tremendous success for solving scientific problems in research and discovery over the past years. Deep learning training is quite challenging because it requires training on large-scale massive dataset, especially with graphics processing units (GPUs) in …
-
Secured Scalable Blockchain Networks for Trustworthy Distributed Deep Learning in VANETs
Distributed deep learning (DDL) within vehicular ad hoc networks (VANETs) holds profound significance in developing smart applications, such as intelligent transport systems and autonomous driving, where multiple parties are coordinated to leverage the training capability and acquisitive …
-
Distributed Deep Learning in IoT: Splitting Neural Networks in Inference and Training
… Knowledge Distillation via Collaboratively Learning (KDCL) to Split Learning to get a distilled model of server-part model in SplitNN after training. The distilled model could be designed to fit the memory-limited Internet of Things (IoT) devices so that clients could get prediction results …
-
Study and optimization of distributed deep learning under the parameter server architecture
Deep learning has transformed numerous fields by leveraging vast datasets and complex neural architectures, but the computational demands of modern models often exceed single-node capabilities, prompting distributed training solutions. This thesis investigates asynchronous training under the …
-
Accelerating Distributed Deep Learning via Software-Defined RDMA Transport in AI Data Centers
… trillion-parameter models therefore requires distributed execution across thousands of accelerators. In such systems, communication efficiency is essential for keeping large GPU clusters synchronized. A key property of distributed deep learning (DDL) is that computation and communication are …
-
Comparison of distributed training architecture for convolutional neural network in cloud
… of data and ever increasing model complexity of deep neural networks (DNNs) have enabled breakthroughs in various artificial intelligence fields such as computer vision, natural language processing and data mining. The training process of the DNN is a computationally intensive application that …
-
Optimizing Collective Communication for Scalable Scientific Computing and Deep Learning
<p>In the realm of distributed computing, collective operations involve coordinated communication and synchronization among multiple processing units, enabling efficient data exchange and collaboration. Scientific applications, such as simulations, computational fluid dynamics, and scalable deep …
-
High-Performance Interconnect-AwareMPI communication for Deep Learning Workloads
… intensive portions of applications. Distributed Deep Learning workloads on these heterogeneous HPC systems has become increasingly important. These new workloads have been developed upon existing HPC libraries such as the Message Passing Interface (MPI) and Compute Unified Device …
-
Efficient and Scalable Deep Learning
<p>Deep Neural Networks (DNNs) can achieve accuracy superior to traditional machine learning models, because of their large learning capacity and the availability of large amounts of labeled data. In general, larger DNNs can obtain higher accuracy. However, there are two obstacles which hinder us …
-
Distributed deep neural networks
Deep neural networks have become popular for solving machine learning problems in the field of computer vision. Although computers have reached parity in the task of image classification in machine learning competitions, the task of mining massive training data often takes expensive hardware a long …
-
Distributed optimization for control and learning
… In such systems, issues related to control and learning have been significant technical challenges to</p> <p>affect system performance and overall cost. While centralized optimization approaches have been widely used by the engineering and computer science community, advanced and effective …
-
Dual-Agent Deep Reinforcement Learning Approach to GPU Job Scheduling
… cloud GPU clusters are increasingly used for distributed deep learning tasks, making the job scheduler critical for minimizing job waiting and completion times. However, scheduling is inherently complex and NP-hard. Current approaches typically address job scheduling and GPU allocation …
-
AI-assisted resource orchestration for network services and distributed cloud-native applications
… that rely either on exact methods or Machine Learning (ML). In this respect, we present an approach based on Distributed Deep Learning tailored to the embedding of SFCs onto large-scale network infrastructures. In order to confront the computational hardness of the SFC embedding problem, we …
-
OPTIMIZING COMMUNICATION IN PARALLEL DEEP LEARNING ON EXASCALE-CLASS MACHINES
Deep learning has made significant advancements across various fields, driven by increasingly larger neural networks and massive datasets. However, these improvements come at the cost of high computational demands, necessitating the use of thousands of GPUs operating in parallel for extreme scale …
Page 1 of 2