Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 37 for “"Distributed Deep Learning"”.

  1. Novel Allreduce Algorithms for Distributed Deep Learning

    To solve the most computationally challenging problems, scientists and engineers use HPC clusters. These massive-scale systems comprise thousands of servers, each containing multiple GPUs and CPUs, tied together with a web of interconnect technologies like PCIe, InfiniBand, and NVLink. As a result, …

    queens Repository record for Novel Allreduce Algorithms for Distributed Deep Learning (opens in a new tab)

  2. COLLABORATIVE DISTRIBUTED DEEP LEARNING SYSTEMS ON THE EDGES

    Deep learning has revolutionized a wide range of fields. In spite of its success, most deep learning systems are proposed in the cloud, where data are processed in a centralized manner with abundant compute and network resources. This raises a problem when deep learning is deployed on the edge …

    msu Repository record for COLLABORATIVE DISTRIBUTED DEEP LEARNING SYSTEMS ON THE EDGES (opens in a new tab)

  3. Elastic Synchronization for Efficient and Effective Distributed Deep Learning

    Training deep neural networks (DNNs) using a large-scale cluster with an efficient distributed paradigm significantly reduces the training time. However, a distributed paradigm developed only from system engineering perspective is most likely to hindering the model from learning due to the …

    york Repository record for Elastic Synchronization for Efficient and Effective Distributed Deep Learning (opens in a new tab)

  4. Quality Attributes of Data in Distributed Deep Learning Architectures

    … challenges related with data quality of a distributed deep learning system. The challenges are identified by conducing interviews with five experts from autonomous driving domain as well as through literature review. The challenges and their severity are validated using a survey. After …

    chalmers Repository record for Quality Attributes of Data in Distributed Deep Learning Architectures (opens in a new tab)

  5. A TRAINING FRAMEWORK AND ARCHITECTURAL DESIGN OF DISTRIBUTED DEEP LEARNING

    Deep learning has recently gained a lot of attention on account of its incredible success in many complex data-driven applications, such as image classification. However, deep learning is quite user-hostile and is thus difficult to apply. For example, it is tricky and slow to train a large model …

    nus Repository record for A TRAINING FRAMEWORK AND ARCHITECTURAL DESIGN OF DISTRIBUTED DEEP LEARNING (opens in a new tab) Download file for A TRAINING FRAMEWORK AND ARCHITECTURAL DESIGN OF DISTRIBUTED DEEP LEARNING (opens in a new tab)

  6. A practical evaluation of parallel and distributed deep learning frameworks

    … to be processed contributed to researchers in deep learning update their models to use distributed train ing. Distributed Deep Learning (DDL) is essential for solving large-scale problems faster and accurately using multiple devices to run the model in parallel. This strategy brings challenges …

    brazil-ufrgs Repository record for A practical evaluation of parallel and distributed deep learning frameworks (opens in a new tab)

  7. Towards a Resource Efficient Framework for Distributed Deep Learning Applications

    Distributed deep learning has achieved tremendous success for solving scientific problems in research and discovery over the past years. Deep learning training is quite challenging because it requires training on large-scale massive dataset, especially with graphics processing units (GPUs) in …

    vt Repository record for Towards a Resource Efficient Framework for Distributed Deep Learning Applications (opens in a new tab)

  8. Secured Scalable Blockchain Networks for Trustworthy Distributed Deep Learning in VANETs

    Distributed deep learning (DDL) within vehicular ad hoc networks (VANETs) holds profound significance in developing smart applications, such as intelligent transport systems and autonomous driving, where multiple parties are coordinated to leverage the training capability and acquisitive …

    carleton Repository record for Secured Scalable Blockchain Networks for Trustworthy Distributed Deep Learning in VANETs (opens in a new tab)

  9. Distributed Deep Learning in IoT: Splitting Neural Networks in Inference and Training

    … Knowledge Distillation via Collaboratively Learning (KDCL) to Split Learning to get a distilled model of server-part model in SplitNN after training. The distilled model could be designed to fit the memory-limited Internet of Things (IoT) devices so that clients could get prediction results …

    queens Repository record for Distributed Deep Learning in IoT: Splitting Neural Networks in Inference and Training (opens in a new tab)

  10. Study and optimization of distributed deep learning under the parameter server architecture

    Deep learning has transformed numerous fields by leveraging vast datasets and complex neural architectures, but the computational demands of modern models often exceed single-node capabilities, prompting distributed training solutions. This thesis investigates asynchronous training under the …

    greece Repository record for Study and optimization of distributed deep learning under the parameter server architecture (opens in a new tab)

  11. Accelerating Distributed Deep Learning via Software-Defined RDMA Transport in AI Data Centers

    … trillion-parameter models therefore requires distributed execution across thousands of accelerators. In such systems, communication efficiency is essential for keeping large GPU clusters synchronized. A key property of distributed deep learning (DDL) is that computation and communication are …

    umn Repository record for Accelerating Distributed Deep Learning via Software-Defined RDMA Transport in AI Data Centers (opens in a new tab)

  12. Comparison of distributed training architecture for convolutional neural network in cloud

    … of data and ever increasing model complexity of deep neural networks (DNNs) have enabled breakthroughs in various artificial intelligence fields such as computer vision, natural language processing and data mining. The training process of the DNN is a computationally intensive application that …

    uiuc Repository record for Comparison of distributed training architecture for convolutional neural network in cloud (opens in a new tab)

  13. Optimizing Collective Communication for Scalable Scientific Computing and Deep Learning

    <p>In the realm of distributed computing, collective operations involve coordinated communication and synchronization among multiple processing units, enabling efficient data exchange and collaboration. Scientific applications, such as simulations, computational fluid dynamics, and scalable deep …

    utk-theses Repository record for Optimizing Collective Communication for Scalable Scientific Computing and Deep Learning (opens in a new tab)

  14. High-Performance Interconnect-AwareMPI communication for Deep Learning Workloads

    … intensive portions of applications. Distributed Deep Learning workloads on these heterogeneous HPC systems has become increasingly important. These new workloads have been developed upon existing HPC libraries such as the Message Passing Interface (MPI) and Compute Unified Device …

    queens Repository record for High-Performance Interconnect-AwareMPI communication for Deep Learning Workloads (opens in a new tab)

  15. Efficient and Scalable Deep Learning

    <p>Deep Neural Networks (DNNs) can achieve accuracy superior to traditional machine learning models, because of their large learning capacity and the availability of large amounts of labeled data. In general, larger DNNs can obtain higher accuracy. However, there are two obstacles which hinder us …

    duke Repository record for Efficient and Scalable Deep Learning (opens in a new tab)

  16. Distributed deep neural networks

    Deep neural networks have become popular for solving machine learning problems in the field of computer vision. Although computers have reached parity in the task of image classification in machine learning competitions, the task of mining massive training data often takes expensive hardware a long …

    texas Repository record for Distributed deep neural networks (opens in a new tab)

  17. Distributed optimization for control and learning

    … In such systems, issues related to control and learning have been significant technical challenges to</p> <p>affect system performance and overall cost. While centralized optimization approaches have been widely used by the engineering and computer science community, advanced and effective …

    iastate Repository record for Distributed optimization for control and learning (opens in a new tab)

  18. Dual-Agent Deep Reinforcement Learning Approach to GPU Job Scheduling

    … cloud GPU clusters are increasingly used for distributed deep learning tasks, making the job scheduler critical for minimizing job waiting and completion times. However, scheduling is inherently complex and NP-hard. Current approaches typically address job scheduling and GPU allocation …

    york Repository record for Dual-Agent Deep Reinforcement Learning Approach to GPU Job Scheduling (opens in a new tab)

  19. AI-assisted resource orchestration for network services and distributed cloud-native applications

    … that rely either on exact methods or Machine Learning (ML). In this respect, we present an approach based on Distributed Deep Learning tailored to the embedding of SFCs onto large-scale network infrastructures. In order to confront the computational hardness of the SFC embedding problem, we …

    greece Repository record for AI-assisted resource orchestration for network services and distributed cloud-native applications (opens in a new tab)

  20. OPTIMIZING COMMUNICATION IN PARALLEL DEEP LEARNING ON EXASCALE-CLASS MACHINES

    Deep learning has made significant advancements across various fields, driven by increasingly larger neural networks and massive datasets. However, these improvements come at the cost of high computational demands, necessitating the use of thousands of GPUs operating in parallel for extreme scale …

    maryland Repository record for OPTIMIZING COMMUNICATION IN PARALLEL DEEP LEARNING ON EXASCALE-CLASS MACHINES (opens in a new tab)

Page 1 of 2