Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 70 for “"Collective Communication"”.
-
Unresponsiveness -Tolerant Collective Communication
… the final goal of increasing the performance of collective-communication-centric parallel applications.
-
Optimization of MPI Collective Communication Operations
… (MPI) libraries, especially with regard to collective operations.The implementations of state-of-the-art MPI collective operations heavily rely on synchronizations, and these implementations magnify noise across the participating processes, resulting in significant performance slowdowns. …
-
Algorithmic techniques for optimal collective communication
Improving the performance of collective communication---algorithms for coordinated data movement in distributed computing---becomes increasingly important as the use of large-scale machine learning clusters continues to grow. In this work, we introduce techniques for synthesizing optimal algorithms …
-
Advancing collective communication design for fertility tracking
… fertility data support group, Lilac Fertility Collective, made choices about their communication together and how their choices revealed the problems, techniques, and situated ideals that shape collaborative sensemaking about fertility tracking. This work advances collective communication …
-
The Collective Communication of Social Choice Messages
… in this dissertation is to develop a theory of collective communication. Collective communication is defined as social interaction mediated through messages whose production involves a collectivity. The focus of analysis is on social choice messages, messages that prescribe or proscribe the …
-
Accelerating Collective Communication for Distributed Machine Learning
Collective communication has emerged as a cornerstone of distributed machine learning, enabling datacenter-scale clusters of accelerators to collaboratively train or serve large language models. However, it has also become a significant performance bottleneck, impeding the efficient utilization and …
-
Modeling collective communication : design and performance evaluation
Thesis (Ph. D.)--Michigan State University. Department of Computer Science, 1997
-
Partial aggregation for collective communication in distributed memory machines
… latency is particularly challenging in collective communications, where many PEs may interact in complex communication patterns. Although collective communications can be optimized for network-level parallelism, occasional synchronization delays due to dependencies in the communication …
-
ATCOM: Automatically tuned collective communication system for SMP clusters.
<p>Conventional implementations of collective communications are based on point-to-point communications, and their optimizations have been focused on efficiency of those communication algorithms. However, point-to-point communications are not the optimal choice for modern computing clusters of SMPs …
-
Optimizing Collective Communication for Scalable Scientific Computing and Deep Learning
<p>In the realm of distributed computing, collective operations involve coordinated communication and synchronization among multiple processing units, enabling efficient data exchange and collaboration. Scientific applications, such as simulations, computational fluid dynamics, and scalable deep …
-
Efficient Process Arrival Pattern Aware Collective Communication for HPC and Deep Learning
… parallel programming standard that fulfills communication in HPC systems. MPI collective communication operations involve all processes within a program-defined group of processes and have been used extensively in parallel applications. Unfortunately, most of the studies attempting to improve …
-
Kernel-assisted and Topology-aware MPI Collective Communication among Multicore or Many-core Clusters
… We identified three critical issues specific to collective communication: The first problem arises from the gap between logical collective topologies and underlying hardware topologies; Second, current MPI communications lack efficient shared memory message delivering approaches; Last, on …
-
HARP: A MACHINE LEARNING FRAMEWORK ON TOP OF THE COLLECTIVE COMMUNICATION LAYER FOR THE BIG DATA SOFTWARE STACK
… In this thesis, the Harp framework, which uses collective communication techniques, is prototyped to improve the performance of data movement and provides high-level APIs for various synchronization patterns in iterative computation. In contrast to traditional parallelization strategies that …
-
Software-Hardware Optimizations for Efficient Collective Communications in Distributed Machine Learning Platforms
… of activations and gradients through collective communication operations. As collective communication constitutes a primary bottleneck in distributed ML, optimizing its efficiency remains a critical research challenge. This dissertation explores software-hardware optimizations for …
-
MPI collective operations over Myrinet
Collective communication is an important subset of Message Passing Interface. Improving the performance of collective communication can greatly contribute to the performance of MPI applications. MPI-NP II is an MPI specific messaging system for PC clusters. By integrating collective communication …
-
Accelerating MPI collective communications through hierarchical algorithms with flexible inter-node communication and imbalance awareness
… work presents and evaluates algorithms for MPI collective communication operations on high performance systems. Collective communication algorithms are extensively investigated, and a universal algorithm to improve the performance of MPI collective operations on hierarchical clusters is …
Page 1 of 4