Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 54 for “"Hadoop MapReduce"”.

  1. Hadoop MapReduce for Mobile Cloud

    … systems for big data storage and processing. Hadoop is a scalable platform that provides distributed storage and computational capabilities on clusters of commodity hardware. Building Hadoop on a mobile net- work enables the devices to run data intensive computing applications without direct …

    tamu Repository record for Hadoop MapReduce for Mobile Cloud (opens in a new tab)

  2. Parallelization of Particle Swarm Optimization Algorithm Using Hadoop Mapreduce

    … two different parallelization techniques using MapReduce programming, 1) all nodes in the cluster work on the same population, and 2) each node in cluster has its own population. Both of the parallel implementations are compared based on performance and speedup. Parallel implementation of the …

    ndsu Repository record for Parallelization of Particle Swarm Optimization Algorithm Using Hadoop Mapreduce (opens in a new tab)

  3. Sharing the love : a generic socket API for Hadoop Mapreduce

    Hadoop is a popular software framework written in Java that performs data-intensive distributed computations on a cluster. It includes Hadoop MapReduce and the Hadoop Distributed File System (HDFS). HDFS has known scalability limitations due to its single NameNode which holds the entire file system …

    u-pacific Repository record for Sharing the love : a generic socket API for Hadoop Mapreduce (opens in a new tab)

  4. Fusion-based Hadoop MapReduce job for fault tolerance in distributed systems

    Standard recovery solution on a failed task in Hadoop systems is to execute the task again. After retrying for a configured number of times, it is marked as failure. With significant amount of data, complicated Map and Reduce functions, recovering corrupted or unfinished data from a failed job can …

    texas Repository record for Fusion-based Hadoop MapReduce job for fault tolerance in distributed systems (opens in a new tab)

  5. An Ensemble Method for Large Scale Machine Learning with Hadoop MapReduce

    … Parallelized-Meta-Learning (PML) using the MapReduce programming paradigm on Hadoop. The experimental results on the Amazon EC2 cloud computing infrastructure show that PML reduces the computation complexity enormously while retaining lower error rates than the results on a single computer. …

    ottawa-retro Repository record for An Ensemble Method for Large Scale Machine Learning with Hadoop MapReduce (opens in a new tab)

  6. A Scheduling Algorithm for Hadoop MapReduce Workflows with Budget Constraints in the Heterogeneous Cloud

    … For our research, we consider the popular Apache Hadoop framework for scheduling workflows onto resources rented from cloud service providers. Investigated in our work is budget-constrained workflow scheduling on the Hadoop MapReduce platform, wherein we devise both an optimal and a heuristic …

    carleton Repository record for A Scheduling Algorithm for Hadoop MapReduce Workflows with Budget Constraints in the Heterogeneous Cloud (opens in a new tab)

  7. Towards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital system

    … BDA platform of hospital system. Methods: A Hadoop/MapReduce framework formed the BDA platform with HBase (NoSQL database) using hospital-specific metadata and file ingestion. Query performance tested with Apache tools in Hadoop’s ecosystem. Results: At optimized iteration, Hadoop distributed …

    uvic Repository record for Towards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital system (opens in a new tab)

  8. Optimized Runtime Systems for MapReduce Applications in Multi-core Clusters

    … proposes a novel runtime system, Habanero Hadoop, to tackle the inefficient utilization of multi-core machines' memory in the existing Hadoop MapReduce runtime system. Insufficient memory for each map task leads to the inability to tackle large-scale problems such as genome sequencing and …

    rice Repository record for Optimized Runtime Systems for MapReduce Applications in Multi-core Clusters (opens in a new tab)

  9. Application-Aware Network Design Using Software Defined Networking for Application Performance Optimization for Big Data and Video Streaming

    … For applications, we consider two classes: Hadoop MapReduce and video streaming. The Hadoop MapReduce (M/R) framework has become the de facto standard for Big Data analytics. However, the lack of network-awareness of the default MapReduce resource manager in a traditional IP network can …

    umkc Repository record for Application-Aware Network Design Using Software Defined Networking for Application Performance Optimization for Big Data and Video Streaming (opens in a new tab)

  10. Enumerating K-Cliques in a Large Network Using Apache Spark

    … on distributed clusters of machines using the Hadoop mapreduce framework. However, the solution suffers from a general limitation of the framework, as Hadoop's mapreduce performs substantial amounts of reading and writing to disk. Thus, the running times of Hadoop-based approaches suffer …

    iupui Repository record for Enumerating K-Cliques in a Large Network Using Apache Spark (opens in a new tab)

  11. Applying data mining techniques over big data

    … algorithms to the Big Data algorithms by using Hadoop/MapReduce as a core implementation of Big Data for scalable algorithms. We implemented the K-means algorithm and A-priori algorithm with Hadoop/MapReduce on a 5 nodes Hadoop cluster. We explore NoSQL databases for semi-structured, massively …

    bu Repository record for Applying data mining techniques over big data (opens in a new tab)

  12. Performance models for parallel applications under failures

    … of the dissertation evaluates the performance of Hadoop MapReduce applications, with different execution parameters and under different failure scenarios. The dissertation introduces performance models for Hadoop MapReduce applications considering node and process failures. Having a performance …

    houston Repository record for Performance models for parallel applications under failures (opens in a new tab)

  13. Towards a Multi-layer Architecture for IoT-based Streaming Big Data Applications

    … as a single-tier architecture that uses Hadoop MapReduce distributed processing engine deployed on a cluster of low-cost commodity computers, is then implemented for handling big data processing. Experiments with a real-life smart parking application show the efficiency and scalability of …

    auckland-ms Repository record for Towards a Multi-layer Architecture for IoT-based Streaming Big Data Applications (opens in a new tab)

  14. ANONYMOUS ROUTING FOR PRIVACY-PRESERVING DISTRIBUTED COMPUTING

    … appli- cations written in the popular MapReduce framework and Spark on an untrusted cloud. We design and implement our solution to add a mix phase/stage to enhance the existing Hadoop MapReduce and Spark framework. The evaluation shows it is feasible to run Spark jobs in our design with …

    nus Repository record for ANONYMOUS ROUTING FOR PRIVACY-PRESERVING DISTRIBUTED COMPUTING (opens in a new tab) Download file for ANONYMOUS ROUTING FOR PRIVACY-PRESERVING DISTRIBUTED COMPUTING (opens in a new tab)

  15. A distributed approach to Frequent Itemset Mining at low support levels

    … scale to hundreds of cores, on a standard Hadoop MapReduce cluster, and can improve executions times by at least an order of magnitude at the lowest support levels.

    uvic Repository record for A distributed approach to Frequent Itemset Mining at low support levels (opens in a new tab)

  16. ACCELERATING DATA-INTENSIVE COMPUTATIONS THROUGH DYNAMIC NETWORK TRAFFIC OPTIMIZATION

    Hadoop has been emerging as a popular distributed framework for data intensive computing in clustered environments. The main usage has been in parallel computing problems where interconnected clusters would transfer parts of the data between individual compute nodes to accomplish one job. The …

    houston Repository record for ACCELERATING DATA-INTENSIVE COMPUTATIONS THROUGH DYNAMIC NETWORK TRAFFIC OPTIMIZATION (opens in a new tab)

  17. Improving Energy-Efficiency through Smart Data Placement in Hadoop Clusters

    Hadoop, a pioneering open source framework, has revolutionized the big data world because of its ability to process vast amounts of unstructured and semi-structured data. This ability makes Hadoop the ‘go-to’ technology for many industries that generate big data, thus it also aids in being cost …

    columbus-state Repository record for Improving Energy-Efficiency through Smart Data Placement in Hadoop Clusters (opens in a new tab)

  18. Efficient Ranking And Selection In Parallel Computing Environments

    … namely the Message-Passing Interface (MPI), Hadoop MapReduce, and Apache Spark, and show that MPI performs the best while Spark provides good protection against core failures at the expense of a moderate drop in core utilization.

    cornell Repository record for Efficient Ranking And Selection In Parallel Computing Environments (opens in a new tab)

  19. Phurti: application and network-aware flow scheduling for MapReduce

    Traffic for a typical MapReduce job in a datacenter consists of multiple network flows. Traditionally, network resources have been allocated to optimize network-level metrics such as flow completion time or throughput. Some recent schemes propose using application-aware scheduling which can reduce …

    uiuc Repository record for Phurti: application and network-aware flow scheduling for MapReduce (opens in a new tab)

  20. Enhancing Parallelization of Agent-based Graph Computing

    … computing frameworks, such as Apache Spark and Hadoop MapReduce, are effective for large-scale data processing but are not always well suited for graph computation. The MASS (Multi-Agent Spatial Simulation) Java library instead provides an agent-based approach to distributed graph computation …

    washington Repository record for Enhancing Parallelization of Agent-based Graph Computing (opens in a new tab)

Page 1 of 3