Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 54 for “"Hadoop MapReduce"”.
-
Hadoop MapReduce for Mobile Cloud
… systems for big data storage and processing. Hadoop is a scalable platform that provides distributed storage and computational capabilities on clusters of commodity hardware. Building Hadoop on a mobile net- work enables the devices to run data intensive computing applications without direct …
-
Parallelization of Particle Swarm Optimization Algorithm Using Hadoop Mapreduce
… two different parallelization techniques using MapReduce programming, 1) all nodes in the cluster work on the same population, and 2) each node in cluster has its own population. Both of the parallel implementations are compared based on performance and speedup. Parallel implementation of the …
-
Sharing the love : a generic socket API for Hadoop Mapreduce
Hadoop is a popular software framework written in Java that performs data-intensive distributed computations on a cluster. It includes Hadoop MapReduce and the Hadoop Distributed File System (HDFS). HDFS has known scalability limitations due to its single NameNode which holds the entire file system …
-
Fusion-based Hadoop MapReduce job for fault tolerance in distributed systems
Standard recovery solution on a failed task in Hadoop systems is to execute the task again. After retrying for a configured number of times, it is marked as failure. With significant amount of data, complicated Map and Reduce functions, recovering corrupted or unfinished data from a failed job can …
-
An Ensemble Method for Large Scale Machine Learning with Hadoop MapReduce
… Parallelized-Meta-Learning (PML) using the MapReduce programming paradigm on Hadoop. The experimental results on the Amazon EC2 cloud computing infrastructure show that PML reduces the computation complexity enormously while retaining lower error rates than the results on a single computer. …
-
A Scheduling Algorithm for Hadoop MapReduce Workflows with Budget Constraints in the Heterogeneous Cloud
… For our research, we consider the popular Apache Hadoop framework for scheduling workflows onto resources rented from cloud service providers. Investigated in our work is budget-constrained workflow scheduling on the Hadoop MapReduce platform, wherein we devise both an optimal and a heuristic …
-
Towards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital system
… BDA platform of hospital system. Methods: A Hadoop/MapReduce framework formed the BDA platform with HBase (NoSQL database) using hospital-specific metadata and file ingestion. Query performance tested with Apache tools in Hadoop’s ecosystem. Results: At optimized iteration, Hadoop distributed …
-
Optimized Runtime Systems for MapReduce Applications in Multi-core Clusters
… proposes a novel runtime system, Habanero Hadoop, to tackle the inefficient utilization of multi-core machines' memory in the existing Hadoop MapReduce runtime system. Insufficient memory for each map task leads to the inability to tackle large-scale problems such as genome sequencing and …
-
Application-Aware Network Design Using Software Defined Networking for Application Performance Optimization for Big Data and Video Streaming
… For applications, we consider two classes: Hadoop MapReduce and video streaming. The Hadoop MapReduce (M/R) framework has become the de facto standard for Big Data analytics. However, the lack of network-awareness of the default MapReduce resource manager in a traditional IP network can …
-
Enumerating K-Cliques in a Large Network Using Apache Spark
… on distributed clusters of machines using the Hadoop mapreduce framework. However, the solution suffers from a general limitation of the framework, as Hadoop's mapreduce performs substantial amounts of reading and writing to disk. Thus, the running times of Hadoop-based approaches suffer …
-
Applying data mining techniques over big data
… algorithms to the Big Data algorithms by using Hadoop/MapReduce as a core implementation of Big Data for scalable algorithms. We implemented the K-means algorithm and A-priori algorithm with Hadoop/MapReduce on a 5 nodes Hadoop cluster. We explore NoSQL databases for semi-structured, massively …
-
Performance models for parallel applications under failures
… of the dissertation evaluates the performance of Hadoop MapReduce applications, with different execution parameters and under different failure scenarios. The dissertation introduces performance models for Hadoop MapReduce applications considering node and process failures. Having a performance …
-
Towards a Multi-layer Architecture for IoT-based Streaming Big Data Applications
… as a single-tier architecture that uses Hadoop MapReduce distributed processing engine deployed on a cluster of low-cost commodity computers, is then implemented for handling big data processing. Experiments with a real-life smart parking application show the efficiency and scalability of …
-
ANONYMOUS ROUTING FOR PRIVACY-PRESERVING DISTRIBUTED COMPUTING
… appli- cations written in the popular MapReduce framework and Spark on an untrusted cloud. We design and implement our solution to add a mix phase/stage to enhance the existing Hadoop MapReduce and Spark framework. The evaluation shows it is feasible to run Spark jobs in our design with …
-
A distributed approach to Frequent Itemset Mining at low support levels
… scale to hundreds of cores, on a standard Hadoop MapReduce cluster, and can improve executions times by at least an order of magnitude at the lowest support levels.
-
ACCELERATING DATA-INTENSIVE COMPUTATIONS THROUGH DYNAMIC NETWORK TRAFFIC OPTIMIZATION
Hadoop has been emerging as a popular distributed framework for data intensive computing in clustered environments. The main usage has been in parallel computing problems where interconnected clusters would transfer parts of the data between individual compute nodes to accomplish one job. The …
-
Improving Energy-Efficiency through Smart Data Placement in Hadoop Clusters
Hadoop, a pioneering open source framework, has revolutionized the big data world because of its ability to process vast amounts of unstructured and semi-structured data. This ability makes Hadoop the ‘go-to’ technology for many industries that generate big data, thus it also aids in being cost …
-
Efficient Ranking And Selection In Parallel Computing Environments
… namely the Message-Passing Interface (MPI), Hadoop MapReduce, and Apache Spark, and show that MPI performs the best while Spark provides good protection against core failures at the expense of a moderate drop in core utilization.
-
Phurti: application and network-aware flow scheduling for MapReduce
Traffic for a typical MapReduce job in a datacenter consists of multiple network flows. Traditionally, network resources have been allocated to optimize network-level metrics such as flow completion time or throughput. Some recent schemes propose using application-aware scheduling which can reduce …
-
Enhancing Parallelization of Agent-based Graph Computing
… computing frameworks, such as Apache Spark and Hadoop MapReduce, are effective for large-scale data processing but are not always well suited for graph computation. The MASS (Multi-Agent Spatial Simulation) Java library instead provides an agent-based approach to distributed graph computation …
Page 1 of 3