Spelling suggestions: "subject:"hadoop anda MMR(MPI based mapereduce)"" "subject:"hadoop anda MMR(MPI based hmapreduce)""
1 |
An Efficient Platform for Large-Scale MapReduce ProcessingWang, Liqiang 15 May 2009 (has links)
In this thesis we proposed and implemented the MMR, a new and open-source MapRe- duce model with MPI for parallel and distributed programing. MMR combines Pthreads, MPI and the Google's MapReduce processing model to support multi-threaded as well as dis- tributed parallelism. Experiments show that our model signi cantly outperforms the leading open-source solution, Hadoop. It demonstrates linear scaling for CPU-intensive processing and even super-linear scaling for indexing-related workloads. In addition, we designed a MMR live DVD which facilitates the automatic installation and con guration of a Linux cluster with integrated MMR library which enables the development and execution of MMR applications.
|
Page generated in 0.0638 seconds