University of North Florida. School of Computing
Performance Evaluation of LINQ to HPC and Hadoop for Big Data
Abstract
dc:description.abstractThere is currently considerable enthusiasm around the MapReduce paradigm, and the distributed computing paradigm for analysis of large volumes of data. The Apache Hadoop is the most popular open source implementation of MapReduce model and LINQ to HPC is Microsoft's alternative to open source Hadoop. In this thesis, the performance of LINQ to HPC and Hadoop are compared using different benchmarks. To this end, we identified four benchmarks (Grep, Word Count, Read and Write) that we have run on LINQ to HPC as well as on Hadoop. For each benchmark, we measured each system’s performance metrics (Execution Time, Average CPU utilization and Average Memory utilization) for various degrees of parallelism on clusters of different sizes. Results revealed some interesting trade-offs. For example, LINQ to HPC performed better on three out of the four benchmarks (Grep, Read and Write), whereas Hadoop performed better on the Word Count benchmark. While more research that is extensive has focused on Hadoop, there are not many references to similar research on the LINQ to HPC platform, which is slowly evolving during the writing of this thesis.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Computer and Information Sciences (MS)
- Discipline thesis:degree_discipline
- Computing
- Grantor dc:publisher
- University of North Florida. School of Computing
- Date dc:date.issued
- Summer
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Sivasubramaniam, Ravishankar
- Sivasubramaniam, Ravishankar, 1982-
- Advisors dc:contributor.advisor
-
- Elfayoumy, Sherif
- Eggen, Roger
- Ahuja, Sanjay P.
- Contributors dc:contributor
-
- Dr. Sherif Elfayoumy
- Dr. Roger Eggen
- Dr. Sanjay P. Ahuja
Subjects
dc:subject × 8- Thesis; University of North Florida; UNF; Dissertations
- Academic -- UNF -- Master of Science in Computer and Information Sciences; Dissertations
- Academic -- UNF -- Computing; performance; LINQ; HPC; Hadoop
- Computer and Systems Architecture
- Computer Engineering
- Data Storage Systems
- Other Computer Engineering
- Information storage and retrieval systems -- Testing; Query languages (Computer science) -- Testing; High performance computing -- Testing; Computer storage devices -- Testing
Rights
dc:rightsIdentifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.unf.edu/etd/463