Back to search

University of North Florida. School of Computing

Performance Evaluation of LINQ to HPC and Hadoop for Big Data

Abstract

dc:description.abstract

There is currently considerable enthusiasm around the MapReduce paradigm, and the distributed computing paradigm for analysis of large volumes of data. The Apache Hadoop is the most popular open source implementation of MapReduce model and LINQ to HPC is Microsoft's alternative to open source Hadoop. In this thesis, the performance of LINQ to HPC and Hadoop are compared using different benchmarks. To this end, we identified four benchmarks (Grep, Word Count, Read and Write) that we have run on LINQ to HPC as well as on Hadoop. For each benchmark, we measured each system’s performance metrics (Execution Time, Average CPU utilization and Average Memory utilization) for various degrees of parallelism on clusters of different sizes. Results revealed some interesting trade-offs. For example, LINQ to HPC performed better on three out of the four benchmarks (Grep, Read and Write), whereas Hadoop performed better on the Word Count benchmark. While more research that is extensive has focused on Hadoop, there are not many references to similar research on the LINQ to HPC platform, which is slowly evolving during the writing of this thesis.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Computer and Information Sciences (MS)
Discipline thesis:degree_discipline
Computing
Grantor dc:publisher
University of North Florida. School of Computing
Date dc:date.issued
Summer

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Sivasubramaniam, Ravishankar
  • Sivasubramaniam, Ravishankar, 1982-
Advisors dc:contributor.advisor
  • Elfayoumy, Sherif
  • Eggen, Roger
  • Ahuja, Sanjay P.
Contributors dc:contributor
  • Dr. Sherif Elfayoumy
  • Dr. Roger Eggen
  • Dr. Sanjay P. Ahuja

Subjects

dc:subject × 8

Rights

dc:rights

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.unf.edu/etd/463

Chain of custody

source
Harvested from
University of North Florida
Base URL
digitalcommons.unf.edu/do/oai/
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Sivasubramaniam, Ravishankar; Sivasubramaniam, Ravishankar, 1982-. Performance Evaluation of LINQ to HPC and Hadoop for Big Data. University of North Florida. School of Computing, https://digitalcommons.unf.edu/etd/463