Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 177 for “"Apache Spark"”.

  1. Distributed linear programming with Apache Spark

    … interior point algorithm on top of Apache Spark for solving large-scale linear programming problems. Our large-scale solver (Spark-LP) is unique because it is open-source, fault-tolerant and can be used on commodity cluster of machines. As a result, Spark-LP provides an opportunity …

    ubc Repository record for Distributed linear programming with Apache Spark (opens in a new tab) Download PDF for Distributed linear programming with Apache Spark (opens in a new tab)

  2. K-Anonymization Implementation Using Apache Spark

    … L-diversity and t-closeness solutions for Apache spark using Java. In the era of volumes of data, science needs more scalable and efficient methods to overcome data leakage, where there is information like public health, diagnosis, sensitive information like name, zip, race, education which …

    ndsu Repository record for K-Anonymization Implementation Using Apache Spark (opens in a new tab)

  3. Performance Comparison of Apache Spark MLlib

    … an attempt to understand the performance of Apache Spark and the MLlib platform. To this end, the cluster computing system of Apache Spark is set up and five supervised machine learning algorithms (Naïve-Bayes, Decision Tree, Random Forest, Support Vector Machine and Logistic Regression) were …

    ndsu Repository record for Performance Comparison of Apache Spark MLlib (opens in a new tab)

  4. Assessing Apache Spark Streaming with Scientific Data

    … come short when results are needed on the fly. Apache Spark's streaming library is increasingly becoming a popular choice as it can stream and analyze a significant amount of data. To showcase and assess the ability of Spark various metrics were designed and operated using data collected from …

    uno Repository record for Assessing Apache Spark Streaming with Scientific Data (opens in a new tab)

  5. Distributed multi-label learning on Apache Spark

    … and feature selection implemented on the Apache Spark distributed computing model. Five approaches for determining the optimal architecture to speed up multi-label learning methods are presented. These approaches range from local parallelization using threads to distributed computing using …

    vcu Repository record for Distributed multi-label learning on Apache Spark (opens in a new tab)

  6. Distributed graph decomposition algorithms on Apache Spark

    … this paper, we propose distributed algorithms on Apache Spark for k-truss and k-core decomposition of a graph. We also compare the performance of our algorithm with state-of-the-art Map-Reduce and parallel algorithms using openly available real world network data. Our proposed algorithms have …

    iupui Repository record for Distributed graph decomposition algorithms on Apache Spark (opens in a new tab)

  7. Parallel SPARQL Query Execution using Apache Spark

    … of cluster computing. Big data ecosystems like Apache Spark provide new opportunities for designing scalable RDF indexing and query processing techniques. In this thesis, we present new ideas on storing, indexing, and query processing of RDF datasets with billions of RDF statements. In our …

    umkc Repository record for Parallel SPARQL Query Execution using Apache Spark (opens in a new tab)

  8. Zpracování síťové komunikace v prostředí Apache Spark

    … komunikácie v prostredí distribuovaného systému Apache Spark. Implementáciu je možné rozdeliť do troch častí. Prvou je načítanie dát z distribuovaného úložiska HDFS, druhou analýza podporovaných sieťových protokolov a treťou distribuované vyhodnotenie výsledkov. Po vyhodnotení sú výstupy …

    brno-tech Repository record for Zpracování síťové komunikace v prostředí Apache Spark (opens in a new tab)

  9. Exploration of fault tolerance in Apache Spark

    … solving fault tolerance for batch processing in Apache Spark. We evaluate the benefits and challenges of these approaches. Apache Spark is a cluster computing system comprised of three main components: the driver program, the cluster manager, and the worker nodes. Spark already tolerates the loss …

    uiuc Repository record for Exploration of fault tolerance in Apache Spark (opens in a new tab)

  10. Escalonador distribuído de tarefas para o Apache Spark

    … of a share of the scheduling load. We use Apache Spark for implementing a version of the hierarchical distributed task scheduler and to perform comparative experiments for testing the proposal scalability. Using 32 computational nodes, results show our proof of concept maintains execution …

    brazil-uerj Repository record for Escalonador distribuído de tarefas para o Apache Spark (opens in a new tab)

  11. Přenesení extraktorů nástroje Plaso na platformu Apache Spark

    … Plaso nástroja pre forenznú analýzu na platformu Apache Spark. Teoretická časť rozoberá fungovanie a architektúru Plaso nástroja. Práca ďalej skúma aktuálne nástroje, ktoré implementujú distribuované výpočtové modely. Popisuje ich architektúru, dátové abstrakty a spôsob ich fungovanie. Taktiež sú …

    brno-tech Repository record for Přenesení extraktorů nástroje Plaso na platformu Apache Spark (opens in a new tab)

  12. A Distributed Approach to EpiFast using Apache Spark

    … and provides two different implementations: Spark-EpiFast based on the Apache Spark big data processing engine and Charm-EpiFast based on the Charm++ parallel programming framework. The study focuses on exploiting features of both systems that we believe could potentially benefit in terms of …

    vt Repository record for A Distributed Approach to EpiFast using Apache Spark (opens in a new tab)

  13. OCTWAS - Online Check-pointer for Workflows on Apache Spark

    … data, are run on many engines, one of which is Apache Spark. Apache Spark is a fast and efficient in-memory parallel-processing software framework. By retaining the data in memory, it speeds up the execution of a wide variety of applications. It maintains fault-tolerance by storing information …

    queens Repository record for OCTWAS - Online Check-pointer for Workflows on Apache Spark (opens in a new tab)

  14. MsSpark: Implementation of Molecular Simulation Queries Using Apache Spark

    … we have tried an alternate approach that uses Apache Spark- a modern big data platform – to parallelize the computation of analytical queries. MsSpark consists of three layers: Apache Spark layer, MS RDD layer and MS Query Processing layer. MS RDD layers supports data that is specific to …

    usf Repository record for MsSpark: Implementation of Molecular Simulation Queries Using Apache Spark (opens in a new tab)

  15. Learning from Multi-Class Imbalanced Big Data with Apache Spark

    … of machine learning algorithms using Apache Spark, a distributed computing framework based on the MapReduce model designed to handle very large datasets. Experimentation showed that many of the traditional classifier algorithms do not translate well to a distributed computing …

    vcu Repository record for Learning from Multi-Class Imbalanced Big Data with Apache Spark (opens in a new tab)

  16. Enumerating K-Cliques in a Large Network Using Apache Spark

    … e cient, scalable, and distributed solution, kc-spark , for enumerating cliques in real-life networks using the Apache Spark in-memory cluster computing framework. Experiment results show that kc-spark can enumerate k-cliques from very large real-life networks, whereas a single commodity machine …

    iupui Repository record for Enumerating K-Cliques in a Large Network Using Apache Spark (opens in a new tab)

  17. EFFICIENT REPRESENTATION AND ANALYSIS OF LARGE MESHES USING APACHE SPARK

    … efficiently. This dissertation investigates how Apache Spark can serve as a high-level distributed environment for the scalable representation and topological analysis of very large meshes. It introduces compact distributed data representations for large meshes, develops scalable algorithms for …

    maryland Repository record for EFFICIENT REPRESENTATION AND ANALYSIS OF LARGE MESHES USING APACHE SPARK (opens in a new tab)

  18. Data analytics with mapreduce in apache spark and hadoop systems

    MapReduce comes from a traditional problem solving method: separating a big problem and solving each small parts. With the target of computing larger dataset in more efficient and cheaper way, this is implement into a programming mode to deal with massive quantity of data. The users get a map …

    njit Repository record for Data analytics with mapreduce in apache spark and hadoop systems (opens in a new tab)

  19. Performance Evaluation of Job Scheduling and Resource Allocation in Apache Spark

    … Data processing on distributed systems such as Apache Spark are gaining popularity in recent years. Apache Spark is a widely used in-memory framework for distributed processing of large datasets on a cluster of inexpensive computers. This thesis proposes using Spark for distributed processing of …

    sask Repository record for Performance Evaluation of Job Scheduling and Resource Allocation in Apache Spark (opens in a new tab)

  20. High-performance simulation of interacting multiparticle quantum walks with Apache Spark

    … phenomena. In the present work, we show that Apache Spark, a framework for large-scale data processing, can be used to simulate quantum walks with multiple interacting particles, with instance sizes that are impractical on single-processor, general-purpose computers. We also provide a …

    brazil-uerj Repository record for High-performance simulation of interacting multiparticle quantum walks with Apache Spark (opens in a new tab)

Page 1 of 9