Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 42 for “"Large-scale data processing"”.
-
Robust Algorithms for Compact Representations in Large-Scale Data Processing
<p>Compact representations are a central tool in large-scale data processing. They replace large datasets or complex problem instances with smaller, structure-preserving proxies. Their effectiveness, however, depends on the quality of the information underlying them. In practice, this information …
-
Software for supporting large scale data processing for High Throughput Screening
High Throughput Screening for is a valuable data generation technique for data driven knowledge discovery. Because the rate of data generation is so great, it is a challenge to cope with the demands of post experiment data analysis. This thesis presents three software solutions that I implemented …
-
Parallel Algorithms for Processing Massive Texts and Graphs
… space is an inevitable scenario when the input data does not fit in the memory of available systems. In recent years, with the abundance of data and the increasing demand for large scale data processing, the size of datasets easily surpasses that of the typical machine’s memory. Examples of the …
-
Systems abstractions for big data processing on a single machine
Large-scale internet services, such as Facebook or Google, are using clusters of many servers for problems such as search, machine learning, and social networks. However, while it may be possible to apply the tools used at this scale to smaller, more common problems as well, this dissertation …
-
Performance study of an implementation of the push-relabel maximum flow algorithm in Apache Spark's GraphX, A
… Apache Spark, a fast and generalized engine for large-scale data processing in the cloud. While the popularity of Spark and GraphX is growing, the relatively young technology has yet to explore the breadth of graph problems that exist in the field. In order to examine and gain insights into the …
-
High-performance simulation of interacting multiparticle quantum walks with Apache Spark
… of computational resources due to the amount of data growing exponentially with the instance sizes and, thus, high performance computing techniques are necessary. Multiparticle quantum walks have been receiving a great deal of attention recently as a tool for designing quantum algorithms and for …
-
Towards a Reference Architecture with Modular Design for Large-scale Genotyping and Phenotyping Data Analysis: A Case Study with Image Data
… with the base system over time. Moreover, large scale data need to be processed within the time-line for more effective analysis. Recently, Big Data technologies are emerging for facilitating large scale data processing with commodity hardware. Among the above-mentioned systems, GenAp is …
-
Supporting Efficient Database Processing in Mapreduce
… industry and as a successful paradigm for web-scale application deployment. However, due to the heterogeneity and massiveness nature of data in the Cloud, current Cloud systems trade rigorous data management functionalities for better versatility and scalability. The overarching goal of this …
-
Program synthesis for distributed computing : translating sequential programs to distributed programs with automated test generation.
With the growing demand for large-scale data processing, distributed computing has become an essential paradigm, allowing complex tasks to be handled across multiple computational nodes. However, transitioning from sequential to distributed programming presents significant challenges, such as the …
-
Thin client collaborative visualizations using the distributed cloud
… a collaborative visualization system that models large data sets in thin clients using the Lively Web development environment. A thin client is a computing device with light resources, depending heavily on remote computational resources for any large scale data processing. A thin client could be a …
-
GoldBI: uma solução de Business Intelligence como serviço
… techniques (extract, transform, load) and Big Data technologies, with the intention of facilitating decentralized extraction and data processing in large quantities. Currently, it appears that it is practically impossible conduct a consistent analysis without the aid of a software for reporting …
-
Enhancing Parallelization of Agent-based Graph Computing
The demand for distributed data processing grows as modern applications involve increasingly large and complex datasets. Traditional distributed computing frameworks, such as Apache Spark and Hadoop MapReduce, are effective for large-scale data processing but are not always well suited for graph …
-
Logistic regression of large scale data using distributed processing algorithm
… as logistic regression, are designed to analyze data from a single source. Applying existing statistical methods to a distributed research network (DRN) creates the opportunity to conduct research using data from multiple organizations. The use of distributed data has been explored in previous …
-
Greedy Matching Algorithms in Semi-Streaming Environments for Large Bipartite Graphs
… problem become computationally challenging for large-scale graphs due to the high memory and time demands of optimal algorithms. This thesis investigates the viability of greedy matching algorithms within a semi-streaming environment as a practical approach for such scenarios. Several variations …
-
Performance modeling framework for SLO-driven MapReduce environments
… are increasingly using MapReduce for efficient large scale data processing such as personalized advertising, spam detection, and data mining tasks. There is a growing need among MapReduce users to achieve different Service Level Objectives (SLOs). Often, applications need to complete data …
-
Distributed large-scale data storage and processing
… and the way that we store and process massive data-sets. Reliable large-scale data storage: Distributed storage systems for large clusters typically use replication to provide reliability. Recently, erasure codes have been used to reduce the large storage overhead of three-replicated systems. …
-
Concentric Layout, A New Scientific Data Layout For Matrix Data Set In Hadoop File System
The data generated by scientific simulation, sensor, monitor or optical telescope has increased with dramatic speed. In order to analyze the raw data speed and space efficiently, data preprocess operation is needed to achieve better performance in data analysis phase. Current research shows an …
-
Comparative Performance and Scalability Analysis of GPUaccelerated Database Operations
… thesis investigates the performance dynamics of database operations - V-Search, Fuzzy Search, and Join - implemented on both Central Processing Units (CPU) and Graphics Processing Units (GPU). With the ever-increasing demand for efficient data processing, it has become crucial to understand and …
-
Prediction of land cover in continental United States using machine learning techniques
… studying changes in the land use patterns at a large scale. With advent of satellite images and remote sensing technologies, land cover classification has become easier and more reliable. In contrast to the conventional land cover classification methods that make use of land and aerial …
Page 1 of 3