Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 240 for “"Massive data"”.
-
FlashX: Massive Data Analysis Using Fast I/O
With the explosion of data and the increasing complexity of data analysis, large-scale data analysis imposes significant challenges in systems design. While current research focuses on scaling out to large clusters, these scale-out solutions introduce a significant amount of overhead. This thesis …
-
Practical methods for data mining with massive data sets
The increasing size of data sets has necessitated advancement in exploratory techniques. Methods that are practical for moderate to small data sets become infeasible when applied to massive data sets. Advanced techniques such as binned kernel density estimation, tours, and mode-based projection …
-
Functional testing techniques for new massive data processing paradigms
Los programas Big Data son aquellos que analizan información utilizando nuevos modelos de procesamiento que superan las limitaciones de la tecnología tradicional en cuanto al volumen, velocidad y variedad de los datos procesados. Entre estos, se destaca MapReduce que permite procesar grandes …
-
Algorithm design on multicore processors for massive-data analysis
Analyzing massive-data sets and streams is computationally very challenging. Data sets in systems biology, network analysis and security use network abstraction to construct large-scale graphs. Graph algorithms such as traversal and search are memory-intensive and typically require very little …
-
Joint Feature Screening and Subsampling in Analysis of Massive Data
… scientific research, collecting large amounts of data has become increasingly prevalent. For example, in genomics, there have been more than 500, 000 microarrays that are publicly available with each array containing tens of thousands of expression values of molecules; In biomedical engineering, …
-
Massive data visualization based on dimensionality reduction and projection error evaluation /
… thesis two ways to evaluate projection error for massive data sets are proposed. One of them is based on building the sample of the data set, the second one on dividing the data set into the smaller data sets. Both proposed ways of projection error evaluation are suitable for massive data sets and …
-
Massive data K-means clustering and bootstrapping via A-optimal Subsampling
For massive data analysis, the computational bottlenecks exist in two ways. Firstly, the data could be too large that it is not easy to store and read. Secondly, the computation time could be too long. To tackle these problems, parallel computing algorithms like Divide-and-Conquer were proposed, …
-
Topics in statistical inference for massive data and high-dimensional data
… problems in statistics concerning high-volume datasets. The first paper studies the distributed statistical inference for massive data. With the increasing size of the data, computational complexity and feasibility should be taken into consideration for statistical analyses. We investigate the …
-
The Applications of Workload Characterization in The World of Massive Data Storage
… at different levels. New storage media and data recording technologies such as shingled magnetic recording (SMR) are also developed to increase the storage capacity. This work focuses on improving existing technologies and designing new schemes based on I/O workload characterizations in …
-
Large-Scale Nonparametric and Semiparametric Inference for Large, Complex, and Noisy Datasets
Massive Data bring new opportunities and challenges to data scientists and statisticians. On one hand, Massive Data hold great promises for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. On the other hand, the size and dimensionality of …
-
Dimensijų mažinimu pagrįstas didelės apimties duomenų vizualizavimas ir projekcijos paklaidos vertinimas /
… thesis two ways to evaluate projection error for massive data sets are proposed. One of them is based on building the sample of the data set, the second one on dividing the data set into the smaller data sets. Both proposed ways of projection error evaluation are suitable for massive data sets and …
-
Modern Anomaly Detection: Benchmarking, Scalability and a Novel Approach
… detecting the most unusual elements in a data set. Anomaly detection applications emerge in domains such as computer security, system monitoring, fault detection, and wireless sensor networks. The strategic importance of detecting anomalies in these domains makes anomaly detection a …
-
Robust Uncertainty Quantification and Scalable Computation for Computer Models with Massive Output
… provide statistical models that are scalable to massive data produced in computer experiments and real experiments, through fast and robust statistical inference.</p><p>Chapter 2 provides a practical approach for simultaneously emulating/approximating massive number of functions, with the …
-
Distributed large-scale data storage and processing
… systems and the way that we store and process massive data-sets. Reliable large-scale data storage: Distributed storage systems for large clusters typically use replication to provide reliability. Recently, erasure codes have been used to reduce the large storage overhead of three-replicated …
-
SCALABLE ALGORITHMS FOR HIGH DIMENSIONAL STRUCTURED DATA
… provide us with increasingly large volume of data with respect to both the sample size and the number of features. To explore the benefits of massive data sets, scalable statistical models and machine learning algorithms are more and more important in different research disciplines. For robust …
-
Some Problems in Veterinary Medicine Disease Mapping
… heartworm and anaplasmosis. Specifically, a massive data set obtained from the Companion Animal Parasite Council (CAPC) is analyzed to help describe these two diseases. The data sets consist of the number of positive tests and the total number of tests performed on a county-by-county basis in …
-
Network compression via network memory: fundamental performance limits
… inference, and communication mechanisms for this massive data. This Ph.D. dissertation draws upon mathematical tools from information theory and statistics to understand the fundamental performance limits of universal compression of this massive data at the packet level using universal compression …
-
Towards end-to-end reference-free summarization evaluation via negative sampling
… of reference summaries. By negative sampling, massive data in existing summarization datasets are transformed for training by pairing documents with corrupted reference summaries. Two learning schemes are explored: weakly supervised learning with explicit number labels and preference learning …
-
Statistical Aggregation: Theory and Applications
Due to their size and complexity, massive data sets bring many computational challenges for statistical analysis, such as overcoming the memory limitation and improving computational efficiency of traditional statistical methods. In the dissertation, I propose the statistical aggregation strategy …
-
Edge-distributed stream processing for video analytics in smart city applications
… the city’s backbone. Such a system generates massive data streams for event-based applications that require rapid processing for immediate actions. Finding a missing person using facial recognition technology is one of those applications that require immediate action at the location where that …
Page 1 of 12