Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 30 for “"Distributed stream processing"”.
-
Scalable and adaptable distributed stream processing
Data stream processing has a wide applicability, ranging from computer network management to financial monitoring to environment monitoring through sensor network. This thesis examines the design of a large scale distributed stream processing system, COSMOS (Cooperative and Self-tuning Management …
-
TOWARDS LATENCY GUARANTEE FOR DISTRIBUTED STREAM PROCESSING
… time-sensitive applications demand low-latency Stream Processing Engines (SPEs). Guaranteeing latency is vital for QoS so streaming jobs meet benchmarks under dynamic workloads, yet scaling to balance latency, throughput, and resource efficiency is hard. This thesis presents StreamSwitch and …
-
Efficient Distributed Stream Processing: Optimization Approaches and Applications
… type of technology that allows us to do this: Distributed Stream Processing Systems (DSPS) are systems consisting of many computers that jointly process, and hence extract value from, large amounts of data at high speeds. This dissertation consists of three research projects that investigate …
-
A benchmark suite for distributed stream processing systems
… characterized by the continuous and low-latency processing of large volumes of data has been gaining attention. The growing number of applications of such genre has led to the creation of Stream Processing Systems (SPSs), systems that abstract the details of real-time applications from the …
-
Prediction based scaling in a distributed stream processing cluster
… arriving voluminous data. To provide real-time processing capabilities over streaming data, distributed stream processing engines (DSPEs) such as Apache STORM and Apache FLINK have been widely deployed. These frameworks support computations over large-scale, high frequency streaming data. …
-
Dynamic Load Balancing and Autoscaling in Distributed Stream Processing Systems
In big data world, Hadoop and other batch-processing tools are widely used to analyze data and get results in minutes. However, minutes of latency still cannot satisfy the proliferated needs for real-time decision in many fields such as live stock and trading feeds in financial services, …
-
Edge-distributed stream processing for video analytics in smart city applications
… Internet of Things (IoT) applications based on distributed sensors and machine intelligence, especially in smart cities, present many challenges for network and processing infrastructure. For example, a single system with a few dozen monitoring cameras is sufficient to saturate the city’s …
-
EdgeDAG: a latency-aware initial operator placement strategy for edge-based distributed stream processing applications
… the data generated by IoT devices has increased. Processing applications can provide valuable information and it can reduce the amount of data passed to the cloud. The critical goal of these applications is to provide low latency results. Stream processing can facilitate the processing by offering …
-
Elastic edge-based stream processing over Apache Storm
Apache Storm is a distributed stream processing framework designed to handle continuous data flows, yet its elasticity remains limited when components are deployed across heterogeneous nodes and incoming data rates vary over time. Existing work on Apache Storm does not adequately address how …
-
Scalability Benchmarking of Cloud-Native Applications Applied to Event-Driven Microservices
… type of cloud-native applications that employ distributed stream processing frameworks to scale with massive data volumes. Extensive experimental evaluations benchmark and compare the scalability of various stream processing frameworks under different configurations and deployments, including …
-
Towards an internet-scale stream processing service with loosely-coupled entities
Stream processing engines are application-independent, specially designed query engines to process high-volume, real-time data streams. In recent year, many stream processing engines have been developed and employed by business entities to provide stream processing service over the internet. …
-
Priority-Based Scheduling Techniques for a Multitenant Stream Processing Platform
Apache Storm is a distributed stream processing system which is heavily used by the key players in the industry including YAHOO and Twitter. An application running in Storm is called a topology that is characterized by a Directed Acyclic Graph. Isolation Scheduler, the default scheduler for a …
-
Exactly-once semantics for recoverable data processing applications
… for ensuring the correctness of recoverable data processing applications. This dissertation examines two distributed data processing systems: Impeller and Lupin. Impeller is a distributed stream processing system that processes stream records stored in shared logs. It employs an efficient protocol …
-
Towards federated learning over large-scale streaming data
Distributed Stream Processing Engines (DSPEs) have seen significant deployment growth along with an increase in streaming data sources such as sensor networks. These DSPEs enable processing large amounts of streaming data in a cluster of commodity machines to extract knowledge and insights in …
-
Safe Programming Over Distributed Streams
The sheer scale of today's data processing needs has led to a new paradigm of software systems centered around requirements for high-throughput, distributed, low-latency computation.Despite their widespread adoption, existing solutions have yet to provide a programming model with safe semantics -- …
-
Achieving high-throughput distributed, graph-based multi-stage stream processing
Processing complex computations on high volume streaming data in real time is a challenge for many organizational data processing systems. Such systems should produce results with low latency while processing billions of messages daily. In order to address these requirements distributed stream …
-
Adaptive batching of streams to enhance throughput and to support dynamic load balancing
… and increase revenue. This need for real-time processing of big data has led to the development of frameworks for distributed stream processing in clusters. It is important for such frameworks to be resilient against variable operating conditions such as server load variation, changes in data …
-
Deterministic, elastic and real - time processing in the big data era
… to healthcareinfrastructures and financial processing. In order to processefficiently such high volume of data, novel distributed big dataframeworks such as Apache Storm and Apache Spark have been proposed.Such systems offer scalable and low latency data processing bydistributing the …
Page 1 of 2