• Refine Query
  • Source
  • Publication year
  • to
  • Language
  • 20
  • 19
  • 4
  • 3
  • 2
  • 1
  • Tagged with
  • 65
  • 65
  • 28
  • 19
  • 18
  • 15
  • 15
  • 13
  • 13
  • 12
  • 12
  • 11
  • 11
  • 10
  • 10
  • About
  • The Global ETD Search service is a free service for researchers to find electronic theses and dissertations. This service is provided by the Networked Digital Library of Theses and Dissertations.
    Our metadata is collected from universities around the world. If you manage a university/consortium/country archive and want to be added, details can be found on the NDLTD website.
11

A Dynamic Attribute-Based Load Shedding and Data Recovery Scheme for Data Stream Management Systems

Ahuja, Amit 29 June 2006 (has links) (PDF)
Data streams being transmitted over a network channel with capacity less than the data rate of the data streams is very common when using network channels such as dial-up, low bandwidth wireless links. Not only does this lower capacity creates delays but also causes sequential network problems such as packet losses, network congestion, errors in data packets giving rise to other problems and creating a cycle of problems hard to break out from. In this thesis, we present a new approach for shedding the less informative attribute data from a data stream with a fixed schema to maintain a data rate lesser than the network channels capacity. A scheme for shedding attributes, instead of tuples, becomes imperative in stream data where the data for one of the attributes remains relatively constant or changes less frequently compared to the data for the other attributes. In such a data stream management system, shedding a complete tuple would lead to shedding of some informative-attribute data along with the less informative-attribute data in the tuple, whereas shedding of the less informative-attribute data would cause only the less informative data to be dropped. In this thesis, we deal with two major problems in load shedding: the intra-stream load shedding and the inter-stream load shedding problems. The intra-stream load shedding problem deals with shedding of the less informative attributes when a single data stream with the data rate greater than the channel capacity has to be transmitted to the destination over the channel. The inter-stream load shedding problem refers to shedding of attributes among different streams when more than one stream has to be transferred to the destination over a channel with the channel capacity less than the combined data rate of all the streams to be transmitted. As a solution to the inter-stream or intra-stream load shedding problem, we apply our load shedding schema approach to determine a ranking amongst the attributes on a singe data stream or multiple data streams with the least informative attribute(s) being ranked the highest. The amount of data to be shed to maintain the data rate below the capacity is calculated dynamically, which means that the amount of data to be shed changes with any change in the channel capacity or any change in the data rate. Using these two pieces of information, a load shedding schema describing the attributes to be shed is generated. The load shedding schema is generated dynamically, which means that the load shedding schema is updated with any change in (i) the rankings of attributes that capture the rate of change on the values of each attribute, (ii) channel capacity, and (iii) data rate even after load shedding has been invoked. The load shedding schema is updated using our load shedding schema re-evaluation algorithm, which adapts to the data stream characteristics and follows the attribute data variation curve of the data stream. Since data dropped at the source may be of interest to the user at the destination, we also propose a recovery module which can be invoked to recover attribute data already shed. The recovery module maintains the minimal amount of information about data already shed for recovery purpose. Preliminary experimental results have shown that recovery accuracy ranges from 90% to 99%, which requires only 5% to 33% and 4.88% to 50% of the dropped data to be stored for weather reports and stock exchanges, respectively. Storing of recovery information imposes storage and processing burden on the source site, and our recovery method aims at satisfactory recovery accuracy while imposing minimal burden on the source site. Our load shedding approach, which achieves a high performance in reducing the data stream load, (i) handles wide range of data streams in different application domains (such as weather, stocks, and network performance, etc.), (ii) is dynamic in nature, which means that the load shedding scheme adjusts the amount of data to be shed and which attribute data to be shed according to the current load and network capacity, and (iii) provides a data recovery mechanism that is capable to recover any shedded attribute data with recovery accuracy up to 90% with very low burden on the source site and 99% with a higher burden on some stream data. To the best of our knowledge, the dynamic load shedding scheme we propose is the first one in the literature to shed attributes, instead of tuples, along with providing a recovery mechanism in a data stream management system. Our load shedding approach is unique since it is not a static load shedding schema, which is less appealing in an ever-changing (sensor) network environment, and is not based on queries, but works on the general characteristics of the data stream under consideration instead.
12

AN EFFICIENT DEMAND-SIDE LOAD SHEDDING ALGORITHM IN SMART GRID

LI, YANG 27 September 2013 (has links)
Rapid advances in the smart grid technology are making it possible to tackle a lot of problems in the aged power systems. High-speed data acquisition system, high-voltage power electronic equipment, advanced utility and customer interaction technologies, as well as distributed renewable generation are enabling the revolution in the electric power generation, delivery and distribution. Through the implementation of ubiquitous metering and communication networks, the customers would no longer be a passive receiver of the electrical energy, but instead, an active participant in the power system and electricity market. They can not only sell their own energy to the utility, but also take part in the emergency restoration in the power grid. Nonetheless, some technical barriers are encountered during this revolution, such as difficulties in integrating home automation, smart metering, customer interaction and power system operation into the whole system. This thesis proposes a customer involved load shedding algorithm for both the power system frequency control and the micro-grid islanding. This new algorithm possesses the features of centralized load control and distributed load control, which fully utilizes the advantages of hierarchical communication networks along with the home automation. The proposed algorithm considers the reliability of the power grid as well as the comfort of the electricity users. In the power distribution system, the high-level control centre is responsible for coordinating the local load controllers, whilst the local controller takes charge of frequency monitoring and decision making. In the micro-grid, a centralized control strategy is adopted to better serve the system with the wide set of information available at the micro-grid control centre. The simulation results have demonstrated the correctness and feasibility of the proposed algorithm. Finally, the hardware implementation further tests the validity of the wireless sensor networks serving as the system’s monitoring and communication technology. / Thesis (Master, Electrical & Computer Engineering) -- Queen's University, 2013-09-24 20:01:37.098
13

Análise de planos de corte de carga através de métodos diretos / Algorithm for elaboration of plans for service restoration to large scale distribution systems

Brolin, Leandro Castilho 03 December 2010 (has links)
Sistemas Elétricos de Potência (SEPs) muitas vezes não são capazes de retomarem a uma nova condição de equilíbrio após grandes perdas de geração ou mesmo pela retirada de importantes linhas de transmissão. O déficit de potência causado por alguns desses distúrbios pode acarretar no declínio gradual da freqüência do sistema. Caso a reserva girante ou o próprio sistema de transmissão não sejam capazes de recompor o SEP, medidas corretivas devem ser tomadas para evitar o colapso do mesmo. Nesta condição de emergência, um montante de carga deve ser desconectado de forma a restaurar uma nova condição de equilíbrio através de um esquema emergencial conhecido como plano de corte de carga por subfrequência. Muitos trabalhos vem sendo desenvolvidos ao longo dos anos, nos quais são propostas diferentes técnicas para a determinação de planos de corte de carga. Na maioria delas utiliza-se uma modelagem equivalente e linearizada do sistema. Tais simplificações trazem grandes facilidades para a representação do sistema. Porém, para que a integridade do mesmo seja garantida, muitas vezes os planos de corte de carga envolvem montantes de carga maiores que o necessário. A metodologia apresentada neste trabalho utiliza uma representação não linear para o SEP, o que permite um estudo do comportamento dinâmico de suas unidades geradoras para que os limites de frequência sejam determinados. Assim, os planos podem ser determinados com eficiência, reduzindo o número de consumidores desprovidos de energia elétrica durante o processo de alívio de carga. Entretanto, a escolha de um modelo mais completo para a representação do sistema pode acarretar num grande esforço na análise e determinação dos esquemas de alívio de carga, quando aplicados em sistemas de grande porte. Sendo assim, é proposta neste trabalho uma metodologia capaz de auxiliar tais estudos, o que diminui os esforços tanto da parte computacional quanto da parte empregada pelo projetista. Uma abordagem energética é aplicada ao problema e, dessa forma, dada uma perda de geração é possível determinar o valor mínimo de frequência atingido pelo sistema sem que haja a necessidade de se conhecer a trajetória do ponto de operação do sistema. Portanto, é proposta uma metodologia baseada em funções energia para a determinação de planos de corte de carga e, posteriormente, são realizadas simulações em uma representação simplificada de um sistema elétrico de potência para a validação da mesma. Também é mostrado o comportamento da frequência do sistema durante uma condição de subfrequência sobre duas perspectivas. Uma delas utiliza-se de uma modelagem não linear para a representação do sistema e a outra utiliza-se do modelo linearizado para a representação deste mesmo sistema. Este trabalho tem por finalidade o estudo e modelagem matemática do problema emergencial de alívio de carga de uma forma introdutória, para que posteriormente, possa ser desenvolvida de uma ferramenta capaz de auxiliar tais estudos. O método proposto demonstrou-se muito promissor, apesar das simplificações utilizadas para a construção do modelo. / Electric power systems (EPS) are not always capable of achieving a new stable equilibrium point after a severe generation loss or even after the loss of important transmission lines. The lack of active power generation caused by some of these disturbances can lead to a gradual decay of the system frequency. If the spinning reserve or even the bulk transmission system are not capable of restoring the system, then, corrective actions should be taken to avoid a system collapse. Under this emergency condition, a portion of the load should be disconnected, as a way to restore a new stable equilibrium condition, through an emergency scheme known as under frequency load shedding (UFLS). Several works have been developed in this field throughout the years, in which different techniques are proposed to determine the load shedding schemes. The majority of these works use an equivalent linearized model of the system, which facilitates the system representation. However, in order to keep the integrity of the system, it is common to overestimate the shedding of loads. The validation of load shedding schemes that use a linear methodology is generally performed through simulations based on nonlinear models of the whole system. The methodology presented in this work uses a nonlinear representation for the EPS for developing an UFLS scheme, which permits a study of the dynamic behavior of its generators in order to find the frequency limits. ln this way, the schemes can be efficiently determined, aiming a reduction on the number of consumers affected by the load shedding scheme, and avoiding additional simulations to validate the designed scheme. An energetic approach is applied to the problem and, in this way, given a generation loss it is possible to determine the minimum frequency value achieved by the system without the need for the knowledge of the trajectory of the system\'s operating point. Voltage regulators and speed governors are neglected, and the loads and network equipments are represented through a constant impedance model, whereas the generators are modeled through its classical model.
14

Control strategies enabling seamless switching to islanded operation

Zheng, Wei January 2018 (has links)
Significant penetration of distributed generation (DG) and the increasing automation level available for distribution networks have opened an option of splitting a network into subsystems and operating each as an "autonomous island". This is particularly important when a major contingency occurs. However, there are issues and challenges that must be addressed before islanded operation becomes viable, among which, ensuring seamless switching of a distribution subsystem from grid-connected to islanded mode is critically important. Unless the subsystem is a predesigned microgrid, it is highly possible that the subsystem load demand will exceed the generation capacity of island DGs. Therefore, an appropriate load shedding scheme must be implemented to ensure the islanded subsystem is power balanced. In this thesis, a switching control strategy is designed to deliver seamless islanding switching. This strategy comprises a multiple-DG coordination method and a single-step load shedding scheme. Mathematical studies and time-domain simulations that investigate the transients observed during the islanding switching process are both conducted, and together, they are used to address the transient stability issues of an islanded subsystem. This thesis focuses on a distribution subsystem consisting of a mix of synchronous and inverter-based DGs and a combination of static and dynamic loads. DG modelling and control is first introduced, and based on that, various types of method to achieve multiple-DG coordination, including an innovative multiple-master strategy, are investigated. The widely accepted master-slave strategy is used to coordinate DGs when the subsystem is islanded. The strategy demands a single dispatchable and controllable DG, such as a synchronous generator, to be the master, whilst requires the others, such as intermittent renewable-based DGs, to be the slaves. Dynamic load modelling is another critical part of this thesis. The transient stability of dynamic loads after major disturbances is investigated and then used to design the stability-oriented load shedding priority. The single-step load shedding scheme calculates the load shedding amount based on the power flow at the point of common coupling (PCC) and the spinning reserve available in the island. This scheme is activated by the tripping event of the PCC circuit breaker between the grid and the island, and then priorities the load to be shed according to the priority predetermined from the stability perspective. Mathematical analysis is first conducted on a simple subsystem to investigate the impact of DG settings on the islanding transients. A full-scale subsystem is also simulated in PSCAD/EMTDC and used to verify the effectiveness of the switching control strategy. In time-domain simulations, the subsystem is islanded following either a routine switching event or a permanent grid fault. Various factors that may affect the transient performance are analysed, such as the severity of the fault, the DG penetration level, the fault clearance time and the switching control delay. This thesis concludes that based on the proposed switching control strategy, the concept of seamless switching from grid-connected to islanded operation is technically viable.
15

Análise de planos de corte de carga através de métodos diretos / Algorithm for elaboration of plans for service restoration to large scale distribution systems

Leandro Castilho Brolin 03 December 2010 (has links)
Sistemas Elétricos de Potência (SEPs) muitas vezes não são capazes de retomarem a uma nova condição de equilíbrio após grandes perdas de geração ou mesmo pela retirada de importantes linhas de transmissão. O déficit de potência causado por alguns desses distúrbios pode acarretar no declínio gradual da freqüência do sistema. Caso a reserva girante ou o próprio sistema de transmissão não sejam capazes de recompor o SEP, medidas corretivas devem ser tomadas para evitar o colapso do mesmo. Nesta condição de emergência, um montante de carga deve ser desconectado de forma a restaurar uma nova condição de equilíbrio através de um esquema emergencial conhecido como plano de corte de carga por subfrequência. Muitos trabalhos vem sendo desenvolvidos ao longo dos anos, nos quais são propostas diferentes técnicas para a determinação de planos de corte de carga. Na maioria delas utiliza-se uma modelagem equivalente e linearizada do sistema. Tais simplificações trazem grandes facilidades para a representação do sistema. Porém, para que a integridade do mesmo seja garantida, muitas vezes os planos de corte de carga envolvem montantes de carga maiores que o necessário. A metodologia apresentada neste trabalho utiliza uma representação não linear para o SEP, o que permite um estudo do comportamento dinâmico de suas unidades geradoras para que os limites de frequência sejam determinados. Assim, os planos podem ser determinados com eficiência, reduzindo o número de consumidores desprovidos de energia elétrica durante o processo de alívio de carga. Entretanto, a escolha de um modelo mais completo para a representação do sistema pode acarretar num grande esforço na análise e determinação dos esquemas de alívio de carga, quando aplicados em sistemas de grande porte. Sendo assim, é proposta neste trabalho uma metodologia capaz de auxiliar tais estudos, o que diminui os esforços tanto da parte computacional quanto da parte empregada pelo projetista. Uma abordagem energética é aplicada ao problema e, dessa forma, dada uma perda de geração é possível determinar o valor mínimo de frequência atingido pelo sistema sem que haja a necessidade de se conhecer a trajetória do ponto de operação do sistema. Portanto, é proposta uma metodologia baseada em funções energia para a determinação de planos de corte de carga e, posteriormente, são realizadas simulações em uma representação simplificada de um sistema elétrico de potência para a validação da mesma. Também é mostrado o comportamento da frequência do sistema durante uma condição de subfrequência sobre duas perspectivas. Uma delas utiliza-se de uma modelagem não linear para a representação do sistema e a outra utiliza-se do modelo linearizado para a representação deste mesmo sistema. Este trabalho tem por finalidade o estudo e modelagem matemática do problema emergencial de alívio de carga de uma forma introdutória, para que posteriormente, possa ser desenvolvida de uma ferramenta capaz de auxiliar tais estudos. O método proposto demonstrou-se muito promissor, apesar das simplificações utilizadas para a construção do modelo. / Electric power systems (EPS) are not always capable of achieving a new stable equilibrium point after a severe generation loss or even after the loss of important transmission lines. The lack of active power generation caused by some of these disturbances can lead to a gradual decay of the system frequency. If the spinning reserve or even the bulk transmission system are not capable of restoring the system, then, corrective actions should be taken to avoid a system collapse. Under this emergency condition, a portion of the load should be disconnected, as a way to restore a new stable equilibrium condition, through an emergency scheme known as under frequency load shedding (UFLS). Several works have been developed in this field throughout the years, in which different techniques are proposed to determine the load shedding schemes. The majority of these works use an equivalent linearized model of the system, which facilitates the system representation. However, in order to keep the integrity of the system, it is common to overestimate the shedding of loads. The validation of load shedding schemes that use a linear methodology is generally performed through simulations based on nonlinear models of the whole system. The methodology presented in this work uses a nonlinear representation for the EPS for developing an UFLS scheme, which permits a study of the dynamic behavior of its generators in order to find the frequency limits. ln this way, the schemes can be efficiently determined, aiming a reduction on the number of consumers affected by the load shedding scheme, and avoiding additional simulations to validate the designed scheme. An energetic approach is applied to the problem and, in this way, given a generation loss it is possible to determine the minimum frequency value achieved by the system without the need for the knowledge of the trajectory of the system\'s operating point. Voltage regulators and speed governors are neglected, and the loads and network equipments are represented through a constant impedance model, whereas the generators are modeled through its classical model.
16

Advanced load shedding scheme for voltage collapse prevention

Wang, Yunfei 11 1900 (has links)
Present-day economic and environmental constraints push power systems to be operated closer to their limits. A common limiting factor for power transmission is the risk of voltage instability in recent years. As the ultimate countermeasure to voltage collapse, load shedding is normally considered the last resort, when there are no other alternatives to stop an approaching voltage collapse. The requirements of a practical load shedding scheme are to prevent a power system from voltage collapse and to maximize its reliability. In order to design such a scheme, the following tasks are equally important: 1. Recognizing the approaching voltage collapse. 2. Determining the best load shedding locations. 3. Minimizing the amount of load shedding. This thesis firstly investigates the widely used undervoltage load shedding schemes (UVLS) and the single-port impedance match (SPIM) based schemes. The findings explain the difficulties faced by them. An original load shedding oriented voltage stability monitoring scheme, which involves developing a new multi-port network equivalent, is then developed. With the help of the multi-port network equivalent, the monitoring scheme can not only recognize the approaching voltage collapse in time, but also can easily rank the load buses based on their weakness. The results of ranking are consistent with those obtained from modal analysis method. This thesis then proposes a practical event-driven load shedding scheme based on the experiences learned from the schemes implemented by various utilities. The scheme involves developing a multistage method, which is to optimize the amount of load shedding. A general design procedure for the scheme is presented in the thesis. Using a real 2038 bus system as an example, the design methodology is described in detail. The methodology is expected to help power system engineers develop their own load shedding schemes. A practical emergency demand response scheme is also developed and presented in the appendix. It is aimed at choosing the proper demand response participants and minimizing the total cost while achieving a certain level of operation reserves. / Power Engineering and Power Electronics
17

Stability Analysis and Economic Dispatch of an Isolated Power System with Wind Generators

Lai, Yu-chieh 07 July 2011 (has links)
The objective of this thesis is to investigate the transient response and optimal economic dispatch of an isolated power system with wind generators. Different types of wind turbines and the classification of Stability are introduced. Then, the process of Transient stability analysis and the concept of Genetic Algorithms are given for explanation. In this thesis, the practical power system of Kinmen is selected for case study. The disturbances introduced by gusting wind and N-1 system contingency are considered in the transient stability analysis. Furthermore, in order to obtain both accuracy and feasibility of the Optimal power dispatch by using Real-parameter Genetic Algorithms, the simulation results should be tested for the restrictions and requirements of the actual operation.
18

Advanced load shedding scheme for voltage collapse prevention

Wang, Yunfei Unknown Date
No description available.
19

Analise dos sistemas de proteção e controle de instalações industriais com geradores sincronos durante operação ilhada / Protection and control systems analysis of industrial plants with synchronous generators during islanded operation

Arioli, Fernanda Caseño Trindade, 1984- 13 August 2018 (has links)
Orientador: Walmir de Freitas Filho / Dissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Eletrica e de Computação / Made available in DSpace on 2018-08-13T11:32:14Z (GMT). No. of bitstreams: 1 Trindade_FernandaCasenoLima_M.pdf: 1160331 bytes, checksum: 8645597088992da29acb335423c8dbc4 (MD5) Previous issue date: 2009 / Resumo: Sistemas industriais modernos são instalações bastante complexas com elevado grau de automatização e com capacidade de operar de forma isolada (ilhada) da rede elétrica após a ocorrência de contingências devido à utilização de geradores próprios compostos principalmente por máquinas síncronas e turbinas térmicas. Tais instalações, na presença de geradores, são denominadas genericamente como consumidores autoprodutores. Como muitos desses autoprodutores são conectados em redes de distribuição e subtransmissão de energia elétrica, tais consumidores estão sujeitos às normas técnicas requeridas por essas concessionárias. Assim, a desconexão da instalação industrial logo após a ocorrência de um ilhamento na rede de distribuição é um procedimento obrigatório. Imediatamente após a detecção do ilhamento pelo sistema de proteção da instalação industrial, a rede de distribuição e o sistema industrial são separados (isolados). Esta separação é realizada através da abertura do disjuntor instalado no lado de baixa tensão do transformador (lado do consumidor) que faz a conexão entre os dois sistemas. Então, a concessionária pode realizar os procedimentos necessários para reenergização da rede. Logo após a realização da separação dos sistemas, é necessário adotar uma série de medidas que garanta que o sistema industrial possa continuar operando isoladamente de forma adequada. Basicamente, três ações devem ser tomadas: (a) mudança do modo de operação do regulador de velocidade e do sistema de excitação dos geradores síncronos; (b) implementação do sistema de rejeição de carga e (c) alteração dos ajustes dos relés de sobrecorrente do sistema de proteção da rede industrial. Nesse contexto, o objetivo desta dissertação de mestrado é investigar tais procedimentos e propor metodologias de análise dessas questões previamente mencionadas de forma a obter um melhor entendimento do problema. Com o desenvolvimento dessas metodologias, objetiva-se que os estudos desses procedimentos automáticos possam ser realizados de forma mais eficiente e sistemática. / Abstract: Modern industrial systems are very sophisticated installations with a high number of automatic processes and capability of isolated (islanded) operation after contingences by using onsite generators composed mainly by synchronous machines and steam turbines. Such installations, in the presence of generators, are generically called autoproducers. Since many of these autoproducers are connected to electrical power distribution and subtransmission grids, they must respect the technical recommendations imposed by these utilities. As a consequence, the disconnection of these systems from the grid after islanding occurrence is a mandatory procedure. Soon after the islanding detection by the industrial protection system, the industry and the grid must be electrically separated (isolated) by opening the circuit breaker installed at the low voltage side of the interconnection transformer. Thus, after the separation, the utility can carry out the necessary technical procedures to restore the network. From the industrial system perspective, after the separation, it is necessary to take control actions to guarantee that the industrial system continues operating with quality and reliability. Basically, three actions must be taken: (a) change the operation mode of the speed governor and excitation system of the generators; (b) implement the load shedding system and (c) change the settings of the protection system overcurrent relays. In this context, the objective of this master thesis is to investigate these procedures and propose methods for analysis in order to obtain a better understanding of these issues. With this methodologies development, it is expected that new automatic proceedings can be achieved in a more efficient and systematic way. / Mestrado / Energia Eletrica / Mestre em Engenharia Elétrica
20

Efficient Stream Analysis and its Application to Big Data Processing / Analyse efficace de flux de données et applications au traitement des grandes masses de données

Rivetti di Val Cervo, Nicolo 30 September 2016 (has links)
L’analyse de flux de données est utilisée dans beaucoup de contexte où la masse des données et/ou le débit auquel elles sont générées, excluent d’autres approches (par exemple le traitement par lots). Le modèle flux fourni des solutions aléatoires et/ou fondées sur des approximations pour calculer des fonctions d’intérêt sur des flux (repartis) de n-uplets, en considérant le pire cas, et en essayant de minimiser l’utilisation des ressources. En particulier, nous nous intéressons à deux problèmes classiques : l’estimation de fréquence et les poids lourds. Un champ d’application moins courant est le traitement de flux qui est d’une certaine façon un champ complémentaire aux modèle flux. Celui-ci fournis des systèmes pour effectuer des calculs génériques sur les flux en temps réel souple, qui passent à l’échèle. Cette dualité nous permet d’appliquer des solutions du modèle flux pour optimiser des systèmes de traitement de flux. Dans cette thèse, nous proposons un nouvel algorithme pour la détection d’éléments surabondants dans des flux repartis, ainsi que deux extensions d’un algorithme classique pour l’estimation des fréquences des items. Nous nous intéressons également à deux problèmes : construire un partitionnement équitable de l’univers des n-uplets par rapport à leurs poids et l’estimation des valeurs de ces n-uplets. Nous utilisons ces algorithmes pour équilibrer et/ou délester la charge dans les systèmes de traitement de flux. / Nowadays stream analysis is used in many context where the amount of data and/or the rate at which it is generated rules out other approaches (e.g., batch processing). The data streaming model provides randomized and/or approximated solutions to compute specific functions over (distributed) stream(s) of data-items in worst case scenarios, while striving for small resources usage. In particular, we look into two classical and related data streaming problems: frequency estimation and (distributed) heavy hitters. A less common field of application is stream processing which is somehow complementary and more practical, providing efficient and highly scalable frameworks to perform soft real-time generic computation on streams, relying on cloud computing. This duality allows us to apply data streaming solutions to optimize stream processing systems. In this thesis, we provide a novel algorithm to track heavy hitters in distributed streams and two extensions of a well-known algorithm to estimate the frequencies of data items. We also tackle two related problems and their solution: provide even partitioning of the item universe based on their weights and provide an estimation of the values carried by the items of the stream. We then apply these results to both network monitoring and stream processing. In particular, we leverage these solutions to perform load shedding as well as to load balance parallelized operators in stream processing systems.

Page generated in 0.0922 seconds