For growing organisations that have built their data flow around a monolithic database server, anever-increasing number of applications and an ever-increasing demand for data freshness willeventually push the existing system to its limits, prompting either hardware upgrades or anupdated data architecture. Switching from an approach of full extractions of data at regularintervals to an approach where only changes are extracted, resource consumption couldpotentially be decreased, while simultaneously increasing data freshness. The objective of this thesis is to provide insights into how implementing an event streamingsetup with Apache Kafka connected to SQL Server through the Debezium source connectoraffects resource consumption on the database server. Other studies in related work have oftenbeen focused on steps further downstream in the data pipeline. This thesis can thereforecontribute to an area where more knowledge is needed. Through an empirical study done using two different setups in the same system, traditional dataextraction in batches and extraction through event streaming is measured and compared. The point of measurement is the SQL Server database from which data is extracted. Both memoryutilisation and CPU utilisation is measured, using SQL Server Profiler. Different parameters fortable sizes, volumes of data and intervals between changes are used to simulate differentscenarios. One of the takeaways of the results is that, at the same number of total changes, the size of theindividual transactions has a large impact on the resource consumption caused by eventstreaming. The study shows that an overhead cost is involved with each transaction, and also thatthe regular polling that the source connector performs causes resource consumption even inidleness. The thesis concludes that event streaming can offer reduced resource consumption on thedatabase server. However, when the source table size is small, and the number of changes large,extraction in batches is less resource-intensive.

O presente trabalho centra-se no estudo da narrativa do romance O Castelo, escrito em 1922, pelo escritor tcheco Franz Kafka. Por meio da análise formal da obra em questão, objetiva-se estabelecer relações entre aspectos presentes na narrativa que possuam associações metafóricas a temas vigentes no cotidiano do autor e, conseqüentemente, do homem moderno, e que possuam conotação negativa, tais como o poder, simbolizado pela burocracia, pela divinização, e pelo espaço. Partindo dessa premissa, propõe-se relacionar esses temas à teoria dos conjuntos da matemática, na qual um conjunto maior contém um conjunto menor, esse atuando por sua vez como um subconjunto daquele. Propõe-se aqui fazer uma analogia do conjunto poder e seu enfoque negativo como poder com o subconjunto burocracia, este intimamente ligado àquele, e que possui intersecção com os subconjuntos divinização e espaço. Por fim, ressaltar-se-á a universalidade da obra de Kafka, que possibilita a efetuação de analogias temáticas das mais diversas, não só as aqui expostas em forma de conjuntos e subconjuntos, pelo fato de seu texto ser multifacetado no tocante a temas. / This monograph focuses on analyzing the narrative of The Castle, a novel written by the Czech author Franz Kafka, in 1922. It aims at establishing a connection between certain aspects within the text which may have a metaphorical association with themes related to not only the authors life experiences, but also any other modern mans. It will be centered on a formal analysis of the novel and on metaphorical aspects within the narrative, which may have a negative connotation linked with power, represented by bureaucracy, divinization and space. Afterwards, we will propose a relation of such themes to the set theory from Mathematics, in which a greater set contains a smaller set, also known as a subset. We aim at drawing an analogy of power as a set and its negative connotation with the bureaucratic subset, which are intimately connected. Bureaucracy intersects the two other subsets called divinization and space. Eventually, we will focus on the universality of Kafkas work, which enables the drawing of many other thematic analogies, not only the ones discussed in this set theory proposed in this monograph, due to the fact that Kafkas work is multifaceted in terms of themes.

Šiame darbe analizuojama kokia yra egzistencializmo samprata. Magistriniame darbe pateikiamos egzistencializmo atstovų teorijos apie egzistencializmo esmę. Savo filosofinėmis idėjomis egzistencialistai pristato keliamas problemas. Visi egzistencializmo krypties atstovai aiškinasi būties, gyvenimo prasmės, kančios problemas. Prie egzistencinių ir neišvengiamų problemų žmogaus gyvenime priskiriamos – kova, kaltė, nuobodulys, maištas, absurdo jausmas. Iškeltai hipotezei patvirtinti atliktas praktinis tyrimas su 11 – 12 klasių moksleiviais. Susumavus tyrimo rezultatus formuluotos išvados. Egzistencializmo srovė ypatinga ir išskirtinė yra tuo, kad didelį dėmesį skiria žmogaus būčiai. Egzistencializmas gvildena atskiro žmogaus problemas. Pabrėžiamas žmogaus laikiškumas ir laikinumas. Iškeliamas žmogaus gyvenimo beprasmiškumas. Baigtinė žmogaus egzistencija pasaulyje ir jos įprasminimas – pagrindinė egzistencializmo problema. Egzistencializmo srovė ypatinga dar ir tuo, kad savo idėjoms išreikšti dažnai rinkosi meninę, literatūrinę kalbą, kurioje tarsi persikūnydavo į kitą asmenį. Pagal požiūrį į tikėjimą, egzistencializmas yra skirstomas į „krikščioniškąjį“ ir „ateistinį“. Krikščioniškieji egzistencialistai savo idėjas paremia Dievo buvimu. Tuo tarpu ateistinio mąstymo filosofų idėjos yra paremtos Dievo neigimu. Iškeliamas žmogaus laisvas pasirinkimas kurti, veikti. Atlikus egzistencializmo atstovų A. Camus‘o - „Krytis“, „Maras“, „Svetimas“, „Sizifo mitas“... [toliau žr. visą tekstą] / This paper analysis the concept of existentialism. The master thesis presents the theories of the representatives of existentialism on the essence of existentialism. Philosophical ideas of the existentialists represent relevant problems. All representatives of existentialism trend develop the problems of subsistence, meaning of life, anguish. Struggle, guilt, boredom, rebellion, feeling of absurdity are all assigned to existential and inevitable problems that a person faces in life. To justify the hypothesis, a practical study has been made, which involves 11-12 grade students. After summarizing the results of the study, the conclusions have been made. Existentialism trend is special and exceptional for paying special attention to the subsistence of a human being. Existentialism examines the problems of individual people. Temporality and impermanence of a human life are emphasized. Futility of the human life is highlighted. Finite human existence in the world and its meaning is the main problem of existentialism. This trend is also specific for choosing artistic, literary language, which helped to reincarnate into other person. Depending on the attitude to faith, existentialism is divided into “Christian” and “atheistic”. Christian existentialists base their ideas on the existence of God. While the ideas of atheistic philosophers are based on the denial of God. Free choice of a person to create, act is amplified. After analysing the works of the representatives of... [to full text]

nÃo hà / Esta Tese pretende verificar como as narrativas construÃdas por Clarice Lispector (1920-1977) apreendem o que o pensador Paul Ricoeur (2010c, p.328) considera como âtempo humanoâ, por meio do vÃnculo dinÃmico entre os Ãmbitos da introspecÃÃo e da exterioridade. Sob estudo comparativo com as narrativas de O Processo (1925) e O Castelo (1926), de Franz Kafka (1883-1924) e com o pensamento de Hannah Arendt (1906-1975), buscaremos interpretar a âcondiÃÃo sitiadaâ do âhomem comumâ, nos âtempos sombriosâ que antecedem as Grandes Guerras aos anos que as sucedem, a fim de verificar a atualidade da Literatura de Clarice Lispector, no que diz respeito ao seu carÃter âcontemporÃneoâ (AGAMBEN: 2009, p. 62). Do entrecruzamento entre as narrativas histÃrica e ficcional, que compreendem a trajetÃria literÃria e cultural de Clarice Lispector, analisaremos a historicidade e as mÃltiplas temporalidades da narrativa clariceana, enfatizando a experiÃncia como uma categoria fundante, originÃria, que se diz por meio da linguagem. Para tanto, entre suas obras, destacaremos o terceiro romance da escritora, A cidade sitiada (1949), para anÃlise e aprofundamento do processo de construÃÃo de alegorias presentes nessa narrativa para uma interpretaÃÃo das angÃstias existenciais das personagens, junto ao conceito de condiÃÃo humana, sob o lastro dos pensamentos de Walter Benjamin (1892-1940) e Hannah Arendt, que consideramos pertinentes tanto por conta das vivÃncias destes pensadores em face do tempo de âcrise dos fundamentos da vida humanaâ (HOBSBAWN: 2002, p.21), a partir das concepÃÃes de Eric Hobsbawn (1917-2012) e Gilberto de Melo Kujawski, quanto por permitir uma anÃlise comparatista em relaÃÃo ao universo ficcional de Franz Kafka. Este trabalho integra a pesquisa âHistÃrias de Leitura: Bibliotecas Pessoaisâ, sob a CoordenaÃÃo da ProfÂ. DrÂ. Odalice de Castro Silva, do Programa de PÃs-GraduaÃÃo em Letras â Literatura Brasileira, da Universidade Federal do CearÃ.

O presente trabalho centra-se no estudo da narrativa do romance O Castelo, escrito em 1922, pelo escritor tcheco Franz Kafka. Por meio da análise formal da obra em questão, objetiva-se estabelecer relações entre aspectos presentes na narrativa que possuam associações metafóricas a temas vigentes no cotidiano do autor e, conseqüentemente, do homem moderno, e que possuam conotação negativa, tais como o poder, simbolizado pela burocracia, pela divinização, e pelo espaço. Partindo dessa premissa, propõe-se relacionar esses temas à teoria dos conjuntos da matemática, na qual um conjunto maior contém um conjunto menor, esse atuando por sua vez como um subconjunto daquele. Propõe-se aqui fazer uma analogia do conjunto poder e seu enfoque negativo como poder com o subconjunto burocracia, este intimamente ligado àquele, e que possui intersecção com os subconjuntos divinização e espaço. Por fim, ressaltar-se-á a universalidade da obra de Kafka, que possibilita a efetuação de analogias temáticas das mais diversas, não só as aqui expostas em forma de conjuntos e subconjuntos, pelo fato de seu texto ser multifacetado no tocante a temas. / This monograph focuses on analyzing the narrative of The Castle, a novel written by the Czech author Franz Kafka, in 1922. It aims at establishing a connection between certain aspects within the text which may have a metaphorical association with themes related to not only the authors life experiences, but also any other modern mans. It will be centered on a formal analysis of the novel and on metaphorical aspects within the narrative, which may have a negative connotation linked with power, represented by bureaucracy, divinization and space. Afterwards, we will propose a relation of such themes to the set theory from Mathematics, in which a greater set contains a smaller set, also known as a subset. We aim at drawing an analogy of power as a set and its negative connotation with the bureaucratic subset, which are intimately connected. Bureaucracy intersects the two other subsets called divinization and space. Eventually, we will focus on the universality of Kafkas work, which enables the drawing of many other thematic analogies, not only the ones discussed in this set theory proposed in this monograph, due to the fact that Kafkas work is multifaceted in terms of themes.

Målen med denna studie är att implementera en testmiljö för streaming telemetry samt jämföra två alternativ för att möjliggöra realtidsanalys av det insamlade datat. Dessa två alternativ är Python-biblioteken PyKafka och Confluent-Kafka-Python. Bedömningskritierna för jämförselsen var dokumentation, kodmängd och minnesanvändning. Testmiljön för streaming telemetry använder en router med Cisco IOS XR programvara som skickar data till en Cisco Pipeline collector, som vidare sänder datat till ett Kafka-kluster. Jämförelsen av Python-biblioteken utfördes med språket Python. Resultaten av jämförelsen visade att båda biblioteken hade välskriven dokumentation och liten skillnad i kodmängd, dock använde Confluent-Kafka-Python mindre minne. Studien visar att streaming telemetry med realtidsanalys kan fungera bra som ett komplement till eller en ersättning av SNMP. Studien rekommenderar användning av Confluent-Kafka-Python för implementering i produktionsmiljöer med ett stort antal nätverksenheter med tanke på den lägre minnesanvändningen. / The goals of this study are to implement a test environment for streaming telemetry and compare two alternatives for analysing the collected data in realtime. The two alternatives are the Python libraries PyKafka and Confluent-Kafka-Python. The comparison focused mainly on three areas, these being documentation, amount of code and memory usage. The test environment for streaming telemetry was set up with a router running IOS XR software that is sending data to a Cisco Pipeline collector, which in turn sends data to a Kafka-cluster. The comparison of the two libraries for interfacing with the cluster was made with the language Python. The results of the comparison showed that both libraries had well-written documentation and showed a negligible difference in amount of code. The memory usage was considerably lower with the Confluent-Kafka-Python library. The study shows that streaming telemetry together with real-time analysis makes a good complement to or a replacement of SNMP. The study further recommends the use of Confluent-Kafka-Python in real-world implementations of streaming telemetry, particularly in large networks with a large amount of devices.

In the era of big data, data is flooding from numerous data sources and many companies have been utilizing different types of tools to load and process data from various sources in a data lake. The major challenges where different companies are facing these days are how to update data into an existing dataset without having to read the entire dataset and overwriting it to accommodate the changes which have a negative impact on the performance. Besides this, finding a way to capture and track changed data in a big data lake as the system gets complex with large amounts of data to maintain and query is another challenge. Web platforms such as Hopsworks are also facing these problems without having an efficient mechanism to modify an existing processed results and pull out only changed data which could be useful to meet the processing needs of an organization. The challenge of accommodating row level changes in an efficient and effective manner is solved by integrating Hudi with Hops. This takes advantage of Hudi’s upsert mechanism which uses Bloom indexing to significantly speed up the ability of looking up records across partitions. Hudi indexing maps a record key into the file id without scanning over every record in the dataset. In addition, each successful data ingestion is stored in Apache Hudi format stamped with commit timeline. This commit timeline is needed for the incremental processing mainly to pull updated rows since a specified instant of time and obtain change logs from a dataset. Hence, incremental pulls are realized through the monotonically increasing commit time line. Similarly, incremental updates are realized over a time column (key expression) that allows Hudi to update rows based on this time column. HoodieDeltaStreamer utility and DataSource API are used for the integration of Hudi with Hops and Feature store. As a result, this provided a fabulous way of ingesting and extracting row level updates where its performance can further be enhanced by the configurations of the shuffle parallelism and other spark parameter configurations since Hudi is a spark based library. / I dag är stora data mängder vanligt förekommande bland företag. Typiskt så flödar datan från många datakällor och det är populärt bland företag att använda olika typer av verktyg för att läsa och bearbeta data i en data lake. En av de stora utmaningarna som företag står inför idag är att kunna uppdatera stora mängder data på ett effektivt sätt. Tidigare lösningar för att uppdatera stora mängder data är baserat på att skriva över datan, vilket är en ineffektiv metod. En ytterligare utmaning med stora data mängder är problemet av att bokföra ändringar till datan på ett effektivt sätt. Hopsworks är en webbplattform som lagrar och bearbetrar stora mängder data och står således inför dessa utmaningar. I denna avhandling så presenteras en lösning på problemet med att uppdatera stora datamängder på ett effektivt sätt. Lösningen är baserad på att integrera Hudi med Hops. Genom att integrera Hudi med Hops så kan Hops utnyttja Hudis mekanism för effektiv uppdatering av data. Mekanismen som används i Hudi för att uppdatera stora mängder dataär baserad på Bloom-indexering samt logg-baserad lagring av data. Hudi indexerar datan för att snabba upp uppdateringsoperationer. Dessutom så stödjer Hudi att varje uppdatering bokförs till en loggfil, vilket i praktiken fungerar som en tidslinje över datan. Genom att använda tidslinjen så stödjer Hudi att läsa stora datamängder inkrementellt, samt att inspektera datan vid specifika tidpunkter. I denna avhandling så beskrivs hur HoodieDeltaStreamer-verktyget samt Hudis DataSource API används för integrera Hudi med Hops Feature Store. Tack vare denna integration så möjligörs en mer effektiv och användbar uppdatering av stora datamängder i Hops.

Applications found in both large and small enterprises need a communication method in order to meet requirements of scalability and durability. Many communication methods exist, but the most well-used are message queues and message brokers. The problem is that there exist many different types of message queues and message brokers with their own unique design and implementation choices. These choices result in different parameter sets, which can be configured in order to meet requirements of for example high durability, throughput, and availability. This thesis tests two different message brokers, Apache Kafka and RabbitMQ, with the purpose of discussing and showing the impact on throughput and latency when using a variety of parameters. The experiments conducted are focused on two primary metrics, latency and throughput, with secondary metrics such as diskand CPU-usage. The parameters chosen for both RabbitMQ and Kafka are optimized for maximized throughput and decreased latency. The experiments conducted are tested on a cloud platform; Amazon Web Services. The results show that Kafka outshines RabbitMQ regarding throughput and latency. RabbitMQ is the most efficient in terms of quantity of data being written, while on the other hand being more CPU-heavy than Kafka. Kafka performs better than RabbitMQ in terms of the amount of messages being sent and having the shortest one-way latency. / Applikationer som finns i både komplexa och icke-komplexa system behöver en kommunikationsmetod för att uppfylla kriterierna för skalbarhet och hållbarhet. Många kommunikationsmetoder existerar, men de mest använda är meddelandeköer och meddelandemäklare. Problemet är att det finns en uppsjö av olika typer av meddelandeköer och meddelandemäklare som är unika med avseende på deras design och implementering. Dessa val resulterar i olika parametersatser som kan konfigureras för att passa olika kriterier, exempelvis hög hållbarhet, genomströmning och tillgänglighet. Denna avhandling testar två olika meddelandemäklare, Apache Kafka och RabbitMQ med syfte att diskutera och visa effekterna av att använda olika parametrar. De utförda experimenten är inriktade på två primära mätvärden, latens och genomströmning, med sekundära mätvärden som exempelvis diskanvändning och CPU-användning. De parametrar som valts för både RabbitMQ och Kafka optimeras med fokus på de primära mätvärdena. Experimenten som genomförs testades på en molnplattform; Amazon Web Services. Resultaten visar att Kafka presterar bättre än RabbitMQ när det kommer till genomströmning och latens. Gällande inverkan av Kafka och RabbitMQ på mängden skriven data, är RabbitMQ den mest effektiva, medan den å andra sidan är mer CPU-tung än Kafka.

In todays digitalised society, effective solutions to manage huge amount of data is needed. An established design pattern that are used in many systems are CRUD. To handle data in events have become more popular over the years, but CRUD is not optimised for it. A possible replacement is CQRS, it is designed with events in mind. The purpose of the report is to see if CQRS can replace CRUD. The report shows that when it comes to an event driven system using event sourcing, CQRS is recommended. Reason being CQRS is more compatible with events then CRUD. CRUD is more designed around data driven design and therefor is a better fit for other systems. / I dagens digitaliserade samhälle krävs effektiva lösningar för att behandla stora mängder data. Ett etablerat designmönster som används i många system är CRUD. Att hantera data i händelser är något som har blivit alltmer populärt, men CRUD är inte optimerad kring just det. En möjlig ersättare är CQRS, som är designad med event i åtanke. Målet med denna rapport är att se om CQRS kan ersätta CRUD i ett händelsebaserat system. Rapporten visar att när det kommer till ett händelsedrivet system som använder händelsekällor, så är rekommendationen att använda CQRS. Detta för att CQRS är mer kompatibel med händelser än CRUD. CRUD är mer designat runt data driven design och funkar därför bättre med andra typer av system.

Apache Kafka is a distributed, high throughput and fault-tolerant publish/subscribe messaging system in the Hadoop ecosystem. It is used as a distributed data streaming and processing platform. Kafka topics are the units of message feeds in the Kafka cluster. Kafka producer publishes messages into these topics and a Kafka consumer subscribes to topics to pull those messages. With the increased usage of Kafka in the data infrastructure of many companies, there are many Kafka clients that publish and consume messages to/from the Kafka topics. In fact, these client operations can be malicious. To mitigate this risk, clients must authenticate themselves and their operation must be authorized before they can access to a given topic. Nowadays, Kafka ships with a pluggable Authorizer interface to implement access control list (ACL) based authorization for client operation. Kafka users can implement the interface differently to satisfy their security requirements. SimpleACLAuthorizer is the out-of-box implementation of the interface and uses a Zookeeper for ACLs storage.HopsWorks, based on Hops a next generation Hadoop distribution, provides support for project-based multi-tenancy, where projects are fully isolated at the level of the Hadoop Filesystem and YARN. In this project, we added Kafka topicbased multi-tenancy in Hops projects. Kafka topic is created from inside Hops project and persisted both at the Zookeeper and the NDBCluster. Persisting a topic into a database enabled us for topic sharing across projects. ACLs are added to Kafka topics and are persisted only into the database. Client access to Kafka topics is authorized based on these ACLs. ACLs are added, updated, listed and/or removed from the HopsWorks WebUI. HopsACLAuthorizer, a Hops implementation of the Authorizer interface, authorizes Kafka client operations using the ACLs in the database. The Apache Avro schema registry for topics enabled the producer and consumer to better integrate by transferring a preestablished message format. The result of this project is the first Hadoop distribution that supports Kafka multi-tenancy.