National Technical University of Athens (NTUA)
Προσαρμοστικοί αλγόριθμοι εξισορρόπησης φόρτου σε κατανεμημένα περιβάλλοντα: δίκτυα ομοτίμων και υπολογιστικά νέφη
Abstract
dc:descriptionIn this thesis, the problem of load balancing in distributed data management systems is studied. In the first part of this thesis, NIXMIG, an adaptive online algorithm that balances load in distributed range partitioned data structures (i.e., structures that are able to answer range queries) is presented. The problem of uneven load distribution that occurs when peers serve objects of varying popularity is addressed. NIXMIG is implemented on top of a Skip Graph, a structured peer to peer system capable of answering range queries. NIXMIG is experimentally and theoretically compared to other load balancing algorithms and the analysis shows that it is faster and consumes less bandwidth during the balancing procedure. In the second part, the problem of indexing and serving large and diverse (unstructured, semi-structured and fully structured) data sets is addressed. A scalable system in which both the index and the content is created and served in a fully distributed way is presented and implemented. The workload of both content and index creation and serving is balanced among cluster peers by combining the power of the latest distributed data analysis frameworks based on MapReduce with an open source implementation of Google's BigTable. The system is tested under heavy query load and its mean query response time was kept in the order of milliseconds.
Degree
thesis:*- Grantor dc:publisher
- National Technical University of Athens (NTUA)
- Year dc:date
- 2011
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Konstantinou, Ioannis
- Κωνσταντίνου, Ιωάννης
Subjects
dc:subject × 18- Δίκτυα ομότιμων
- Υπολογιστικά νέφη
- Εξισορρόπηση φόρτου
- Κατανεμημένα συστήματα
- Διαχείριση δεδομένων
- Ερωτήματα εύρους
- Peer-to-peer
- Cloud computing
- Load balancing
- Distributed systems
- Data management
- Range queries
- NoSQL
- MapReduce
- Επιστήμες Μηχανικού και Τεχνολογία
- Επιστήμη Ηλεκτρολόγου Μηχανικού, Ηλεκτρονικού Μηχανικού, Μηχανικού Η/Υ
- Engineering and Technology
- Electrical Engineering, Electronic Engineering, Information Engineering
Rights
- Language dc:language
- gre
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/25571