National Technical University of Athens (NTUA)
Optimizing data analysis through offline large language models and scalable data management techniques
Abstract
dc:descriptionThe importance of data across various sectors demands innovative approaches to data management and analytics. This PhD thesis investigates the integration of offline large language models (LLMs) for automated code generation, aiming to streamline data analysis processes, and thus enhance the scalability and efficiency of data management systems. By leveraging offline LLMs, the proposed approach empowers users to perform data analyses without extensive programming skills, thereby democratizing data analytics. The research delves into the architecture and implementation of scalable data management systems that can efficiently handle datasets of several volumes. Based on an efficient data management platform, the capabilities of offline LLMs to generate analytical code are examined, showcasing how these models can transform user queries into executable scripts that facilitate data manipulation and interpretation. Through experiments and case studies, the practical applications and benefits of the proposed study are showcased. The results highlight the potential of offline Large Language Models in Data Science and Analysis. This thesis contributes to the field by presenting a study that integrates AI-driven code generation with robust data management practices, ultimately paving the way for more efficient and user-friendly data analytics solutions.
Degree
thesis:*- Grantor dc:publisher
- National Technical University of Athens (NTUA)
- Year dc:date
- 2025
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Nikolakopoulos, Anastasios
- Νικολακόπουλος, Αναστάσιος
Subjects
dc:subject × 20- Επιστήμη δεδομένων
- Ανάλυση δεδομένων
- Μηχανική μάθηση
- Τεχνητή νοημοσύνη
- Μεγάλα γλωσσικά μοντέλα (LLMs)
- Data science
- Data analysis
- Machine learning
- Artificial intelligence
- Large language models
- Επιστήμη Ηλεκτρολόγου Μηχανικού, Ηλεκτρονικού Μηχανικού, Μηχανικού Η/Υ
- Επιστήμες Μηχανικού και Τεχνολογία
- Υπολογιστές, Υλικό (hardware) και Αρχιτεκτονική
- Άλλες Επιστήμες Μηχανικού και Τεχνολογίες
- Μηχανική, διεπιστημονική προσέγγιση
- Electrical Engineering, Electronic Engineering, Information Engineering
- Engineering and Technology
- Computer science, Hardware and Architecture
- Other Engineering and Technologies
- Engineering, interdisciplinary
Rights
- Language dc:language
- eng
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/58941