National Technical University of Athens (NTUA)
Efficient deep learning in mobile and embedded computing environments
Abstract
dc:descriptionDeep learning has fundamentally transformed the field of artificial intelligence, enabling significant advancements in areas such as natural language processing, computer vision, and autonomous decision-making. However, the ever-increasing complexity of modern models entails substantial computational demands, rendering the use of powerful cloud infrastructures essential. This dependence on centralized computing introduces limitations in terms of latency, privacy, and availability, posing a challenge for the deployment of AI applications on mobile and embedded systems. This dissertation investigates the intersection of deep learning and efficiency in resource-constrained environments, with the aim of establishing a holistic framework for the efficient development and execution of AI systems at the network edge. The research focuses on three key studies: (a) the development of CARIn, an adaptive inference framework designed to execute multiple neural networks on heterogeneous mobile devices using multi-objective optimization techniques; (b) the thorough evaluation and adaptation of Transformer models for mobile environments through low-cost architectural and hardware-aware optimizations; and (c) the design of A-THENA, an efficient intrusion detection system for IoT networks, based on Transformers with time-aware positional encodings. Through these contributions, this dissertation formulates a comprehensive approach to efficient deep learning in mobile and embedded computing environments. By exploring the interplay between model optimization, hardware adaptation, and real-world application requirements, this work bridges the gap between cutting-edge AI research and its practical deployment. The findings emphasize that efficiency is not merely an optimization objective but a foundational enabler for the future of AI, ensuring that deep learning technologies can operate seamlessly, sustainably, and intelligently across a wide range of computing platforms.
Degree
thesis:*- Grantor dc:publisher
- National Technical University of Athens (NTUA)
- Year dc:date
- 2025
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Panopoulos, Ioannis
- Πανόπουλος, Ιωάννης
Subjects
dc:subject × 28- Βαθιά μάθηση
- Τοπική συμπερασματολογία
- Κινητός υπολογισμός
- Ενσωματωμένος υπολογισμός
- Αποδοτική τεχνητή νοημοσύνη
- Ετερογένεια
- Βελτιστοποίηση
- Μοντέλα μετασχηματιστών
- Ανάπτυξη στις παρυφές
- Ανίχνευση εισβολών
- Διαδίκτυο των πραγμάτων
- Deep learning
- On-device inference
- Mobile computing
- Embedded computing
- Efficient AI
- Heterogeneity
- Optimization
- Transformer models
- Edge deployment
- Intrusion detection
- Internet of things
- Επιστήμη Ηλεκτρολόγου Μηχανικού, Ηλεκτρονικού Μηχανικού, Μηχανικού Η/Υ
- Επιστήμες Μηχανικού και Τεχνολογία
- Υπολογιστές, Υλικό (hardware) και Αρχιτεκτονική
- Electrical Engineering, Electronic Engineering, Information Engineering
- Engineering and Technology
- Computer science, Hardware and Architecture
Rights
- Language dc:language
- eng
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/58906