Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 59 for “"parameter-efficient fine-tuning"”.
-
Parameter-Efficient Fine-Tuning for Learning Language Model Watermarks
… due to the high computational costs of fine-tuning large language models. This thesis explores two different parameter-efficient fine-tuning methods for training large language models to mimic watermarked models. These methods are: (i) the low rank adaptations and (ii) transfer learning. …
-
Parameter-Efficient Fine-Tuning for Learning Language Model Watermarks
… due to the high computational costs of fine-tuning large language models. This thesis explores two different parameter-efficient fine-tuning methods for training large language models to mimic watermarked models. These methods are: (i) the low rank adaptations and (ii) transfer learning. …
-
Parameter-Efficient Fine-Tuning for Learning Language Model Watermarks
… due to the high computational costs of fine-tuning large language models. This thesis explores two different parameter-efficient fine-tuning methods for training large language models to mimic watermarked models. These methods are: (i) the low rank adaptations and (ii) transfer learning. …
-
Parameter-Efficient Fine-Tuning for Learning Language Model Watermarks
… due to the high computational costs of fine-tuning large language models. This thesis explores two different parameter-efficient fine-tuning methods for training large language models to mimic watermarked models. These methods are: (i) the low rank adaptations and (ii) transfer learning. …
-
Optimizing Transformer Models: From Isotropic Architectural Design to Parameter-Efficient Fine-Tuning for Large-Scale NLP
… words, e!ciency is not only a question of saving parameters or reducing FLOPs, but also a question of avoiding representational pathologies that waste capacity by collapsing variation. This motivates a representational viewpoint in which the geometry of contextual embedding spaces is treated as a …
-
Parameter-efficient fine-tuning for software engineering : a systematic study of low-resource and multilingual knowledge transfer
… languages remains computationally expensive. Parameter-Efficient Fine-Tuning (PEFT) methods address this challenge by updating only a small subset of parameters or introducing lightweight adaptation modules. However, there is limited empirical understanding of how different PEFT methods behave …
-
Interpretable and Efficient Music Harmonic Analysis Using Multilinear Mixture of Experts and Parameter-Efficient Fine-Tuning Methods
Σκοπός της παρούσας διπλωματικής εργασίας είναι η μελέτη της αυτόματης ανάλυσης αρμονίας με ρωμαϊκούς αριθμούς (Roman Numeral Analysis) στο πεδίο της ανάκτησης μουσικής πληροφορίας (Music Information Retrieval) και πώς αυτή μπορεί να βελτιωθεί βάσει της αποδοτικότητας και της ερμηνευσιμότητας. Τα …
-
ScPEFT : a parameter-efficient fine-tuning framework for enhancing single-cell large language models in out-of-context
… To address this, we introduce a single-cell parameter-efficient fine-tuning (scPEFT) framework that integrates learnable, low-dimensional adapters into scLLMs. By freezing the backbone model and updating only the adapter parameters, scPEFT efficiently adapts to specific tasks using limited …
-
Training a massively multimodal transformer on YouTube data: pre-training and parameter efficient fine-tuning on HPC infrastructure
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2023-09-01 without embargo terms
-
Closed Domain Question Answering With Language Models: Application of Retrieval-Augmented Generation and Parameter Efficient Fine-Tuning In Healthcare
… Retrieval-Augmented Generation (RAG) with Parameter-Efficient Fine-Tuning (PEFT) to create a scalable, efficient, and domain-specific solution. By leveraging structured datasets of dementia-related question-answer pairs and integrating advanced techniques like context injection and model …
-
Design and implementation of a parameter-efficient fine-tunning website for pre-defined ai model /
… software engineering challenges associated with parameter-efficient fine-tuning (PEFT) of large language models, particularly the complexity, cost and inefficiency of manual experimentation. The main contribution is the design and implementation of a web-based tool that helps researchers and …
-
DYNAMIC NEURAL NETWORKS FOR EFFICIENT VISION MODEL INFERENCE
… is hindered by high training overhead from full-parameter fine-tuning and limited application beyond visual perception. This thesis addresses these challenges through three key contributions: Parameter-Efficient Fine-Tuning (PEFT): We demonstrate that dynamic networks can be developed with …
-
INVESTIGATION INTO THE DUALITY OF CONTEXT PROMPTS AND LARGE LANGUAGE MODEL WEIGHTS
… suggests a deep connection between context and parameters. This thesis formalizes that link, showing that ICL in a single linear attention layer equals one gradient-descent step on an analytically defined dataset, and in multi-layer networks acts as a greedy layer-wise training process. We then …
-
Efficient Fine-Tuning of Foundation Models: Generalization, Disparity, and Subgroup Adaptation
… First, it studies demographic adaptation with parameter-efficient fine-tuning (PEFT) under realistic constraints where full fine-tuning is infeasible and available data are skewed. We evaluate five adaptation strategies, three pretraining paradigms, and multiple medical imaging datasets, …
-
TASK-ORIENTED DIALOGUE UNDERSTANDING AND EVALUATION USING MINIMAL DATA
… TOD-specific automated data augmentation, and a Parameter-Efficient Fine-Tuning (PEFT) method, aimed at enhancing system adaptability to new domains. It also proposes a novel evaluation metric, Granular Change Accuracy (GCA), offering a more precise assessment of DST model performance and …
-
Retrieval-augmented speech-based question answering system
… odpovídání na otázky nad dlouhým audiem, zatímco parameter-efficient fine-tuning pomocí LoRA adaptérů dále zvyšuje přesnost na benchmarku. Dodatečná analýza však ukazuje, že model se často více spoléhá na interní jazykové znalosti než na informace obsažené ve vyhledaném audiu. Výsledky práce …
-
Domain-Aware Reasoning with Lightweight Models via Knowledge Distillation
… and RAG-retrieved context, the student model was fine-tuned via Supervised Fine-Tuning (SFT) on the teacher’s generated reasoning chains, employing Parameter-Efficient Fine-Tuning (PEFT) with Low-Rank Adaptation (LoRA). Comprehensive evaluation, incorporating both AI-assisted analysis and blind …
-
Efficient inference and adaptation in deep learning : from edge systems to large language models
… research problem.This thesis investigates efficient inference, training, and adaptation in DL across the model lifecycle from four complementary perspectives: (1) enabling lightweight and energy-efficient inference of DL models on edge devices and distributed Internet of Things (IoT) …
-
Automatic Generation of vTESTstudio Test Cases from Natural Language Requirements Using Large Language Models
… further studies retrieval-based grounding, parameter-efficient fine-tuning for intermediate representation generation, and retrieved skill guidance for improving logical planning. On the small evaluation sets used in this thesis, the proposed pipeline produced useful test artefacts in …
Page 1 of 3