Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 150 for “"Finetuning"”.
-
Meta-learning and synthetic data for automated pretraining and finetuning
… the pretrained model and the hyperparameters for finetuning to it. <br>Moreover, as models grow in scale, the increasing reliance on real-world data poses a bottleneck for training and requires leveraging data more effectively. <br>Addressing the first challenge often involves manual model …
-
DDK shapes origin chromatin structure and replication efficiency by finetuning INO80 function
Eukaryotic genomic DNA is wrapped around histone proteins to form nucleosomes, the basic units of chromatin. Chromatin is a higher-order structure and key regulatory element for DNA-template processes. Nucleosomes can regulate the access to DNA during replication, transcription, recombination, and …
-
Instruction Finetuning Foundation Models, Three-Stage Bubble Analysis, and Examining the Size Effect
Macroeconomic indicators and financial news are important to financial professionals and market participants due to their importance in sentiment analysis, speculative bubble analysis, and portfolio selection. According to the Efficient Market Hypothesis, asset prices incorporate all available …
-
BEYOND VANILLA FINETUNING: APPROACHES TO MAXIMIZE THE BENEFITS OF PRETRAINING IN COMPUTER VISION
… This baseline is the process of pretrainingand finetuning; initially training a neural network on a large dataset to perform some task and then applying components of that network to new tasks with minimal modifications or additions. Specifically, the feature extractor (dimensionality-reducing …
-
Vaizdų transformacija augmentacijoms naudojantis giliaisiais neuroniniais tinklais /
… influenced by using translated images for the finetuning process. CycleGAN, DRIT and MSGAN were chosen as the models for image-to-image translation. Object detection results were measure after finetuning Faster-RCNN + ResNet101 and SSD + MobileNetV2 models. BDD100K and „Transient Attribute“ …
-
Neural Network Pruning for ECG Arrhythmia Classification
… employs a pruning phase interleaved with a finetuning phase. It is shown that when performing the scale-factor pruning algorithm on ECG, finetuning time can be expedited by 1.4 times over the traditional approach with only 10% of expensive floating-point operations retained, while …
-
INVESTIGATING LONGITUDINAL ASSOCIATIONS OF BRAIN AGE AND COGNITION
… generalized to elderly participants but required finetuning for children. After finetuning, we found that changes in brain age gap were associated with future executive function in both age groups. Additionally, lateral ventricles and frontal areas were key for predicting brain age in older …
-
The Influence of Political Media on Large Language Models: Impacts on Information Synthesis, Reasoning, and Demographic Representation
This thesis investigates the impact of finetuning the LLaMA 33B language model on partisan news datasets, revealing negligible changes and underscoring the enduring influence of pretraining datasets on model opinions. Training nine models across nine distinct news datasets spanning three topics and …
-
From Multimodal LLMs to Generalist Embodied Agents
This thesis investigates how finetuning multimodal large language models (MLLMs) with large-scale embodied experience unlocks their ability to act as generalist embodied agents. While MLLMs provide reasoning abilities and broad world knowledge, finetuning aligns these capabilities with the demands …
-
Improving language models with novel contrastive learning objectives
… methods for deploying CL in both pretraining and finetuning of language models. First, we present PACT (Pretraining with Adversarial Contrastive Learning for Text Classification), a novel self-supervised framework for text classification. Instead of contrasting against in-batch negatives, a …
-
Regos-kalbos modelių adaptavimas medicininiams aprašams lietuvių kalba /
… The Unsloth framework was used for additional finetuning of the models, enabling more efficient training while reducing the amount of computational resources required.In addition, an evaluation methodologywasdevelopedtoprovideamorecomprehensiveanalysisofthemodels’performance. The evaluation …
-
Relation extraction: exploring syntax parsing and constructing it as attention-like structure
… tree structure to matrixes and apply on the finetuning process of SyntaxBERT [2] and syntax-aware -local-attention attention BERT (SLA) [3] to strengthen their ability to learning entity relations. They would be finetuned on TACRED [4] dataset. They are compared with the finetuning of …
-
Learning dynamics of deep learning -- force analysis of deep neural networks
… for student models. Large language model (LLM) finetuning: We extend the framework to account for the autoregressive nature of LLMs and the presence of negative gradients. The unified perspective explains behaviors across finetuning methods such as SFT, DPO, and GRPO. We also highlight the …
-
Giliųjų neuroninių tinklų priešiškas apmokymas /
… training with two different techniques - finetuning and feature extraction. Of these methods only finetuning model was successful in learning robust features.
-
Fast and Expressive Sketch Structured Transform for Efficient Inference
… models from scratch for faster inference. (b) Finetuning projected BERT models for 1.31× faster inference while maintaining GLUE scores. (c) Proof of concept with Llama-3-8b, showing 1.11× faster wall clock inference using projected SS1 layers without finetuning.
-
Transfer Learning Using L2 Speech to Improve Automatic Speech Recognition of Dysarthric Speech
… L2 speech dataset, L2-Arctic, using standard finetuning and multitask learning paradigms. It examines whether including L2 speech in the training data improves dysarthric speech recognition in speaker-dependent, speaker-independent, and zero-shot settings. Our results suggest that including L2 …
-
Data-Efficient Learning in Image Synthesis and Instance Segmentation
… high-quality and diverse image generation from finetuning to only 5-100 images. Our method factors a pretrained model into a small but highly expressive weight space for finetuning, which discourages overfitting in a small training set. We validate our method in a challenging few-shot setting of …
-
Accessible Foundation Models: Systems, Algorithms, and Science
… are used to make predictions after training, finetuning approaches that adapt a trained model to new data, and finally, full training of foundation models from scratch. For inference, I will describe our LLM.int8() algorithm, which showed how to enable high-precision 8-bit matrix …
-
Automatizuotas vienetų testų generavimas naudojant kalbos modelius /
… underexplored area. The study was carried out by finetuning the model, as well as evaluating tools that exist in the industry. The study found that, as it stands, language models are still far behind alternative test generation methods such as reinforcement learning.
Page 1 of 8