Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 150 for “"Finetuning"”.

  1. Meta-learning and synthetic data for automated pretraining and finetuning

    … the pretrained model and the hyperparameters for finetuning to it. <br>Moreover, as models grow in scale, the increasing reliance on real-world data poses a bottleneck for training and requires leveraging data more effectively. <br>Addressing the first challenge often involves manual model …

    freiburg-diss Repository record for Meta-learning and synthetic data for automated pretraining and finetuning (opens in a new tab)

  2. DDK shapes origin chromatin structure and replication efficiency by finetuning INO80 function

    Eukaryotic genomic DNA is wrapped around histone proteins to form nucleosomes, the basic units of chromatin. Chromatin is a higher-order structure and key regulatory element for DNA-template processes. Nucleosomes can regulate the access to DNA during replication, transcription, recombination, and …

    lmu-germany Repository record for DDK shapes origin chromatin structure and replication efficiency by finetuning INO80 function (opens in a new tab)

  3. Instruction Finetuning Foundation Models, Three-Stage Bubble Analysis, and Examining the Size Effect

    Macroeconomic indicators and financial news are important to financial professionals and market participants due to their importance in sentiment analysis, speculative bubble analysis, and portfolio selection. According to the Efficient Market Hypothesis, asset prices incorporate all available …

    unr Repository record for Instruction Finetuning Foundation Models, Three-Stage Bubble Analysis, and Examining the Size Effect (opens in a new tab)

  4. BEYOND VANILLA FINETUNING: APPROACHES TO MAXIMIZE THE BENEFITS OF PRETRAINING IN COMPUTER VISION

    … This baseline is the process of pretrainingand finetuning; initially training a neural network on a large dataset to perform some task and then applying components of that network to new tasks with minimal modifications or additions. Specifically, the feature extractor (dimensionality-reducing …

    cornell Repository record for BEYOND VANILLA FINETUNING: APPROACHES TO MAXIMIZE THE BENEFITS OF PRETRAINING IN COMPUTER VISION (opens in a new tab)

  5. Vaizdų transformacija augmentacijoms naudojantis giliaisiais neuroniniais tinklais /

    … influenced by using translated images for the finetuning process. CycleGAN, DRIT and MSGAN were chosen as the models for image-to-image translation. Object detection results were measure after finetuning Faster-RCNN + ResNet101 and SSD + MobileNetV2 models. BDD100K and „Transient Attribute“ …

    vilnius Repository record for Vaizdų transformacija augmentacijoms naudojantis giliaisiais neuroniniais tinklais / (opens in a new tab)

  6. Neural Network Pruning for ECG Arrhythmia Classification

    … employs a pruning phase interleaved with a finetuning phase. It is shown that when performing the scale-factor pruning algorithm on ECG, finetuning time can be expedited by 1.4 times over the traditional approach with only 10% of expensive floating-point operations retained, while …

    calpoly Repository record for Neural Network Pruning for ECG Arrhythmia Classification (opens in a new tab)

  7. INVESTIGATING LONGITUDINAL ASSOCIATIONS OF BRAIN AGE AND COGNITION

    … generalized to elderly participants but required finetuning for children. After finetuning, we found that changes in brain age gap were associated with future executive function in both age groups. Additionally, lateral ventricles and frontal areas were key for predicting brain age in older …

    nus Repository record for INVESTIGATING LONGITUDINAL ASSOCIATIONS OF BRAIN AGE AND COGNITION (opens in a new tab) Download file for INVESTIGATING LONGITUDINAL ASSOCIATIONS OF BRAIN AGE AND COGNITION (opens in a new tab)

  8. The Influence of Political Media on Large Language Models: Impacts on Information Synthesis, Reasoning, and Demographic Representation

    This thesis investigates the impact of finetuning the LLaMA 33B language model on partisan news datasets, revealing negligible changes and underscoring the enduring influence of pretraining datasets on model opinions. Training nine models across nine distinct news datasets spanning three topics and …

    byu Repository record for The Influence of Political Media on Large Language Models: Impacts on Information Synthesis, Reasoning, and Demographic Representation (opens in a new tab) Download PDF for The Influence of Political Media on Large Language Models: Impacts on Information Synthesis, Reasoning, and Demographic Representation (opens in a new tab)

  9. From Multimodal LLMs to Generalist Embodied Agents

    This thesis investigates how finetuning multimodal large language models (MLLMs) with large-scale embodied experience unlocks their ability to act as generalist embodied agents. While MLLMs provide reasoning abilities and broad world knowledge, finetuning aligns these capabilities with the demands …

    gatech Repository record for From Multimodal LLMs to Generalist Embodied Agents (opens in a new tab)

  10. Improving language models with novel contrastive learning objectives

    … methods for deploying CL in both pretraining and finetuning of language models. First, we present PACT (Pretraining with Adversarial Contrastive Learning for Text Classification), a novel self-supervised framework for text classification. Instead of contrasting against in-batch negatives, a …

    ubc Repository record for Improving language models with novel contrastive learning objectives (opens in a new tab) Download PDF for Improving language models with novel contrastive learning objectives (opens in a new tab)

  11. Regos-kalbos modelių adaptavimas medicininiams aprašams lietuvių kalba /

    … The Unsloth framework was used for additional finetuning of the models, enabling more efficient training while reducing the amount of computational resources required.In addition, an evaluation methodologywasdevelopedtoprovideamorecomprehensiveanalysisofthemodels’performance. The evaluation …

    vilnius Repository record for Regos-kalbos modelių adaptavimas medicininiams aprašams lietuvių kalba / (opens in a new tab)

  12. Relation extraction: exploring syntax parsing and constructing it as attention-like structure

    … tree structure to matrixes and apply on the finetuning process of SyntaxBERT [2] and syntax-aware -local-attention attention BERT (SLA) [3] to strengthen their ability to learning entity relations. They would be finetuned on TACRED [4] dataset. They are compared with the finetuning of …

    uiuc Repository record for Relation extraction: exploring syntax parsing and constructing it as attention-like structure (opens in a new tab)

  13. Learning dynamics of deep learning -- force analysis of deep neural networks

    … for student models. Large language model (LLM) finetuning: We extend the framework to account for the autoregressive nature of LLMs and the presence of negative gradients. The unified perspective explains behaviors across finetuning methods such as SFT, DPO, and GRPO. We also highlight the …

    ubc Repository record for Learning dynamics of deep learning -- force analysis of deep neural networks (opens in a new tab) Download PDF for Learning dynamics of deep learning -- force analysis of deep neural networks (opens in a new tab)

  14. Giliųjų neuroninių tinklų priešiškas apmokymas /

    … training with two different techniques - finetuning and feature extraction. Of these methods only finetuning model was successful in learning robust features.

    vilnius Repository record for Giliųjų neuroninių tinklų priešiškas apmokymas / (opens in a new tab)

  15. Fast and Expressive Sketch Structured Transform for Efficient Inference

    … models from scratch for faster inference. (b) Finetuning projected BERT models for 1.31× faster inference while maintaining GLUE scores. (c) Proof of concept with Llama-3-8b, showing 1.11× faster wall clock inference using projected SS1 layers without finetuning.

    rice Repository record for Fast and Expressive Sketch Structured Transform for Efficient Inference (opens in a new tab)

  16. Transfer Learning Using L2 Speech to Improve Automatic Speech Recognition of Dysarthric Speech

    … L2 speech dataset, L2-Arctic, using standard finetuning and multitask learning paradigms. It examines whether including L2 speech in the training data improves dysarthric speech recognition in speaker-dependent, speaker-independent, and zero-shot settings. Our results suggest that including L2 …

    washington Repository record for Transfer Learning Using L2 Speech to Improve Automatic Speech Recognition of Dysarthric Speech (opens in a new tab)

  17. Data-Efficient Learning in Image Synthesis and Instance Segmentation

    … high-quality and diverse image generation from finetuning to only 5-100 images. Our method factors a pretrained model into a small but highly expressive weight space for finetuning, which discourages overfitting in a small training set. We validate our method in a challenging few-shot setting of …

    vt Repository record for Data-Efficient Learning in Image Synthesis and Instance Segmentation (opens in a new tab)

  18. Accessible Foundation Models: Systems, Algorithms, and Science

    … are used to make predictions after training, finetuning approaches that adapt a trained model to new data, and finally, full training of foundation models from scratch. For inference, I will describe our LLM.int8() algorithm, which showed how to enable high-precision 8-bit matrix …

    washington Repository record for Accessible Foundation Models: Systems, Algorithms, and Science (opens in a new tab)

  19. Automatizuotas vienetų testų generavimas naudojant kalbos modelius /

    … underexplored area. The study was carried out by finetuning the model, as well as evaluating tools that exist in the industry. The study found that, as it stands, language models are still far behind alternative test generation methods such as reinforcement learning.

    vilnius Repository record for Automatizuotas vienetų testų generavimas naudojant kalbos modelius / (opens in a new tab)

Page 1 of 8