Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 772 for “"pre-training"”.

  1. Procedural Pre-Training for Visual Recognition

    … Usually, this requires a large amount of data. Pre-training refers to a process of creating a strong initial model by first training it on a large-scale dataset. Such a model can then be adapted to many different tasks, while only requiring a comparatively small amount of task-specific training …

    byu Repository record for Procedural Pre-Training for Visual Recognition (opens in a new tab) Download PDF for Procedural Pre-Training for Visual Recognition (opens in a new tab)

  2. SELF-SUPERVISED PRE-TRAINING FOR PASSIVE SONAR

    … more than 20,000 hours of passive sonar data, we pre-train five transformer models with unique self-supervised approaches to learn data representations without explicit labels, establishing a robust foundation for downstream passive sonar tasks. After this initial pre-training on a noisily labeled …

    nps Repository record for SELF-SUPERVISED PRE-TRAINING FOR PASSIVE SONAR (opens in a new tab)

  3. Self-supervised pre-training for drowsiness prediction

    … with machine learning emerging as a more widespread approach. However, the lack of high-quality data frequently hinders the development of neural networks, also in this domain. Over the past decade, pre-training of neural networks using self-supervised learning techniques has proven to be an …

    chalmers Repository record for Self-supervised pre-training for drowsiness prediction (opens in a new tab)

  4. Large-Scale Offline Pre-Training Bootstraps Embodied Intelligence

    … In this dissertation, we will argue that offline pre-training of foundation models on web-scale data can bootstrap embodied intelligence. In part 1, we present VC-1, a visual foundation model pre-trained (primarily) on video data collected from an egocentric perspective. We systematically …

    gatech Repository record for Large-Scale Offline Pre-Training Bootstraps Embodied Intelligence (opens in a new tab)

  5. Synthetic pre-training for robustness in information retrieval

    Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms

    uiuc Repository record for Synthetic pre-training for robustness in information retrieval (opens in a new tab)

  6. SCALING PRE-TRAINING DATA & LANGUAGE MODELS FOR AFRICAN LANGUAGES

    … This thesis addresses this gap by scaling pre-training data and developing improved language models for African languages. We introduce Wura, a high-quality, document-level pre-training dataset encompassing 16 African languages along with four high-resource languages commonly spoken on the …

    waterloo Repository record for SCALING PRE-TRAINING DATA & LANGUAGE MODELS FOR AFRICAN LANGUAGES (opens in a new tab)

  7. An Investigation of Pre-training Strategies for Sensor Data

    … powerful artificial intelligence models through pre-training has become the dominant precedent in well understood areas such as natural language processing and computer vision. Pre-training has led to the creation of foundation models such as ChatGPT, GPT-4, Llama, and MocoV3, among many others. …

    queens Repository record for An Investigation of Pre-training Strategies for Sensor Data (opens in a new tab)

  8. Optimized Generative Pre-training EEG to Sentiment Classification (OGPTSC)

    … the groundbreaking "Optimized Chat Generative Pre-training EEG to Sentiment Classification (OGPTSC)." This novel approach harnesses the power of Generative Pre-training (GPT2) as the vocabulary language model while utilizing an intelligent hyper-parameter selection method to fine-tune and …

    rit Repository record for Optimized Generative Pre-training EEG to Sentiment Classification (OGPTSC) (opens in a new tab)

  9. TOWARDS ADVERSARIALLY ROBUST REPRESENTATIONS: EVALUATION, PRE-TRAINING, AND FINE-TUNING

    Self-supervised pre-training on vast unlabelled datasets can yield generalizable representations, which have exhibited remarkable performance across diverse downstream tasks through fine-tuning. Nevertheless, the fine-tuned representations are not resistant to adversarial attacks in downstream …

    nus Repository record for TOWARDS ADVERSARIALLY ROBUST REPRESENTATIONS: EVALUATION, PRE-TRAINING, AND FINE-TUNING (opens in a new tab) Download file for TOWARDS ADVERSARIALLY ROBUST REPRESENTATIONS: EVALUATION, PRE-TRAINING, AND FINE-TUNING (opens in a new tab)

  10. Impact of pre-training on background knowledge and societal bias

    <p>With appropriate pre-training on unstructured text, larger and more accurate neural network models can be trained. Unfortunately, unstructured pre-training data may contain undesired societal biases, which a model may mimic and amplify. This thesis focuses on both improving unsupervised …

    oxford Repository record for Impact of pre-training on background knowledge and societal bias (opens in a new tab)

  11. END-TO-END RELATION EXTRACTION USING SEMI-SUPERVISED PRE-TRAINING

    … identifying all relations between all predicted entities. Through this work, we introduce multi-task fine-tuning on pre-trained models as an approach for related tasks and show that it gives significant performance improvements for each of the individual tasks. Our model performs …

    tamu Repository record for END-TO-END RELATION EXTRACTION USING SEMI-SUPERVISED PRE-TRAINING (opens in a new tab)

  12. IMPACT OF PRE-TRAINING ON DAIRY CATTLE AUTOMATIC MILKING SYSTEM ACCLIMATION

    … A5 AMS. The robot-exposed group underwent a pre-training protocol before the first robotic milking, while the non-exposed group was not acclimated before the first robotic milking. Cows experiencing pre-training (<strong>TRT</strong>) had higher milk yield and fat percentages compared to no …

    ut-knoxville Repository record for IMPACT OF PRE-TRAINING ON DAIRY CATTLE AUTOMATIC MILKING SYSTEM ACCLIMATION (opens in a new tab)

  13. Turn of Phrase: Contrastive Pre-Training for Discourse-Aware Conversation Models

    … conversation. Recent advances in unsupervised representation learning of text have been attained primarily through language modeling, which models discourse only implicitly and within a small window. These representations are in turn evaluated chiefly on sentence pair or paragraph-question pair …

    byu Repository record for Turn of Phrase: Contrastive Pre-Training for Discourse-Aware Conversation Models (opens in a new tab) Download PDF for Turn of Phrase: Contrastive Pre-Training for Discourse-Aware Conversation Models (opens in a new tab)

  14. Predicting learning success from patterns of pre-training magnetic resonance images

    … cognitive and psychomotor tasks improves with training, yet the extent of improvement varies among individuals. Is it possible to forecast the benefit that a person might reap from training? What is the mechanism underlying learning? Several behavioral measures have been used to predict …

    uiuc Repository record for Predicting learning success from patterns of pre-training magnetic resonance images (opens in a new tab)

  15. Self-supervised pre-training with Vision Foundation Models on 3D point clouds

    … Therefore, this thesis investigates two pre-training tasks for 3D object detection in LiDAR point clouds and highlights their effectiveness in one-shot and few-shot detection. The pre-training methods in this project utilise two different web-scaled foundation models, namely, SAM 2 and …

    chalmers Repository record for Self-supervised pre-training with Vision Foundation Models on 3D point clouds (opens in a new tab)

Page 1 of 39