Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 772 for “"pre-training"”.
-
Procedural Pre-Training for Visual Recognition
… Usually, this requires a large amount of data. Pre-training refers to a process of creating a strong initial model by first training it on a large-scale dataset. Such a model can then be adapted to many different tasks, while only requiring a comparatively small amount of task-specific training …
-
SELF-SUPERVISED PRE-TRAINING FOR PASSIVE SONAR
… more than 20,000 hours of passive sonar data, we pre-train five transformer models with unique self-supervised approaches to learn data representations without explicit labels, establishing a robust foundation for downstream passive sonar tasks. After this initial pre-training on a noisily labeled …
-
Self-supervised pre-training for drowsiness prediction
… with machine learning emerging as a more widespread approach. However, the lack of high-quality data frequently hinders the development of neural networks, also in this domain. Over the past decade, pre-training of neural networks using self-supervised learning techniques has proven to be an …
-
Large-Scale Offline Pre-Training Bootstraps Embodied Intelligence
… In this dissertation, we will argue that offline pre-training of foundation models on web-scale data can bootstrap embodied intelligence. In part 1, we present VC-1, a visual foundation model pre-trained (primarily) on video data collected from an egocentric perspective. We systematically …
-
Synthetic pre-training for robustness in information retrieval
Submission original under an indefinite embargo labeled 'Open Access'. The submission was exported from vireo on 2022-11-15 without embargo terms
-
Pre-training context effects : training assignment as feedback
Thesis (Ph.D.)--Michigan State University. Department of Psychology, 1993
-
SCALING PRE-TRAINING DATA & LANGUAGE MODELS FOR AFRICAN LANGUAGES
… This thesis addresses this gap by scaling pre-training data and developing improved language models for African languages. We introduce Wura, a high-quality, document-level pre-training dataset encompassing 16 African languages along with four high-resource languages commonly spoken on the …
-
An Investigation of Pre-training Strategies for Sensor Data
… powerful artificial intelligence models through pre-training has become the dominant precedent in well understood areas such as natural language processing and computer vision. Pre-training has led to the creation of foundation models such as ChatGPT, GPT-4, Llama, and MocoV3, among many others. …
-
Optimized Generative Pre-training EEG to Sentiment Classification (OGPTSC)
… the groundbreaking "Optimized Chat Generative Pre-training EEG to Sentiment Classification (OGPTSC)." This novel approach harnesses the power of Generative Pre-training (GPT2) as the vocabulary language model while utilizing an intelligent hyper-parameter selection method to fine-tune and …
-
TOWARDS ADVERSARIALLY ROBUST REPRESENTATIONS: EVALUATION, PRE-TRAINING, AND FINE-TUNING
Self-supervised pre-training on vast unlabelled datasets can yield generalizable representations, which have exhibited remarkable performance across diverse downstream tasks through fine-tuning. Nevertheless, the fine-tuned representations are not resistant to adversarial attacks in downstream …
-
Impact of pre-training on background knowledge and societal bias
<p>With appropriate pre-training on unstructured text, larger and more accurate neural network models can be trained. Unfortunately, unstructured pre-training data may contain undesired societal biases, which a model may mimic and amplify. This thesis focuses on both improving unsupervised …
-
END-TO-END RELATION EXTRACTION USING SEMI-SUPERVISED PRE-TRAINING
… identifying all relations between all predicted entities. Through this work, we introduce multi-task fine-tuning on pre-trained models as an approach for related tasks and show that it gives significant performance improvements for each of the individual tasks. Our model performs …
-
IMPACT OF PRE-TRAINING ON DAIRY CATTLE AUTOMATIC MILKING SYSTEM ACCLIMATION
… A5 AMS. The robot-exposed group underwent a pre-training protocol before the first robotic milking, while the non-exposed group was not acclimated before the first robotic milking. Cows experiencing pre-training (<strong>TRT</strong>) had higher milk yield and fat percentages compared to no …
-
Turn of Phrase: Contrastive Pre-Training for Discourse-Aware Conversation Models
… conversation. Recent advances in unsupervised representation learning of text have been attained primarily through language modeling, which models discourse only implicitly and within a small window. These representations are in turn evaluated chiefly on sentence pair or paragraph-question pair …
-
Predicting learning success from patterns of pre-training magnetic resonance images
… cognitive and psychomotor tasks improves with training, yet the extent of improvement varies among individuals. Is it possible to forecast the benefit that a person might reap from training? What is the mechanism underlying learning? Several behavioral measures have been used to predict …
-
Self-supervised pre-training with Vision Foundation Models on 3D point clouds
… Therefore, this thesis investigates two pre-training tasks for 3D object detection in LiDAR point clouds and highlights their effectiveness in one-shot and few-shot detection. The pre-training methods in this project utilise two different web-scaled foundation models, namely, SAM 2 and …
Page 1 of 39