Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 196 for “"Pre-trained models"”.
-
Mining Visual Knowledge from Pre-trained Models
… labels. This thesis aims to bridge this gap by presenting a practical solution: pre-training deep neural networks on accessible large-scale internet images, and then employing various techniques to adapt these pre-trained models to diverse downstream tasks with minimal or no additional data. In …
-
Attribute inference privacy protection for pre-trained models
… from scratch or extensive fine-tuning of models, posing significant barriers to the development of privacy-conscious models, particularly for smaller organizations seeking to comply with data privacy laws. In this thesis, we address the privacy challenges in computer vision by …
-
Aligning pre-trained models for spoken language translation
… modalitami řeči a textu mapováním embedding reprezentací ASR enkodéru do latentního prostoru reprezentací MT modelu. Během trénování jsou zvolené ASR a MT model zmrazeny, laděny jsou pouze parametry spojovacího modulu. Trénování a evaluace jsou prováděny na datasetu How2, obsahujícím ST data z …
-
Efficient Transfer Learning using Pre-trained Models on CT/MRI
… process makes use of fine-tuning to align the pretrained model with the target class, feature extraction to preserve learned information for downstream classification tasks, and shallow deep learning to perform subsequent training. Experiments are done to compare the performance of the proposed …
-
Solving inverse problems with deep learning : from untrained to pre-trained models
… problem of recovering signals from lossy or compressed measurements arises in numerous settings across science, medicine, and engineering. Since these inverse problems are often ill-posed, imposing useful prior beliefs about the unknown signals is key to accurate recovery. Recently, deep …
-
Contextual topics: advancing text segmentation through pre-trained models and contextual keywords
… in creating structured, searchable text-based representations after digitizing paper-based documents. Traditionally, TS has been approached with sub-optimal feature engineering efforts and heuristic modelling. In this work, we explore novel supervised training procedures with a labeled text …
-
Adapting Pre-Trained Models and Leveraging Targeted Multilinguality for Under-Resourced and Endangered Language Processing
… used to train large neural network-based models. However, these techniques are inapplicable to the vast majority of the world's languages, which lack the vast digitized text datasets available for English and a few other very high-resource languages. In this dissertation, we present three …
-
Strategic Reduction of Training and Annotation in Computer Vision: Leveraging Pre-trained Models and Auxiliary Tasks for Efficient Learning
… data annotation and training processes presents significant challenges for broader application. This thesis addresses the following key questions: 1) How can we improve existing semi-supervised learning models to maintain relatively high performance with fewer training annotations? 2) …
-
Iš anksto apmokytų modelių taikymas sentimentų analizės uždavinio sprendimui /
The main objective of this thesis is to apply pre-trained models to the task of sentiment analysis. To achieve this goal, an analysis of existing pre-trained models and traditional classification algorithms was conducted, selecting the most common classification techniques. Data sets created for …
-
Low-shot Learning based on Pre-trained Model
… of low-shot learning by aiming to equip learning models with the capability to generalize effectively from limited examples. It explores various low-supervision methodologies, including self-supervised, unsupervised, semi-supervised, and active learning, with the goal of reducing the reliance on …
-
Visual understanding of the physical world
… we build our method on top of large-scale pre-trained models or their representations.<br><br>For occlusion understanding and handling, we design a tri-layer plugin for conventional pre-trained object detectors to improve the performance of object detection and instance segmentation under …
-
Using pre-trained language models for extractive text summarisation of academic papers
… With the development of neural networks and pre-trained models within natural language processing in recent years, such as BERT and its derivatives, the field of automatic text summarisation has seen a lot of progress. These models have been pre-trained on large amounts of data for general …
-
An image classification approach based on graph convolutional networks and patch-based multiscale feature graphs
Deep learning architectures have demonstrated impressive results in image classification in the last few years. However, applying sophisticated neural network architectures in small datasets remains challenging. In this context, transfer learning is a promising ap proach for dealing with this …
-
DEEP-LEARNING FOR INDUSTRIAL DATA ANALYTICS
Deep-learning based models are prevalent in all areas of Natural Lan- guage Processing (NLP). Advent of attention based deep bi-directional architectures (Transformers) has given rise to powerful language mod- els (e.g. BERT, RoBERTa and XLNet). These pre-trained models utilize large unsupervised …
-
Lifelong Machine Learning without Lifelong Data Retention
Machine learning models suffer from a phenomenon known as catastrophic forgetting when learning novel concepts from continuously shifting training data. Typical solutions for this continual learning problem require extensive replay of previously seen data, which increases memory costs and may …
-
Cross-modal image feature matching between infrared and visual images. Adapting intra-modal feature matching models for cross-modal matching
… by utilizing the matching capabilities of the pre-trained intra-modal models SuperPoint and SuperGlue. This is done by adding interfacing models and additional layers to mitigate problems such as catastrophic forgetting and data biasing in the pre-trained models. These techniques prove only …
-
Automatic Emergency Detection in Naval VHF Transmissions
… The research also shows that many of the pre-trained models do not have adequate performance on the intended domain, but it was noted that using semi-supervised methods such pre-trained models can be tuned to reach acceptable performance levels. This can be done with smaller sets of …
-
Profile Modeling in Hierarchical Deep Architecture by Mutual Support
… Neural Networks (MFCNN), which can comprehensively implement face analysis including age, gender, race and emotion. Moreover, we take the advantages of the mutual support among different facial features from individual tasks to improve the performance of our model. We also contribute …
-
Epilepsijos priepuolių aptikimas EEG signaluose /
… neural network (CNN) architectures and pre-trained models: ResNet50, ResNet50V2, EfficientNetB0, and EfficientNetV2B0. The best results among SVM models were achieved by the configuration with the Haar wavelet function and 5-level decomposition, which showed 0.86 accuracy, 0.91 …
Page 1 of 10