Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 73 for “"seq2seq"”.
-
Data Augmentation with Seq2Seq Models
Paraphrase sparsity is an issue that complicates the training process of question answering systems: syntactically diverse but semantically equivalent sentences can have significant disparities in predicted output probabilities. We propose a method for generating an augmented paraphrase corpus for …
-
Seq2Seq Scene Graph Generation Utilizing Vision-language Pretrained Model
… we present a one-stage sequence-to-sequence (Seq2Seq) SGG model with a Transformer backbone that can be trained alongside other vision-and-language tasks. Our approach achieves good performance in predicting both object labels and relationships. This study demonstrates the feasibility of …
-
An Investigation Into Supervision for Seq2Seq Techniques for Natural Language to Code Translation
… Python Problems (MBPP) dataset, using the mBART seq2seq framework for running experiments. The best performing models pretrained on the full CodeSearchNet dataset, and finetuned on the MBPP dataset. Several avenues for future inquiry and effective experimentation were discovered and solidifed, …
-
Predicting Construction Hiring Considering Impact of Extreme Events, Economic and Political Factors Through Machine Learning Based Direct, seq2Seq, and Spatio-Temporal Models
… trained by the Recurrent Neural Network (RNN) seq2seq model was evaluated based on their Mean Absolute Error (MAE). The results of the best-performing model indicate that the multivariate seq2Seq model can capture general trends and disruptions due to economic recession and natural disasters …
-
Sequence-to-Sequence Automatic Sentence Simplification: Development & Evaluation
… or substitution. The Sequence-to-Sequence (Seq2Seq) model has demonstrated significant efficacy across various natural language processing tasks, making it a primary focus of our research. The thesis’s first focus is the evaluation aspect of sentence simplification models. We are trying to …
-
Question Generation Using Sequence-to-Sequence Model with Semantic Role Labels
… of rule-based and neural sequence-to-sequence (Seq2Seq) models. The proposed method can automatically generate multiple questions from an input sentence covering different views of the sentence as in rule-based methods, while more complicated "rules" can be learned via the Seq2Seq model. The …
-
Comparison of Sequence-to-Sequence and Retrieval Approaches on the Code Summarization and Code Generation Tasks
… We compare the performance of neural seq2seq BiLSTM [Yin et al. 2018] and attentional-GRU architectures [LeClair et al. 2019], along with that of a semantic code search model reproduced from [Sachdev et al. 2018]. We compare these three models' BLEU scores (1) on their original study …
-
FEW-SHOT VOICE AND FOREIGN ACCENT CONVERSION AND ITS APPLICATIONS IN PRONUNCIATION TRAINING
… • Zero-shot VC based on sequence-to-sequence (seq2seq) model • Zero-shot FAC based on seq2seq model In the first approach, I develop a novel sparse representation for VC that requires as much as one minute of speech from each target speaker. The proposed approach consists of two complementary …
-
Tackling sequence to sequence mapping problems with neural networks
… sequence pairs as sequence to sequence (seq2seq) mapping problems. A lot of research has been devoted to finding ways of tackling these problems, with traditional approaches relying on a combination of hand-crafted features, alignment models, segmentation heuristics, and external …
-
Theoretical Expressivity of Self-Attention as a Model of Binary Sequence-To-Sequence Functions and Other Explorations
… as a model of binary sequence-to-sequence (seq2seq) functions, which is the simplest non-trivial case to analyze. We find, using VC dimension and the Sauer-Shelah lemma, that in the limit of long sequences, almost all binary seq2seq functions cannot be implemented by self-attention. We …
-
Summarization of news articles
In this work, two neural summarization models, Seq2seq and the Transformer, with several variations, were implemented and evaluated on the task of abstractively summarizing news articles. Seq2seq yielded poor results, likely due to not being flexible enough to fit the data set. The Transformer …
-
Improvement of Drought Forecast Skill Through Deep Learning Methods
… LSTM (BiLSTM), and Sequence-to-Sequence (Seq2Seq) LSTM - are systematically compared for multi-step prediction of the Standardized Precipitation Evapotranspiration Index (SPEI) across 15 hydroclimatically homogeneous regions identified via the Leiden graph-based clustering algorithm. The …
-
Improvement of Drought Forecast Skill Through Deep Learning Methods
… LSTM (BiLSTM), and Sequence-to-Sequence (Seq2Seq) LSTM - are systematically compared for multi-step prediction of the Standardized Precipitation Evapotranspiration Index (SPEI) across 15 hydroclimatically homogeneous regions identified via the Leiden graph-based clustering algorithm. The …
-
Improvement of Drought Forecast Skill Through Deep Learning Methods
… LSTM (BiLSTM), and Sequence-to-Sequence (Seq2Seq) LSTM - are systematically compared for multi-step prediction of the Standardized Precipitation Evapotranspiration Index (SPEI) across 15 hydroclimatically homogeneous regions identified via the Leiden graph-based clustering algorithm. The …
-
Attention-based neural sequence-to-sequence methods for information extraction and text summarization
… deep learning technique -- sequence-to-sequence (seq2seq). We first explore the fine-grained entity mention classification problem, an instance of naturally occurring hierarchical learning, where an entity mention in a given context or a sentence can have one or more fine-grained types, e.g., …
-
On Natural Motion Processing using Inertial Motion Capture and Deep Learning
… from sparse sensors using Transformers and Seq2Seq models. We found that Transformers perform better than Seq2Seq models in producing upper-body and full-body motion, but that each model can accurately infer human motion for a variety of postures like sitting, standing, kneeling, and bending …
-
Off-policy latent variable modeling for fast bandit personalization
… recommendation using a combination of a seq2seq model, and a Variational Autoencoder (VAE). The VAE condenses intricate patient information into an encoding, and has the ability to reconstruct that information using this encoding. We can thus consider each possible encoding as a patient …
-
Transformer-Based Architectures for Financial Time Series Forecasting: From Single-Stock Learning to Cross-Asset Generalization
… ακολουθίας-προς-ακολουθία (Seq2Seq). Τα αρχικά πειράματα διεξήχθησαν στη μετοχή της Microsoft (MSFT), πριν επεκταθούν σε ευρύτερο σύνολο εταιρειών εισηγμένων στο NASDAQ. Η αγορά NASDAQ επιλέχθηκε λόγω της υψηλής ρευστότητας, της διαθεσιμότητας δεδομένων και της ποικιλομορφίας …
-
Modeling novel data-driven machine learning approaches for traffic congestion & energy forecasting
… Recursive, and Sequence-to-Sequence (seq2seq) Forecasting—each of which leverages novel model development and ensemble techniques to enhance prediction accuracy. In the energy domain, this thesis contributes to both short-term and medium-term energy forecasting (EF) by developing …
-
Enhancing Community Resiliency With Big Data and Machine Learning: Property Damage and Flood Forecasting During Hurricanes
… In the second part, a Sequence to Sequence (Seq2Seq) learning Long Short-Term Memory (LSTM) Encoder Decoder model is proposed for coastal flood prediction. The model leverages the advantages of LSTM cells, Seq2Seq learning, while utilizing a novel learning approach based on learning from both …
Page 1 of 4