Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 16 of 16 for “"skip-gram"”.
-
Contributions to Fairness and Transparency
… The first topic concerns text mining. GloVe and Skip-gram word embedding methods learn word vectors by decomposing a denoised matrix of word co-occurrences into a low-rank matrix. In this work, we propose an iterative algorithm for computing word vectors based on modeling word co-occurrence …
-
DBpedia Type and Entity Detection Using Word Embeddings and N-gram Models
… sets of features: entity embedding features (Skip-gram and CBOW models) and traditional n-gram features. We present evaluation results for 358 DBpedia classes extracted from the DBpedia ontology. The main contribution of this work consists of the development of automatic invalid type …
-
Doporučovací systém pro webové články
… na neuronových sítích, která aplikuje metodu Skip-gram negative sampling na problematiku doporučování. V další části pak implementuje tuto architekturu společně s několika dalšími modely, požívající algoritmus SVD, collaborative filtering s algoritmem ALS a také metodu Doc2Vec k vytvoření …
-
An Exploration of the Word2vec Algorithm: Creating a Vector Representation of a Language Vocabulary that Encodes Meaning and Usage Patterns in the Vector Space Structure
… a discussion of continuous bag of words, skip-gram, hierarchical softmax, and negative sampling. Finally, Chapter 5 explores some applications of vector representations: word categorization, analogy completion, and language translation assistance.
-
Lietuvių literatūros tekstais apmokytų „GloVe“ ir „Word2Vec“ modelių palyginimas ir pritaikymas /
… analysis of the word embedding models “Word2Vec Skip-gram”, “Word2Vec Continuous Bag-of-Words” and “GloVe” is performed. These models were trained on Lithuanian literary works in order to apply them in the development of an educational tool. It was compared which models are more effective in …
-
Exploring the dynamics underlying taxonomic and thematic representations
… of word embeddings are learned through the same skip-gram model with negative sampling and their performances in measuring the strength of taxonomic and thematic relations were assessed based on human subjective ratings. The assessment results indicated that word2vec-based measures are …
-
Conditional Neural Language Models for Multimodal Learning and Natural Language Understanding
… tensor. Finally we show how we can abstract the skip-gram model for learning word representations to a conditional recurrent neural language model for unsupervised learning of sentence representations. We introduce a family of models called contextual encoder-decoders and demonstrate how our …
-
EVALUATING DISTRIBUTED WORD REPRESENTATIONS FOR PREDICTING MISSING WORDS IN SENTENCES
… as compared to traditional language models like Ngram. In this thesis, we explored various state-of-the-art methods like Latent Semantic Analysis, word2vec, and GloVe to learn the distributed representation of words. Their performance was compared based on the accuracy achieved when tasked with …
-
FUSE: Multi-faceted set expansion by coherent clustering of skip-grams
… seed entity by extracting and clustering its skip-grams, (2) facet fusion module: discovers shared semantic facets of the entire seed set by an optimization formulation, and (3) entity expansion module: expands each semantic facet by utilizing an iterative algorithm robust to skip-gram noise. …
-
Comparing PSO-Based Clustering Over Contextual Vector Embeddings to Modern Topic Modeling
… 30% when pPSO is applied to the same Skip-Gram embedding derived from a limited, corpus-specific vocabulary which is used by ETM and NVDM.
-
Evaluation of Word and Paragraph Embeddings and Analogical Reasoning as an Alternative to Term Frequency-Inverse Document Frequency-based Classification in Support of Biocuration
… A shallow neural network implementing the Skip-Gram algorithm is used to generate semantic vectors using a corpus of approximately 2.4 billion words. The ability to capture meaning is assessed by comparing semantic vectors generated with MESH. Results indicate that semantic vectors trained …
-
Domain-Specific Senitment Analysis of Historical Australian Parliamentary Speeches
… the corpus. We compared two embedding methods, Skip- Gram with Negative Sampling (SGNS) and Positive Pointwise Mutual Information with dimensionality reduction using truncated Singular Value Decomposition (PPMI-SVD). We also used embeddings constructed on different time periods to make inference …
-
Representation Learning With Convolutional Neural Networks
… vector representations with continuous Skip-gram model. The learned representations which capture a large number of precise syntactic and semantic word relationships are taken as input of Convolution Neural Networks for classification. Our experimental results show the effectiveness of …
-
Biomedical Semantic Embeddings: Using Hybrid Sentences to Construct Biomedical Word Embeddings and its Applications
Word embeddings is a useful method that has shown enormous success in various NLP tasks, not only in open domain but also in biomedical domain. The biomedical domain provides various domain specific resources and tools that can be exploited to improve performance of these word embeddings. However, …
-
Multi-Layer Web Services Discovery using Word Embedding and Clustering Techniques
… embedding models, the pre-trained Word2Vec’s skip-gram model reported higher performance in clustering Web services. Among the three semantic similarity measures, path-based WordNet similarity reported higher clustering performance. By considering the different words representations models and …
-
Novel Algorithms for Understanding Online Reviews
… words and their contexts are learned from the skip-gram view of a corpus. We conduct extensive sets of experiments on several short text corpora to demonstrate the proposed model can discover meaningful and coherent topics. For document-level review understanding, we have focused on building …