Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 67 for “"Language Modelling"”.
-
Language modelling approaches to adaptive machine translation
… limitations and efficiency constraints. Large language models (LLMs) have recently shown interesting capabilities of in-context learning, where they learn to replicate certain input-output text generation patterns, without further fine-tuning. Such capabilities have opened new horizons for …
-
Accelerating scientific discovery using domain adaptive language modelling
… In all three cases, we rely on transformer-based Language Models and adhere to domain adaptive techniques to achieve our goals by providing efficient methods in terms of both performance and needed training/inference requirements. Concluding our work, we discuss the importance of our …
-
Enhancing Post Silicon Visibility Using Language Modelling Techniques
The debugging phase is a critical time in the development of a new system on chip product. Specifically, the post-silicon validation phase is one of the most important, as it allows engineers to test the behavior of a device in a real world setting. However, the issue of noisy or incomplete data is …
-
Learning Distributed Representations for Statistical Language Modelling and Collaborative Filtering
… of data sparsity, is applied to statistical language modelling and collaborative filtering. We introduce three probabilistic language models that represent words using learned real-valued vectors. Two of the models are based on the Restricted Boltzmann Machine (RBM) architecture while the …
-
Improving Searchability of Automatically Transcribed Lectures Through Dynamic Language Modelling
… navigating within recordings, the lexicon and language model used by the ASR engine may be dynamically adapted for the topic of each lecture. A prototype is presented which uses the English Wikipedia as a semantically dense, large language corpus to generate a custom lexicon and language model …
-
Statistical approaches for natural language modelling and monotone statistical machine translation
Esta tesis reune algunas contribuciones al reconocimiento de formas estadístico y, más especícamente, a varias tareas del procesamiento del lenguaje natural. Varias técnicas estadísticas bien conocidas se revisan en esta tesis, a saber: estimación paramétrica, diseño de la función de pérdida y …
-
Deep Learning Based Proteomic Language Modelling for in-silico Protein Generation
A protein is a biopolymer of amino acids that encodes a particular function. Given that there are 20 amino acids possible at each site, even a short protein of 100 amino acids has $20^{100}$ possible variants, making it unrealistic to evaluate all possible sequences in sequence level space. This …
-
Discrepancy-Aware Graph–Language Modelling for Cross-Repository Vulnerability Intelligence Alignment and Automated Repair
… remediation and proposes a unified hybrid graph–language framework with four components. First, our first work uses large language models to extract a structured vulnerability schema (vendor, product, version, component, type/CWE, root cause, attack vector, impact) from diverse reports and to …
-
Machine learning in cycling investigations into classification, computer vision and language modelling in cycling aerodynamics
… use of computer vision and the application of Language Modelling within the domain of cycling. Each area of research is of interest; however, the motivation for these studies was inspired by the Body Rocket system, with the overarching goal of lowering the barrier of entry at the professional …
-
Dual Fixed-Size Ordinally Forgetting Encoding (FOFE) For Natural Language Processing
… ordinally-forgetting encoding (FOFE) on Natural Language Processing (NLP) tasks, called dual-FOFE. The main idea behind dual-FOFE is that it allows the encoding to be done with two different forgetting factors; this would resolve the original FOFEs dilemma in choosing between the benefits offered …
-
Probability models for information retrieval based on divergence from randomness
… discussed and used through-out the thesis. The language modelling approach and the standard probabilistic model are studied under the same foundational view and are experimentally compared to the divergence-from-randomness approach. In revisiting the main information retrieval models in the …
-
DEEP-LEARNING FOR INDUSTRIAL DATA ANALYTICS
… (Transformers) has given rise to powerful language mod- els (e.g. BERT, RoBERTa and XLNet). These pre-trained models utilize large unsupervised corpora along with custom language mod- elling objectives. For instance BERT (Bi-directional Encoder Repre- sentations from Transformers) is a …
-
Discrete language models for video retrieval
… group of users. In this thesis we investigate language modelling approaches, that have been the focus of recent attention within the text information retrieval community, for the video search task. Language models are smoothed discrete generative probability distributions generally of text and …
-
Economic inferences using language models
… created by recent advances in natural language modelling, which appear to remain underexplored as an econometric methodology—a gap this thesis aims to help fill. Through this lens, I revisit three economic inference problems: estimation of the dynamic causal effects of monetary policy, …
-
Automatic speech recognition for closed captioning of television: data and issues
… given to the issues of large vocabulary language modelling and consideration of the acoustic complexity arising in broadcast material.
-
A dialogic reading intervention incorporating AAC modelling and increased communication partner responsiveness during shared storybook reading with children with complex physical, cognitive, and sensory needs who use partner assisted scanning : a thesis presented in partial fulfilment of the requirements for the degree of Master of Speech and Language Therapy at Massey University, Albany, New Zealand
… also seldom appear in the literature on aided language. Children who use AAC require significant intervention to build their receptive and expressive language skills and develop communicative competence. This research examined an evidence based dialogic shared reading strategy which …
-
On the Difficulty of Training Deep Neural Networks with Raw Encephalography Data
… to pre-training extremely large DNNs inspired by language modelling rather than the extensions of successes in computer vision which have tended to be favoured. Finally, I describe the open source software library developed in support of this work, that enables similar work to continue in the …
-
The Design and Application of an Acoustic Front-End for Use in Speech Interfaces
… signal processing, through pattern matching, to language modelling. An acoustic front-end can be considered as a multi-stage process, each of which requires the specification of many parameters. Some parameters have fundamental consequences for the ultimate application of the front-end. …
-
Deep Latent Variable Models for Text Modelling
… topic information are helpful for various text modelling tasks, e.g., language modelling, dialogue response generation. Being able to accurately recognising dialogue acts plays a key role to help generate relevant and meaningful responses for dialogue systems. However, existing deep learning …
Page 1 of 4