Lethbridge, Alta. : University of Lethbridge, Dept. of Mathematics and Computer Science
Abstractive multi-document summarization - paraphrasing and compressing with neural networks
Abstract
dc:description.abstractThis thesis presents studies in neural text summarization for single and multiple documents.The focus is on using sentence paraphrasing and compression for generating fluent summaries, especially in multi-document summarization where there is data paucity. A novel solution is to use transfer-learning from downstream tasks with an abundance of data. For this purpose, we pre-train three models for each of extractive summarization, paraphrase generation and sentence compression. We find that summarization datasets – CNN/DM and NEWSROOM – contain a number of noisy samples. Hence, we present a method for automatically filtering out this noise. We combine the representational power of the GRU-RNN and TRANSFORMER encoders in our paraphrase generation model. In training our sentence compression model, we investigate the impact of using different early-stopping criteria, such as embedding-based cosine similarity and F1. We utilize the pre-trained models (ours, GPT2 and T5) in different settings for single and multi-document summarization.
Degree
thesis:*- Level thesis:degree_level
- Ph.D
- Grantor dc:publisher
- Lethbridge, Alta. : University of Lethbridge, Dept. of Mathematics and Computer Science
- Year dc:date.issued
- 2020
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Egonmwan, Elozino Ofualagba
- University of Lethbridge. Faculty of Arts and Science
- Advisor dc:contributor.supervisor
-
- Chali, Yllias
Subjects
dc:subject × 7Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/10133/5827