Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 13 of 13 for “"Summarization Evaluation"”.
-
Methods For Text Summarization Evaluation
… In the natural language processing task of text summarization, evaluation is incredibly difficult: the notion of the "perfect" summary content is ill-defined, but even if it could be defined, that content can be expressed in many different ways, making it difficult to identify in a summary. The …
-
Statistical Analysis of Text Summarization Evaluation
… dissertation applies statistical methods to the evaluation of automatic summarization using data from the Text Analysis Conferences in 2008-2011. Several aspects of the evaluation framework itself are studied, including the statistical testing used to determine significant differences, the …
-
Enhancing automatic summarization evaluation: Metric design, consistency, and explanation
Automatic summarization plays a pivotal role in condensing vast amounts of information into concise representations, thereby facilitating efficient information retrieval and comprehension. Nonetheless, evaluating the effectiveness of automatic summarization systems remains a significant challenge. …
-
Towards end-to-end reference-free summarization evaluation via negative sampling
… we present a proof-of-concept study to a summary evaluation approach without the presence of reference summaries. By negative sampling, massive data in existing summarization datasets are transformed for training by pairing documents with corrupted reference summaries. Two learning schemes are …
-
Text Summarization Evaluation: Correlating Human Performance on an Extrinsic Task with Automatic Intrinsic Metrics
Text summarization evaluation is the process of assessing the quality of an individual summary produced by human or automatic methods. Many techniques have been proposed for text summarization and researchers require an easy and uniform method for evaluation of their summarization systems. Human …
-
Methods to Evaluate and Improve the Quality of Text Summarization
Automatic text summarization is a beneficial tool to improve reading efficiency and information accessibility for users. It quickly condenses a large amount of information into key points, helping users to grasp essential information more easily. In addition, it supports various applications such …
-
Automatic Evaluation of Machine Translation, Paraphrase Generation, and Summarization: A Linear-programming-based Analysis
Automatic evaluations form an important part of Natural Language Processing (NLP) research. Despite their success, the mathematical foundations of most current automatic evaluation metrics are capable of modeling only simple features of n-gram matching, such as exact matches ? possibly after …
-
Evaluation of Automatic Text Summarization Using Synthetic Facts
Automatic text summarization has achieved remarkable success with the development of deep neural networks and the availability of standardized benchmark datasets. It can generate fluent, human-like summaries. However, the unreliability of the existing evaluation metrics hinders its practical usage …
-
Structure-aware reasoning in natural language processing through Questions Under Discussion
… is learnable and transfers to downstream summarization evaluation. Fourth, we extend QUD to multimodal scientific discourse through MQUD. In scientific reading, figures invoke implicit questions that the surrounding text answers, and knowing what to ask can matter as much as answering. We …
-
APPLIED ABSTRACTIVE SUMMARIZATION: MULTIPLE INPUTS, CONTROLLED OUTPUTS, AND EVALUATION
The automatic summarization task is very useful for many real-life scenarios. However, the conventional summarization task has limited applications. Traditional summarization tasks only take in a single input passage and may not handle the complex interactions amongst multiple input sources. …
-
Improving the Performance and Robustness of NLP models with Contrastive Data and Learning
… address false negatives issue and ensure robust evaluation with contrastive data. This dissertation investigates and extends the application of contrastive learning to diverse NLP tasks to improve the performance and robustness, including language generation, representation learning, faithfully …
-
Toward abstractive text summarization
Automatic text summarization is the process of automatically creating a compressed version of a given text. Content reduction can be addressed by extraction or abstraction. Extractive methods select a subset of most salient parts of the source text for inclusion in the summary. In contrast, …
-
Summarizing User-generated Discourse
Automatic text summarization is a long-standing task with its origins in summarizing scholarly documents by generating their abstracts. While older approaches mainly focused on generating extractive summaries, recent approaches using neural architectures have helped the task advance towards …