Back to search

University of North Texas

Understanding and Reasoning with Negation

Abstract

dc:description

In this dissertation, I start with an analysis of negation in eleven benchmark corpora covering six Natural Language Understanding (NLU) tasks. With a thorough investigation, I first show that (a) these benchmarks contain fewer negations compared to general-purpose English and (b) the few negations they contain are often unimportant. Further, my empirical studies demonstrate that state-of-the-art transformers trained using these corpora obtain substantially worse results with the instances that contain negation, especially if the negations are important. Second, I investigate whether translating negation is also an issue for modern machine translation (MT) systems. My studies find that indeed the presence of negation can significantly impact translation quality, in some cases resulting in reductions of over 60%. In light of these findings, I investigate strategies to better understand the semantics of negation. I start with identifying the focus of negation. I develop a neural model that takes into account the scope of negation, context from neighboring sentences, or both. My best proposed system obtains an accuracy improvement of 7.4% over prior work. Further, I analyze the main error categories of the systems through a detailed error analysis. Next, I explore more practical ways to understand the semantics of negation. I consider revealing the meaning of negation by revealing their affirmative interpretations. First, I propose a question-answer driven approach to create AFIN, a collection of 3,001 sentences with verbal negations and their affirmative interpretations. Then, I present an automated procedure to collect pairs of sentences with negation and their affirmative interpretations, resulting in over 150,000 pairs. Experimental results demonstrate that leveraging these pairs helps (a) a T5 system generate affirmative interpretations from negations in AFIN and (b) state-of-the-art transformers solve natural language understanding tasks, including natural language inference and sentiment analysis. Furthermore, I develop a plug-and-play affirmative interpretation generator that is potentially useful in improving a number of natural language understanding tasks where negation poses a challenge.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Hossain, Md Mosharaf
Contributors dc:contributor
  • Albert, Mark
  • Blanco, Eduardo
  • Yuan, Xiaohui (Computer science researcher)
  • Tunc, Cihan
  • Palmer, Alexis

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Public
  • Hossain, Md Mosharaf
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_3123
https://digital.library.unt.edu/ark:/67531/metadc2048613/
ark: ark:/67531/metadc2048613

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Hossain, Md Mosharaf. Understanding and Reasoning with Negation. University of North Texas, 2022. https://doi.org/10.12794/metadc2048613