Back to search

University of York

Sequence-to-Sequence Automatic Sentence Simplification: Development & Evaluation

Abstract

dc:description.abstract

Sentence simplification involves the transformation of complex sentences into simpler versions, addressing syntactic and lexical aspects through operations such as rephrasing, addition, deletion, splitting, or substitution. The Sequence-to-Sequence (Seq2Seq) model has demonstrated significant efficacy across various natural language processing tasks, making it a primary focus of our research. The thesis’s first focus is the evaluation aspect of sentence simplification models. We are trying to minimize the dependency on human to evaluate the models outcomes. Our study examines the correlation between existing text simplification evaluation metrics and human judgment. It identifies evaluation metrics that exhibit strong alignment with human assessments, offering insights into metrics suitable for future research. The second focus of this thesis is different Seq2Seq models with different configurations from dataset to models architecture. The thesis compares the performance of Gated Recurrent Units (GRUs) and Long Short-Term Memory (LSTM) units within Seq2Seq models for sentence simplification tasks. It evaluates which recurrent unit type, GRU or LSTM, achieves superior performance in encoder-decoder architectures equipped with attention mechanism. Also, the impact of text embedding techniques on Seq2Seq sentence simplification models is explored. The significance of embedding methods in determining the quality of simplification outcomes is discussed, highlighting their role in model performance. Moreover, the research investigates the potential of fine-tuning pre-trained Large Language Models (LLMs) for simplifying complex sentences. It assesses the integration of LLMs into Seq2Seq models and their adaptation to the simplification task, aiming to leverage the benefits of pre-trained language representations. The third focus of this thesis is examining the efficacy of fine-tuning domain-specific LLMs on domain-specific datasets to enhance the quality of simplified sentences. It explores whether domain-specific LLMs outperform general LLMs when tailored and fine-tuned for specific domains, contributing insights into domain-specific sentence simplification. Through these investigations, the thesis contributes to advancing the understanding and development of Seq2Seq models for automated sentence simplification, addressing various facets from evaluation metrics to model architecture and fine-tuning strategies.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of York
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Alfear, Noof
Advisor dc:contributor.advisor
  • Kazakov, Dimitar
ORCID person:identifier.orcid

Rights

Language dc:language.dcterms_iso639_2
eng

Chain of custody

source
Harvested from
White Rose University Consortium
Base URL
etheses.whiterose.ac.uk/cgi/oai2
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
related terms
citation

Alfear, Noof. Sequence-to-Sequence Automatic Sentence Simplification: Development & Evaluation. doctoral thesis, University of York, 2024.