Back to search

University of Leeds

Automatic, integrated and structured reporting for radiology image examinations

Abstract

dc:description.abstract

The increasing availability of diverse data sources has expanded the potential for modality translation tasks in artificial intelligence, particularly in converting images into natural language descriptions. In the clinical domain, particularly in chest X-ray (CXR) analysis, advancing Computer-Aided Detection (CAD) and Diagnosis (CADx) technologies hold significant promise for improving patient outcomes and healthcare delivery. This research focuses on improving medical image representations by leveraging clinically relevant information and tasks to establish a more robust pipeline for the automated generation of radiology reports. By aligning with clinical pathways, we aim to generate accurate, contextually relevant reports that reflect real-world medical practices. This study addresses the limitations of current single-modality approaches, which often fail to capture complex relationships and complementary information across different data modalities. The primary objectives of this research are threefold: to develop efficient multi-input pre-processing mechanisms for diverse data types; to establish robust frameworks for modality fusion, combining visual, textual, and clinical data into unified embeddings; and to enhance representation learning capabilities through joint optimisation in multi-task learning. This thesis proposes novel multi-input multi-stream end-to-end networks demonstrating significant improvements in text generation accuracy and contextual relevance. It also includes comprehensive ablation studies, systematic analyses of different architectures, and the introduction of multi-task learning strategies to optimise feature learning and reduce hallucination in generated reports. The findings highlight the potential benefits of multi-modal and multi-task learning in medical applications, suggesting broader implications for other fields requiring integrated multi-modality. While the research faces challenges such as language variability, metric inadequacy, and computational demands, it presents a versatile framework with potential cross-domain applicability and a roadmap for future developments in multi-modal and cross-modal AI systems.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Leeds
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Aksoy, Nurbanu
Advisors dc:contributor.advisor
  • Ravikumar, Nishant
  • Sharoff, Serge
ORCID person:identifier.orcid

Rights

Language dc:language.dcterms_iso639_2
eng

Chain of custody

source
Harvested from
White Rose University Consortium
Base URL
etheses.whiterose.ac.uk/cgi/oai2
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
related terms
citation

Aksoy, Nurbanu. Automatic, integrated and structured reporting for radiology image examinations. doctoral thesis, University of Leeds, 2024.