Back to search

University of Southampton

On properties of deep cascade learning on medical imaging problems

Abstract

dc:description.abstract

This dissertation is on the application of deep neural networks to inference problems in medical imaging. It exploits recent advances in computer vision to solve medical problems. Two issues that motivate this work arise: we need to work with significantly low amount of data and to achieve decisions that are interpretable. We explore Cascade Learning (CL) whereby a neural network is trained layer-by-layer, cast in a transfer learning setting, whereby a model trained using natural image data is adapted (or fine-tuned) to the medical domain, to achieve these two objectives. Cascade-trained network has the property of extracting image features in a coarse to fine way. Hence, as we show in empirical work reported here, the features are better suited for transfer learning than similar networks trained E2E. Empirical results demonstrated on nine different benchmark datasets covering multiple diseases and five different modalities (chest X-ray, whole slide imaging, dermoscopy, endoscopy, and eye fundus imaging) show that CL with transfer (TCL) outperforms not only equivalent E2E trained models but also more sophisticated models such as ResNet and models that take features from self-supervised learning, trained on medical images. In comparison to ResNet with 25.6𝑀 parameters, TCL achieves the same (and often higher) levels of performance with as few as 6.6𝑀 parameters (a 75% reduction). Localisation of features is one important effect of CL. We show, using X-ray data in which human annotation of relevant regions is available, cascade-trained features overlap far better with the annotated bounding boxes. To quantify compactness of features, we use a morphological image processing metric of granulometry and show CL features are often significantly more localized. We also showing that cascade trained models show better calibration and robustness to additive noise in the input, both of which are relevant and important in medical imaging problems. Another consequence of localisation of discriminant features is that models trained in this way may be easier to attack in an adversarial attack setting. We show that this is indeed true through our data showing cascade-trained models are more vulnerable than E2E models under adversarial attack. However, when trained adversarially, both architectures recover their performance to the same extent.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D.
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Southampton
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wang, Junwen
Advisors dc:contributor.advisor
  • Farrahi, Kate
  • Niranjan, Mahesan
ORCID person:identifier.orcid

Rights

Language dc:language
English, eng

Chain of custody

source
Harvested from
University of Southampton
Base URL
eprints.soton.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Wang, Junwen. On properties of deep cascade learning on medical imaging problems. doctoral thesis, University of Southampton, 2023.