Back to search

University of Sheffield

Image-Level Weakly Supervised Semantic Segmentation Based on Novel Class Activation Mapping

Abstract

dc:description.abstract

Weakly Supervised Semantic Segmentation (WSSS) is a vital area in computer vision that focuses on training segmentation models without relying on detailed, pixel-level annotations. Currently, most WSSS methods complete this task by leveraging Class Activation Mapping (CAM). However, existing CAM methods tend to highlight only the most discriminative regions of objects, often resulting in pseudo semantic segmentation labels that fail to cover the entire object and lack spatial accuracy. This limitation leads to incomplete learning of target features by the subsequent semantic segmentation network. To address these challenges, this study introduces a novel CAM algorithm, Region-CAM, which enhances the quality of activation maps to capturing more comprehensive and detailed object regions by treating gradients and features separately based on our one hypothesis and a finding. Moreover, since Region-CAM is a method for processing the gradient of network features, it can be flexibly integrated with existing WSSS methods to achieve better performance. Furthermore, existing evaluation metrics mainly focus on evaluating the faithfulness and interpretability of activation algorithms, rather than the accuracy of activation maps. To fill this gap, this research proposes a novel evaluation metric, mean Mask Intersection Energy (mMIE), that accurately assess the quality of activations method that is beneficial to downstream tasks. Finally, a specialized WSSS network for the food domain is proposed. This study is the first attempt to explore WSSS in the food domain, reducing the reliance on extensive annotations. A novel single-stage dual-branch network (SSDB-Net) is proposed to improve the performance of food WSSS tasks based on image-level annotations. We find that the performance of the food WSSS task at this stage is mainly limited by the Recall of network. Region-CAM is also applied to the proposed network to further demonstrate its effectiveness.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Sheffield
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Cai, Qingdong
Advisor dc:contributor.advisor
  • Abhayaratne, Charith
ORCID person:identifier.orcid

Rights

Language dc:language.dcterms_iso639_2
eng

Chain of custody

source
Harvested from
White Rose University Consortium
Base URL
etheses.whiterose.ac.uk/cgi/oai2
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
related terms
citation

Cai, Qingdong. Image-Level Weakly Supervised Semantic Segmentation Based on Novel Class Activation Mapping. doctoral thesis, University of Sheffield, 2025.