Back to search

University of Southampton

Semantics of texture

Abstract

dc:description.abstract

In this thesis we investigate means by which the semantic and visual spaces of texture may be tied together, and argue for the importance of explicit semantic modelling inhuman-centred texture analysis tasks such as retrieval, annotation, synthesis, and zeroshot learning.<br/><br/>We take a new approach to semantic texture labelling by adopting a pairwise comparison framework robust to human biases, and within a semantic space consisting of attributes,low-level visual features acting as building blocks for more expressive semantic ontologies. We crowdsource a dataset of approximately 140;000 pairwise comparisons across 319 classes of texture and 98 attributes | to our knowledge the largest of its kind.<br/><br/>To aid in learning from sparsely labelled pairwise comparison datasets such as this we derive a new Bayesian probabilistic approach, providing a natural framework in which to incorporate prior knowledge and to measure uncertainty, and outperforming the often used Ranking SVM on incomplete and unreliable data. We demonstrate how the error variance present in our pairwise comparison data may be precisely quantified, allowing us to identify and discard rogue responses in a principled way.<br/><br/>Existing texture descriptors are then assessed in terms of their correspondence to the attributes comprising the semantic space. Textures with strong presence of attributes connoting randomness and complexity are shown to be poorly modelled by existing descriptors. These effects are likely due to disparities between human perception of what texture entails, and definitions adopted prior to (or, sometimes, after) the design of computational texture analysis systems.<br/><br/>Despite the decifiencies of the visual descriptors they are based upon, we demonstrate the benefit of semantically enriched descriptors in a retrieval experiment. Semantic modelling of texture is shown to provide considerable value in both feature selection and in analysis tasks.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D.
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Southampton
Year dc:date.issued
2016

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Matthews, Tim
Advisor dc:contributor.advisor
  • Nixon, Mark
ORCID person:identifier.orcid

Rights

Language dc:language
English, eng

Chain of custody

source
Harvested from
University of Southampton
Base URL
eprints.soton.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Matthews, Tim. Semantics of texture. doctoral thesis, University of Southampton, 2016.