Back to search

University of Southampton

On the learning and structure of symmetry based disentangled representations

Abstract

dc:description.abstract

Representation learning is fundamental to many machine learning techniques, perhaps even more so in the subfield of deep learning. Disentangled representations introduce a form of interpretability such that both humans and our models can understand (to a degree) how decisions are made - or at least, what is important to such decisions. Symmetry based disentangled representations introduce a stricter form of interpretability which ensures the representations are structured based on how the data is observed, which is described by symmetries acting on it. In this work we explore two aspects of symmetry based representations. First we consider methods to learn such representations with a particular focus on doing so without action labelling. Secondly we consider their structure and potential benefits for downstream tasks. We find that through the use of policy gradients, we can successfully learn linear disentangled representation without knowledge of world states or action labels. Indeed our proposed method achieves similar performance to supervised methods. Subsequently, we find that linear disentangled representations are highly structured with respect to a particular symmetry group. This structure allows for better performance than standard disentangled representations on both the tasks of generative factor prediction and observed action prediction.

Degree

thesis:*
Name dc:type.qualificationname
Ph.D.
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Southampton
Year dc:date.issued
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Painter, Matthew
Advisor dc:contributor.advisor
  • Prugel-Bennett, Adam
ORCID person:identifier.orcid

Rights

Language dc:language
English, eng

Chain of custody

source
Harvested from
University of Southampton
Base URL
eprints.soton.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Painter, Matthew. On the learning and structure of symmetry based disentangled representations. doctoral thesis, University of Southampton, 2022.