University of Southampton
An investigation into locating generalised articulated pose models using self-supervised deep learning
Abstract
dc:description.abstractThis thesis investigates how self-supervised learning can be used to locate generalised three-dimensional articulated poses from images. We split this difficult problem into its constituent components, self-supervised keypoint detection to find two-dimensional keypoints from images, and self-supervised pose lifting to infer the depth of those points. We frame this problem as a representation learning problem, where keypoints are a spatially constrained representation, and also consider the semantic properties of keypoints when applied to different use cases. We consider how priors are used to resolve an ill posed problem such as this, before devising a new prior which leverages the rigidity of limbs found in most articulated objects to both locate better keypoints and to improve the lifting of keypoints. We conclude by describing the wider applicability outside of this specifc approach, and suggest future work that logically follows on from this thesis.
Degree
thesis:*- Name dc:type.qualificationname
- Ph.D.
- Level dc:type.qualificationlevel
- doctoral
- Grantor dc:publisher.institution
- University of Southampton
- Year dc:date.issued
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Harris, Joshua Luke
- Advisors dc:contributor.advisor
-
- Hare, Jonathon
- Prugel-Bennett, Adam
- ORCID person:identifier.orcid
Rights
- Language dc:language
- English, eng