Back to search

University of Birmingham

Visual 6D object pose estimation and tracking

Abstract

dc:description.abstract

Visual 6D object pose estimation and tracking is crucial for enabling machines to understand and interact with the three-dimensional world. Despite significant advancements, challenges persist in this field. Existing methods often struggle in complex real-world scenarios, particularly with symmetric and textureless objects under occlusion. Category-level methods also face limitations in generalizability, especially with complex-shaped objects and noisy environments. Additionally, there is a significant gap in effective methods for category-level object pose refinement, which is crucial for achieving high-precision pose information with previously unseen objects. To address these challenges, this thesis proposes three approaches. First, an instance-level object pose tracking method is introduced, leveraging temporal information with augmented autoencoder-based reconstruction to enhance robustness to symmetric and textureless objects under occlusion. Second, a hybrid scope feature extraction layer (HS-layer) is presented for category-level object pose estimation. The HS layer encodes translation and scale information, perceives geometric structural information for handling complex-shaped objects with robustness to outliers. Lastly, a method that combines latent geometric feature extraction and learnable affine transformation is proposed to address shape discrepancy issues in category-level object pose refinement, improving pose refinement accuracy and generalizability. Extensive experiments validate the effectiveness of these approaches in advancing practical applications of visual 6D object pose estimation and tracking. Additionally, all the proposed methods exhibit real-time performance, crucial for real-life applications.

Degree

thesis:*
Name dc:type.qualificationname
d_ph
Level dc:type.qualificationlevel
d_ph
Grantor dc:publisher.institution
University of Birmingham
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zheng, Linfang
ORCID person:identifier.orcid

Subjects

dc:subject × 1

Rights

Language dc:language.dcterms_iso639_2
eng

Identifiers

dc:identifier.*
Dc Identifier Grantnumber
Shenzhen Science and Technology Program under Grant JCYJ20200109141601708
Science, Technology and Innovation Commission of Shenzhen Municipality under grant ZDSYS20200811143601004
Benchmarks for UndeRstanding Grasping (BURG) (EP/S032487/1)
ITRC (Information Technology Research Center) support program (IITP-2024-2020-0-01789)
the Institute of Information and communications Technology Planning and evaluation (IITP) grant funded by the Korea government (MSIT) (2021-0-00537, Visual common sense through self-supervised learning for restoration of invisible parts in images)
the Shenzhen Key Laboratory of Control Theory and Intelligent Systems, under grant No.ZDSYS20220330161800001

Chain of custody

source
Harvested from
University of Birmingham
Base URL
etheses.bham.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Zheng, Linfang. Visual 6D object pose estimation and tracking. d_ph thesis, University of Birmingham, 2024.