Back to search

University of Minnesota

Segmentation and Dense Keypoints Estimation of Monkeys

Abstract

dc:description.abstract

Animal tracking and pose estimation are core topics in neuroscience. However, for monkeys, current deep learning based algorithms often fail to perform well on segmentation and dense keypoints estimation due to the lack of annotated training data. In this thesis, we address this challenge by developing transfer learning based deep learning algorithms without using fully-annotated monkey data. We develop a bootstrapping strategy to refine the pretrained segmentation model on monkey data annotated with 2D sparse landmarks. In addition, we implement a voxel-based visual hull reconstruction approach to recover the 3D monkey pose from the silhouettes. For dense keypoints estimation, we follow a similar bootstrapping strategy to refine a pretrained HRNet, which is then used to learn a dense keypoint detector by leveraging multiview consistency. Our methods outperform the baseline methods on in-the-cage and in-the-wild monkey data.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Yu, Haozheng

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Citation
Yu, Haozheng. (2021). Segmentation and Dense Keypoints Estimation of Monkeys. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/226331.

Chain of custody

source
Harvested from
University of Minnesota
Base URL
conservancy.umn.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Yu, Haozheng. Segmentation and Dense Keypoints Estimation of Monkeys. 2021. https://hdl.handle.net/11299/226331