Back to search

University of British Columbia

PyMouse Lifter : real time 3-D pose estimation for mice with only 2-D annotation via data synthesis

Abstract

dc:description

Neural-network‑based pose estimation models have become increasingly popular for quantitative analysis of mouse behavior, yet most recordings still use a single 2‑D camera view and therefore lack the depth cues needed for accurate 3‑D kinematics. Existing open‑source 3‑D mouse datasets for training deep-learning models cover only a narrow range of environments and do not generalize well to various laboratory settings. To overcome these limitations, I introduce PyMouse Lifter, a pipeline that automatically reconstructs 3‑D mouse poses from ordinary 2-D top‑view videos with minimal manual 2-D annotation. PyMouse Lifter combines (i) an anatomically realistic 3‑D mouse model for automated data synthesis, (ii) a monocular depth estimation model, and (iii) a 2‑D key‑point estimation model, enabling accurate 3‑D lifting (model-based 3D inference) in virtually any open‑field arena without using depth or multiple camera views for reconstruction. I validate the system on multiple datasets against depth‑camera ground truth and show that the lifted 3D trajectories yield improved behavior classification than 2‑D data and can be implemented in real time.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Neuroscience
Grantor dc:publisher
University of British Columbia
Year dc:date
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zeng, Haozong
Contributors dc:contributor
  • Murphy, Timothy H.

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/91762

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Zeng, Haozong. PyMouse Lifter : real time 3-D pose estimation for mice with only 2-D annotation via data synthesis. master's thesis, University of British Columbia, 2025. http://hdl.handle.net/2429/91762