Back to search

Georgia Institute of Technology

Modeling Humans at Rest with Applications to Robot Assistance

Abstract

dc:description.abstract

Humans spend a large part of their lives resting. Machine perception of this class of body poses would be beneficial to numerous applications, but it is complicated by line-of-sight occlusion from bedding. Pressure sensing mats are a promising alternative, but data is challenging to collect at scale. To overcome this, we use modern physics engines to simulate bodies resting on a soft bed with a pressure sensing mat. This method can efficiently generate data at scale for training deep neural networks. We present a deep model trained on this data that infers 3D human pose and body shape from a pressure image, and show that it transfers well to real world data. We also present a model that infers pose, shape and contact pressure from a depth image facing the person in bed, and it does so in the presence of blankets. This model similarly benefits from synthetic data, which is created by simulating blankets on the bodies in bed. We evaluate this model on real world data and compare it to an existing method that requires RGB, depth, thermal and pressure imagery in the input. Our model only requires an input depth image, yet it is 12% more accurate. Our methods are relevant to applications in healthcare, including patient acuity monitoring and pressure injury prevention. We demonstrate this work in the context of robotic caregiving assistance, by using it to control a robot to move to locations on a person’s body in bed.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Biomedical Engineering (Joint GT/Emory Department)
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Clever, Henry M.
Advisor dc:contributor.advisor
  • Kemp, Charles C.
Committee members dc:contributor.committeemember
  • Hays, James
  • Howard, Ayanna
  • Liu, C. Karen
  • Turk, Greg

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/66175

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Clever, Henry M.. Modeling Humans at Rest with Applications to Robot Assistance. Doctoral thesis, Georgia Institute of Technology, 2021. http://hdl.handle.net/1853/66175