Georgia Institute of Technology
Housekeep: Tidying Virtual Households using Commonsense Reasoning
Abstract
dc:description.abstractWe introduce Housekeep, a benchmark to evaluate commonsense reasoning in the home for embodied AI. In Housekeep, an embodied agent must tidy a house by rearranging misplaced objects without explicit instructions specifying which objects need to be rearranged. Instead, the agent must learn from and is evaluated against human preferences of which objects belong where in a tidy house. Specifically, we collect a dataset of where humans typically place objects in tidy and untidy houses constituting 1799 objects, 268 object categories, 585 placements, and 105 rooms. Next, we propose a modular baseline approach for Housekeep that integrates planning, exploration, and navigation. It leverages a fine-tuned large language model (LLM) trained on an internet text corpus for effective planning. See our webpage for code, data and more details: https://yashkant.github.io/housekeep/. We find that our baseline planner generalizes to some extent when rearranging objects in unknown environments.
Degree
thesis:*- Level thesis:degree_level
- Masters
- Department dc:contributor.department
- Computer Science
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2023
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Ramachandran, Arun
- Advisor dc:contributor.advisor
-
- Batra, Dhruv
- Committee members dc:contributor.committeemember
-
- Garg, Animesh
- Hoffman, Judy
Subjects
dc:subject × 3Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/71981