Back to search

Cornell University

AI ASSEMBLY: OBJECT RECOGNITION, COMPUTER VISION, AND DIGITAL TWIN FOR MIXED REALITY ASSEMBLY

Abstract

dc:description.abstract

The thesis explores incorporating emerging computing technologies in architectural assembly and design processes, with a focus on developing an AI system for recognizing self-similar components and generating step-by-step assembly instructions. The proposed methodology includes the use of object recognition algorithms, computer vision, digital twins, and mixed reality. The thesis consists of a series of investigations, such as an initial prototypical study using Lego blocks, synthetic dataset generation, secondary case studies with 3D-printed nodes, real-time video streaming and processing, and assembly instruction generation. The AI-Assembly system can respond to real-time user changes, error detection, assembly status tracking, and structure analysis to support human creative agency during the design iteration process. The thesis aims to facilitate Human-AI co-creation in assembling complex structures, enhancing efficiency and flexibility in architectural processes. Furthermore, this research contributes to the growing field of architecture by demonstrating the potential of emerging technologies and integrating physical modeling processes.

Degree

thesis:*
Name thesis:degree_name
M.S., Architecture
Level thesis:degree_level
Master of Science
Discipline thesis:degree_discipline
Architecture
Grantor
Cornell University
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Ma, Haotian
  • Kyaw, Alexander Htet
Chair dc:contributor.chair
  • Sabin, Jenny
Committee member dc:contributor.committeemember
  • Marschner, Stephen

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial 4.0 International
Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16176564
Dc Identifier Other
ProQuest Submission ID: 11808
ProQuest Publication ID: 30524303

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Ma, Haotian; Kyaw, Alexander Htet. AI ASSEMBLY: OBJECT RECOGNITION, COMPUTER VISION, AND DIGITAL TWIN FOR MIXED REALITY ASSEMBLY. Master of Science thesis, Cornell University, 2023. https://hdl.handle.net/1813/113919