Back to search

West Virginia University

Development of a Mixed Reality Robotics Testing Environment

Abstract

dc:description.abstract

Development of a Mixed Reality Robotics Testing Environment Haneen Hanoon This research presents the development of a Mixed Reality (MR) robotic framework that integrates real and virtual environments for experimental robotics, education, and visualization. The proposed system combines a motion-capture system, a simulator, and a projector to create a spatially aligned, interactive workspace where physical robots coexist with projected virtual objects. The framework enables real-robot motion to be tracked in real time and mirrored in the simulated environment, allowing projected obstacles, goals, and paths to be precisely aligned with the physical world. A coordinate transformation and scaling process was implemented to ensure accurate mapping between the motion capture system and the simulation coordinate frames. Software programs were developed to manage real-time pose streaming, calibration, and dynamic visualization. The system was validated through multiple navigation and obstacle-avoidance experiments conducted in both static and dynamic environments, demonstrating the framework’s ability to maintain spatial consistency between virtual and physical spaces. Experimental results demonstrated accurate spatial alignment between the physical and virtual domains and stable real-time performance during testing. For example, the physical robot successfully avoided both static and moving virtual obstacles while following replanned paths displayed on the lab floor using the projector. This work establishes a robust MR foundation for real-time robot navigation, spatial calibration, and educational visualization, bridging physical experimentation and virtual simulation.

Degree

thesis:*
Name thesis:degree_name
MS
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Mechanical and Aerospace Engineering

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Hanoon, Haneen
Contributors dc:contributor
  • Jason Gross
  • Yu Gu
  • Guilherme Pereira

Subjects

dc:subject × 9

Identifiers

dc:identifier.*
Identifier
<p><a href="https://orcid.org/0009-0002-0609-3837">https://orcid.org/0009-0002-0609-3837</a></p>
https://researchrepository.wvu.edu/etd/13104

Chain of custody

source
Harvested from
West Virginia University
Base URL
researchrepository.wvu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Hanoon, Haneen. Development of a Mixed Reality Robotics Testing Environment. Thesis thesis, https://doi.org/10.33915/etd.13104