Back to search

Michigan Technological University

DESIGN AND EXPERIMENTAL EVALUATION OF A CUSTOM VISION-GUIDED APPROACH TO 2D PART LOCALIZATION FOR INDUSTRIAL ROBOTS

Abstract

dc:description.abstract

Vision-guided robots offer a clear advantage over teach-pendant programming for battery handling, where modern packs hold thousands of cells and teaching each position by hand does not scale. Commercial vision systems address this need, but their calibration, detection, and coordinate-conversion stages are closed to the user, making it hard to incorporate newer learning-based methods. This work presents a modular, custom-built vision-guided system using an Orbbec Gemini 435Le eye-in-hand camera, an NVIDIA Jetson Orin Nano, an Allen-Bradley Micro850 PLC, and a FANUC LR Mate 200iC, communicating over Modbus TCP and EtherNet/IP. A per-hole classification model resolves each known hole into a present, absent, or flipped state. A two-stage calibration—17-point homography plus affine correction—achieves 0.93 mm RMS positioning accuracy across eight runs, comparable to two FANUC iRVision configurations (0.904 mm and 0.756 mm). By keeping every stage from image to robot coordinate accessible, the system aims to establish a calibrated, sub-millimeter foundation for LLM/VLM planners on industrial robots.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Mechatronics (MS)
Level thesis:degree_level
Open Access Master's Report
Discipline thesis:degree_discipline
Department of Applied Computing

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ali, Faisal
Committee members dc:contributor.committeemember
  • Ashraf Saleem
  • Nathir A. Rawashdeh
  • Vinh T. Nguyen
Contributors dc:contributor
  • Aleksandr V. Sergeyev

Subjects

dc:subject × 7

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Michigan Technological University
Base URL
digitalcommons.mtu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Ali, Faisal. DESIGN AND EXPERIMENTAL EVALUATION OF A CUSTOM VISION-GUIDED APPROACH TO 2D PART LOCALIZATION FOR INDUSTRIAL ROBOTS. Open Access Master's Report thesis, https://doi.org/10.37099/mtu.dc.etdr/2138