{"id":{"repo_id":"mtu","oai_identifier":"oai:digitalcommons.mtu.edu:etdr-3297"},"canonical_url":"https://search.ndltd.org/etd/mtu/oai:digitalcommons.mtu.edu:etdr-3297","repository":{"repo_id":"mtu","name":"Michigan Technological University","base_url":"https://digitalcommons.mtu.edu/do/oai/"},"display":{"title":"DESIGN AND EXPERIMENTAL EVALUATION OF A CUSTOM VISION-GUIDED APPROACH TO 2D PART LOCALIZATION FOR INDUSTRIAL ROBOTS","abstract":"Vision-guided robots offer a clear advantage over teach-pendant programming for battery handling, where modern packs hold thousands of cells and teaching each position by hand does not scale. Commercial vision systems address this need, but their calibration, detection, and coordinate-conversion stages are closed to the user, making it hard to incorporate newer learning-based methods. This work presents a modular, custom-built vision-guided system using an Orbbec Gemini 435Le eye-in-hand camera, an NVIDIA Jetson Orin Nano, an Allen-Bradley Micro850 PLC, and a FANUC LR Mate 200iC, communicating over Modbus TCP and EtherNet/IP. A per-hole classification model resolves each known hole into a present, absent, or flipped state. A two-stage calibration—17-point homography plus affine correction—achieves 0.93 mm RMS positioning accuracy across eight runs, comparable to two FANUC iRVision configurations (0.904 mm and 0.756 mm). By keeping every stage from image to robot coordinate accessible, the system aims to establish a calibrated, sub-millimeter foundation for LLM/VLM planners on industrial robots.","abstract_html":"Vision-guided robots offer a clear advantage over teach-pendant programming for battery handling, where modern packs hold thousands of cells and teaching each position by hand does not scale. Commercial vision systems address this need, but their calibration, detection, and coordinate-conversion stages are closed to the user, making it hard to incorporate newer learning-based methods. This work presents a modular, custom-built vision-guided system using an Orbbec Gemini 435Le eye-in-hand camera, an NVIDIA Jetson Orin Nano, an Allen-Bradley Micro850 PLC, and a FANUC LR Mate 200iC, communicating over Modbus TCP and EtherNet/IP. A per-hole classification model resolves each known hole into a present, absent, or flipped state. A two-stage calibration—17-point homography plus affine correction—achieves 0.93 mm RMS positioning accuracy across eight runs, comparable to two FANUC iRVision configurations (0.904 mm and 0.756 mm). By keeping every stage from image to robot coordinate accessible, the system aims to establish a calibrated, sub-millimeter foundation for LLM/VLM planners on industrial robots.","abstract_has_math":false,"creators":["Ali, Faisal"],"institution":null,"degree_name":"Master of Science in Mechatronics (MS)","degree_level":"Open Access Master's Report","degree_discipline":"Department of Applied Computing","degree_department":null,"school":null,"contributors":["Aleksandr V. Sergeyev"],"advisors":[],"committee_chairs":[],"committee_members":["Ashraf Saleem","Nathir A. Rawashdeh","Vinh T. Nguyen"],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:19:32Z","subjects":["Vision-Guided Robotics","Camera-to-Robot Calibration","Homography","YOLOv11","Industrial Robotics","FANUC iRVision","Electro-Mechanical Systems"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.mtu.edu/etdr/2138"],"render_values":[{"text":"https://digitalcommons.mtu.edu/etdr/2138","href":"https://digitalcommons.mtu.edu/etdr/2138","code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://doi.org/10.37099/mtu.dc.etdr/2138","outbound_label":"DOI","outbound_source":"dc:identifier","record_url":"https://doi.org/10.37099/mtu.dc.etdr/2138","record_label":"Repository record","record_kind":"doi","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.mtu.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.mtu.edu%3Aetdr-3297","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Aleksandr V. Sergeyev"]},{"key":"dc:contributor.committeemember","label":"Committee Member","values":["Ashraf Saleem","Nathir A. Rawashdeh","Vinh T. Nguyen"]},{"key":"dc:creator","label":"Author","values":["Ali, Faisal"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.created","label":"Dc Date Created","values":["2026-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Department of Applied Computing"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Open Access Master's Report"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science in Mechatronics (MS)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Vision-Guided Robotics","Camera-to-Robot Calibration","Homography","YOLOv11","Industrial Robotics","FANUC iRVision","Electro-Mechanical Systems"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["10.37099/mtu.dc.etdr/2138","https://digitalcommons.mtu.edu/etdr/2138"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Vision-guided robots offer a clear advantage over teach-pendant programming for battery handling, where modern packs hold thousands of cells and teaching each position by hand does not scale. Commercial vision systems address this need, but their calibration, detection, and coordinate-conversion stages are closed to the user, making it hard to incorporate newer learning-based methods. This work presents a modular, custom-built vision-guided system using an Orbbec Gemini 435Le eye-in-hand camera, an NVIDIA Jetson Orin Nano, an Allen-Bradley Micro850 PLC, and a FANUC LR Mate 200iC, communicating over Modbus TCP and EtherNet/IP. A per-hole classification model resolves each known hole into a present, absent, or flipped state. A two-stage calibration—17-point homography plus affine correction—achieves 0.93 mm RMS positioning accuracy across eight runs, comparable to two FANUC iRVision configurations (0.904 mm and 0.756 mm). By keeping every stage from image to robot coordinate accessible, the system aims to establish a calibrated, sub-millimeter foundation for LLM/VLM planners on industrial robots."]},{"key":"dc:title","label":"Title","values":["DESIGN AND EXPERIMENTAL EVALUATION OF A CUSTOM VISION-GUIDED APPROACH TO 2D PART LOCALIZATION FOR INDUSTRIAL ROBOTS"]}]}],"canonical_facts":{"dc:contributor":["Aleksandr V. Sergeyev"],"dc:contributor.committeemember":["Ashraf Saleem","Nathir A. Rawashdeh","Vinh T. Nguyen"],"dc:creator":["Ali, Faisal"],"dc:date.created":["2026-01-01T08:00:00Z"],"dc:description.abstract":["Vision-guided robots offer a clear advantage over teach-pendant programming for battery handling, where modern packs hold thousands of cells and teaching each position by hand does not scale. Commercial vision systems address this need, but their calibration, detection, and coordinate-conversion stages are closed to the user, making it hard to incorporate newer learning-based methods. This work presents a modular, custom-built vision-guided system using an Orbbec Gemini 435Le eye-in-hand camera, an NVIDIA Jetson Orin Nano, an Allen-Bradley Micro850 PLC, and a FANUC LR Mate 200iC, communicating over Modbus TCP and EtherNet/IP. A per-hole classification model resolves each known hole into a present, absent, or flipped state. A two-stage calibration—17-point homography plus affine correction—achieves 0.93 mm RMS positioning accuracy across eight runs, comparable to two FANUC iRVision configurations (0.904 mm and 0.756 mm). By keeping every stage from image to robot coordinate accessible, the system aims to establish a calibrated, sub-millimeter foundation for LLM/VLM planners on industrial robots."],"dc:identifier":["10.37099/mtu.dc.etdr/2138","https://digitalcommons.mtu.edu/etdr/2138"],"dc:subject":["Vision-Guided Robotics","Camera-to-Robot Calibration","Homography","YOLOv11","Industrial Robotics","FANUC iRVision","Electro-Mechanical Systems"],"dc:title":["DESIGN AND EXPERIMENTAL EVALUATION OF A CUSTOM VISION-GUIDED APPROACH TO 2D PART LOCALIZATION FOR INDUSTRIAL ROBOTS"],"thesis:degree_discipline":["Department of Applied Computing"],"thesis:degree_level":["Open Access Master's Report"],"thesis:degree_name":["Master of Science in Mechatronics (MS)"]},"updated_at":"2026-11-19T08:19:32Z"}