{"id":{"repo_id":"calpoly","oai_identifier":"oai:digitalcommons.calpoly.edu:theses-5072"},"canonical_url":"https://search.ndltd.org/etd/calpoly/oai:digitalcommons.calpoly.edu:theses-5072","repository":{"repo_id":"calpoly","name":"Cal Poly","base_url":"https://digitalcommons.calpoly.edu/do/oai/"},"display":{"title":"Development and Testing of a Computer Vision Pose Estimation System for Planar Mobile Robots","abstract":"This thesis details the development and testing of a computer vision-based real-time pose estimation system for differential drive robots. A single camera with a fisheye lens is used to locate ArUco markers placed at fixed locations and attached to robots. Using the OpenCV library, the Perspective-n-Point (PnP) problem is solved to facilitate the transformation of 2-D robot positions in an image to world-frame coordinates. An analytical solution is presented to estimate robot poses based on a single PnP solution, rather than solving the PnP problem for each pose estimate. Pose information is relayed to individual robots using a multi-microcontroller architecture that leverages the ESP-NOW wireless protocol. For static objects, the pose estimates from the computer vision (CV) algorithm produced accurate results compared to ground truth values, but when integrated on a moving robot, the CV pose estimates deviated significantly from odometry-based values. This project validates the CV system as a viable source of pose data and verifies the reliability and efficiency of the wireless communication system. Further work should be done to verify and increase the accuracy of pose estimates for moving objects.","abstract_html":"This thesis details the development and testing of a computer vision-based real-time pose estimation system for differential drive robots. A single camera with a fisheye lens is used to locate ArUco markers placed at fixed locations and attached to robots. Using the OpenCV library, the Perspective-n-Point (PnP) problem is solved to facilitate the transformation of 2-D robot positions in an image to world-frame coordinates. An analytical solution is presented to estimate robot poses based on a single PnP solution, rather than solving the PnP problem for each pose estimate. Pose information is relayed to individual robots using a multi-microcontroller architecture that leverages the ESP-NOW wireless protocol. For static objects, the pose estimates from the computer vision (CV) algorithm produced accurate results compared to ground truth values, but when integrated on a moving robot, the CV pose estimates deviated significantly from odometry-based values. This project validates the CV system as a viable source of pose data and verifies the reliability and efficiency of the wireless communication system. Further work should be done to verify and increase the accuracy of pose estimates for moving objects.","abstract_has_math":false,"creators":["Jones, Andrew"],"institution":null,"degree_name":"MS in Mechanical Engineering","degree_level":null,"degree_discipline":"Mechanical Engineering","degree_department":null,"school":null,"contributors":["Eric Espinoza-Wade","Mechanical Engineering","College of Engineering"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T07:12:58Z","subjects":["Computer vision","robotics","microcontroller","pose estimation","Electro-Mechanical Systems"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.calpoly.edu/theses/3397","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.calpoly.edu/theses/3397","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.calpoly.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.calpoly.edu%3Atheses-5072","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Eric Espinoza-Wade","Mechanical Engineering","College of Engineering"]},{"key":"dc:creator","label":"Author","values":["Jones, Andrew"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2026-07-11T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2026-08-01T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Mechanical Engineering"]},{"key":"thesis:degree_name","label":"Degree Name","values":["MS in Mechanical Engineering"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Computer vision","robotics","microcontroller","pose estimation","Electro-Mechanical Systems"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.calpoly.edu/theses/3397"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This thesis details the development and testing of a computer vision-based real-time pose estimation system for differential drive robots. A single camera with a fisheye lens is used to locate ArUco markers placed at fixed locations and attached to robots. Using the OpenCV library, the Perspective-n-Point (PnP) problem is solved to facilitate the transformation of 2-D robot positions in an image to world-frame coordinates. An analytical solution is presented to estimate robot poses based on a single PnP solution, rather than solving the PnP problem for each pose estimate. Pose information is relayed to individual robots using a multi-microcontroller architecture that leverages the ESP-NOW wireless protocol. For static objects, the pose estimates from the computer vision (CV) algorithm produced accurate results compared to ground truth values, but when integrated on a moving robot, the CV pose estimates deviated significantly from odometry-based values. This project validates the CV system as a viable source of pose data and verifies the reliability and efficiency of the wireless communication system. Further work should be done to verify and increase the accuracy of pose estimates for moving objects."]},{"key":"dc:title","label":"Title","values":["Development and Testing of a Computer Vision Pose Estimation System for Planar Mobile Robots"]}]}],"canonical_facts":{"dc:contributor":["Eric Espinoza-Wade","Mechanical Engineering","College of Engineering"],"dc:creator":["Jones, Andrew"],"dc:date.available":["2026-07-11T07:00:00Z"],"dc:date.created":["2026-08-01T07:00:00Z"],"dc:description.abstract":["This thesis details the development and testing of a computer vision-based real-time pose estimation system for differential drive robots. A single camera with a fisheye lens is used to locate ArUco markers placed at fixed locations and attached to robots. Using the OpenCV library, the Perspective-n-Point (PnP) problem is solved to facilitate the transformation of 2-D robot positions in an image to world-frame coordinates. An analytical solution is presented to estimate robot poses based on a single PnP solution, rather than solving the PnP problem for each pose estimate. Pose information is relayed to individual robots using a multi-microcontroller architecture that leverages the ESP-NOW wireless protocol. For static objects, the pose estimates from the computer vision (CV) algorithm produced accurate results compared to ground truth values, but when integrated on a moving robot, the CV pose estimates deviated significantly from odometry-based values. This project validates the CV system as a viable source of pose data and verifies the reliability and efficiency of the wireless communication system. Further work should be done to verify and increase the accuracy of pose estimates for moving objects."],"dc:identifier":["https://digitalcommons.calpoly.edu/theses/3397"],"dc:subject":["Computer vision","robotics","microcontroller","pose estimation","Electro-Mechanical Systems"],"dc:title":["Development and Testing of a Computer Vision Pose Estimation System for Planar Mobile Robots"],"thesis:degree_discipline":["Mechanical Engineering"],"thesis:degree_name":["MS in Mechanical Engineering"]},"updated_at":"2026-11-19T07:12:58Z"}