{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-10442"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-10442","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Multi-object Localization in Robotic Hand","abstract":"We have developed a machine learning approach to localized objects inside a robotic hand using only images from 2D cameras. Specifically, we used deep learning method (You Only Look Once, YOLO) and Iterative closest Point (ICP) to estimate the 3D coordinates of the objects in a robotic hand. This method will also output the number of objects inside the robotic hand in addition to the coordinates of the objects. We have demonstrated the performance with simulation and obtained typical accuracy within a few pixels (couple mm) and counting accuracy of about 76%. We have also applied it to real images, which is currently a work in progress to improve prediction performance. Furthermore, we are in the process of expanding the model to predict objects other than spheres. Our approach can find applications in many image-based object localization applications including industrial and service robotics.","abstract_html":"We have developed a machine learning approach to localized objects inside a robotic hand using only images from 2D cameras. Specifically, we used deep learning method (You Only Look Once, YOLO) and Iterative closest Point (ICP) to estimate the 3D coordinates of the objects in a robotic hand. This method will also output the number of objects inside the robotic hand in addition to the coordinates of the objects. We have demonstrated the performance with simulation and obtained typical accuracy within a few pixels (couple mm) and counting accuracy of about 76%. We have also applied it to real images, which is currently a work in progress to improve prediction performance. Furthermore, we are in the process of expanding the model to predict objects other than spheres. Our approach can find applications in many image-based object localization applications including industrial and service robotics.","abstract_has_math":false,"creators":["Tsow, Tsing"],"institution":"University of South Florida","degree_name":"Master of Science (M.S.)","degree_level":"Thesis","degree_discipline":"Community and Family Health","degree_department":null,"school":null,"contributors":["Yu Sun, Ph.D.","Dmitry Goldgof, Ph.D.","Shaun Canavan, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-10-27T07:00:00Z","date_published":"2021-10-27T07:00:00Z","updated_at":"2026-11-19T08:47:56Z","subjects":["Machine learning","Deep learning","ICP","Robots","Object detection YOLO","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/9245","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/9245","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-10442","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Yu Sun, Ph.D.","Dmitry Goldgof, Ph.D.","Shaun Canavan, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Tsow, Tsing"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2021-10-27T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Community and Family Health"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis","M.S."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (M.S.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Machine learning","Deep learning","ICP","Robots","Object detection YOLO","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/9245"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["We have developed a machine learning approach to localized objects inside a robotic hand using only images from 2D cameras. Specifically, we used deep learning method (You Only Look Once, YOLO) and Iterative closest Point (ICP) to estimate the 3D coordinates of the objects in a robotic hand. This method will also output the number of objects inside the robotic hand in addition to the coordinates of the objects. We have demonstrated the performance with simulation and obtained typical accuracy within a few pixels (couple mm) and counting accuracy of about 76%. We have also applied it to real images, which is currently a work in progress to improve prediction performance. Furthermore, we are in the process of expanding the model to predict objects other than spheres. Our approach can find applications in many image-based object localization applications including industrial and service robotics."]},{"key":"dc:title","label":"Title","values":["Multi-object Localization in Robotic Hand"]}]}],"canonical_facts":{"dc:contributor":["Yu Sun, Ph.D.","Dmitry Goldgof, Ph.D.","Shaun Canavan, Ph.D."],"dc:creator":["Tsow, Tsing"],"dc:date":["2021-10-27T07:00:00Z"],"dc:description":["We have developed a machine learning approach to localized objects inside a robotic hand using only images from 2D cameras. Specifically, we used deep learning method (You Only Look Once, YOLO) and Iterative closest Point (ICP) to estimate the 3D coordinates of the objects in a robotic hand. This method will also output the number of objects inside the robotic hand in addition to the coordinates of the objects. We have demonstrated the performance with simulation and obtained typical accuracy within a few pixels (couple mm) and counting accuracy of about 76%. We have also applied it to real images, which is currently a work in progress to improve prediction performance. Furthermore, we are in the process of expanding the model to predict objects other than spheres. Our approach can find applications in many image-based object localization applications including industrial and service robotics."],"dc:identifier":["https://digitalcommons.usf.edu/etd/9245"],"dc:subject":["Machine learning","Deep learning","ICP","Robots","Object detection YOLO","Computer Sciences"],"dc:title":["Multi-object Localization in Robotic Hand"],"thesis:degree_discipline":["Community and Family Health"],"thesis:degree_level":["Thesis","M.S."],"thesis:degree_name":["Master of Science (M.S.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:47:56Z"}