Abstract
dc:descriptionWe have developed a machine learning approach to localized objects inside a robotic hand using only images from 2D cameras. Specifically, we used deep learning method (You Only Look Once, YOLO) and Iterative closest Point (ICP) to estimate the 3D coordinates of the objects in a robotic hand. This method will also output the number of objects inside the robotic hand in addition to the coordinates of the objects. We have demonstrated the performance with simulation and obtained typical accuracy within a few pixels (couple mm) and counting accuracy of about 76%. We have also applied it to real images, which is currently a work in progress to improve prediction performance. Furthermore, we are in the process of expanding the model to predict objects other than spheres. Our approach can find applications in many image-based object localization applications including industrial and service robotics.
Degree
thesis:*- Name thesis:degree_name
- Master of Science (M.S.)
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Community and Family Health
- Grantor
- University of South Florida
- Year dc:date
- 2021
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Tsow, Tsing
- Contributors dc:contributor
-
- Yu Sun, Ph.D.
- Dmitry Goldgof, Ph.D.
- Shaun Canavan, Ph.D.
Subjects
dc:subject × 6Identifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.usf.edu/etd/9245