Back to search

University of South Florida

Multi-object Localization in Robotic Hand

Abstract

dc:description

We have developed a machine learning approach to localized objects inside a robotic hand using only images from 2D cameras. Specifically, we used deep learning method (You Only Look Once, YOLO) and Iterative closest Point (ICP) to estimate the 3D coordinates of the objects in a robotic hand. This method will also output the number of objects inside the robotic hand in addition to the coordinates of the objects. We have demonstrated the performance with simulation and obtained typical accuracy within a few pixels (couple mm) and counting accuracy of about 76%. We have also applied it to real images, which is currently a work in progress to improve prediction performance. Furthermore, we are in the process of expanding the model to predict objects other than spheres. Our approach can find applications in many image-based object localization applications including industrial and service robotics.

Degree

thesis:*
Name thesis:degree_name
Master of Science (M.S.)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Community and Family Health
Grantor
University of South Florida
Year dc:date
2021

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Tsow, Tsing
Contributors dc:contributor
  • Yu Sun, Ph.D.
  • Dmitry Goldgof, Ph.D.
  • Shaun Canavan, Ph.D.

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/9245

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Tsow, Tsing. Multi-object Localization in Robotic Hand. Thesis thesis, University of South Florida, 2021. https://digitalcommons.usf.edu/etd/9245