Back to search

University of South Florida

Predicting the Number of Objects in a Robotic Grasp

Abstract

dc:description

Picking up the desired number of objects at once from a pile is still very difficult to dofor a robot. The main challenge is predicting the number of objects in the grasp. This thesis describes several deep-learning-based prediction models that predict the number of objects in the grasp of a Barrett hand using the tactile sensors on its fingers and palm and its joint angles and torque (strain gauge) readings. The deep learning models include various architectures using autoencoders and vision transformers. We evaluated the models with a dataset of grasping 0, 1, 2, 3, and 4 spheres. Then, we train the model using the dataset generated from the simulation system and use it on real-system data through transfer learning. Finally, we predict the number of objects a robot might have grasped before lifting the hand. We achieved an overall accuracy of 79% on the simulation and 60% on the real system dataset.

Degree

thesis:*
Name thesis:degree_name
MS in Computer Science (M.S.C.S.)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2022

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Tamrakar, Utkarsh
Contributors dc:contributor
  • Yu Sun, Ph.D.
  • Shaun Canavan, Ph.D.
  • Paul A. Rosen, Ph.D.

Subjects

dc:subject × 5

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/9474

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Tamrakar, Utkarsh. Predicting the Number of Objects in a Robotic Grasp. Thesis thesis, University of South Florida, 2022. https://digitalcommons.usf.edu/etd/9474