Back to search

National Technical University of Athens (NTUA)

Βαθμονόμηση ρομποτικού βραχίονα – μηχανικής όρασης και σχεδιασμός συστήματος ελέγχου παρακολούθησης τροχιάς

Abstract

dc:description

This thesis researches the computational algorithms that are used in developing visual tracking robotic applications, where an industrial robot arm tries to follow the displacements of a moving object based on measurement results acquired from a vision system. This category of robotic applications is usually referred to as “visual servoing applications” and is a subject of research for many years. In most cases a vision system consisted of one or more cameras observes a characteristic feature on the object’s surface (ex. hole or corner) and uses image processing techniques to extract the feature’s location in image coordinates. A proper control law is usually commissioned in order to relate the variance of the sensor measurements with the corresponding movement of the robot arm. This thesis examines the case that no characteristic features can be detected on the surface of the observed object, which can happen if the object has smooth surface without obvious texture features. This case is very common in industrial robotic applications, where some rigid objects that need to be tracked by a robot arm have smooth and featureless surfaces.Throughout the development of the discussed visual tracking application, various innovative methods and algorithms were developed and tested. The first innovation concerns the calculation of the relative position and orientation of the vision system’s coordinate frame in reference to the robot tool frame. This calculation is usually referred to as “Hand-Eye Calibration” and all currently proposed methods make use of the 3D transformations derived from the calibration of the cameras. The innovation of the proposed method lies in the use of 3D reconstructed points for the calculation of the Hand-Eye transformation rather than the transformation matrices derived from camera calibration. The superiority of the proposed method is theoretically justified and experimentally proven by means of multiple experimental results. The second innovation concerns the use of 3D surface reconstruction techniques in visual tracking robotic applications, by means of calculating the position and orientation of an observed moving object. Due to the lack of characteristic features on the observed object, its whole visible surface had to be reconstructed by using a vision system consisting of a camera and a multiple laser line device. The cloud of reconstructed points on the object’s surface was correlated with the corresponding CAD data of the object’s model by applying the ICP algorithm. In this way the 3D transformation relating the CAD model’s coordinate frame and the vision system’s measurement frame could be extracted, thus the position and orientation of the observed object could be found. In order to speed up the ICP algorithm the nearest neighbor point extraction function (used by ICP) was accelerated by using 3D space sub-division based on KD-trees. The accuracy and time performance of the proposed method for calculating the position and orientation of an observed object renders the method attractive for practical visual tracking robotic application. The feasibility and performance of the complete visual tracking system is proven by presenting multiple experimental results.The contribution of this thesis in the scientific fields of automation control and robotics is significant, as many of the presented methods and algorithms constitute an innovation to the corresponding fields. The presented theoretical background and the extensive experimental results provide a complete study for building real-world visual tracking robotic applications. Throughout the development of the discussed visual tracking application significant effort has been made for optimizing the time performance of the system, especially the algorithms used by the vision system for calculating the position and orientation of the observed object. Although the use of KD-trees significantly increased time performance, the vision system is not fast enough yet for use in time continuous tracking applications, where a robot arm is required to continuously track the displacement of a moving object in real time. Our goal is to use parallel processing techniques in multi-core processors in order to increase the time performance of the vision system, so that the robot arm will be able to track high-speed moving objects by performing an uninterrupted continuous path motion. Furthermore, a more sophisticated control law may be needed for handling a time continuous tracking application, which should include state prediction functionality for compensating for the position hysteresis of the tracking system.

Degree

thesis:*
Grantor dc:publisher
National Technical University of Athens (NTUA)
Year dc:date
2012

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Aristos, Dimitrios
  • Αρίστος, Δημήτριος

Subjects

dc:subject × 17

Rights

Language dc:language
gre

Identifiers

dc:identifier.*
Identifier
10.12681/eadd/39496

Chain of custody

source
Harvested from
Greek National Archive of PhD Theses
Base URL
phdtheses.ekt.gr/eadd_oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Aristos, Dimitrios; Αρίστος, Δημήτριος. Βαθμονόμηση ρομποτικού βραχίονα – μηχανικής όρασης και σχεδιασμός συστήματος ελέγχου παρακολούθησης τροχιάς. National Technical University of Athens (NTUA), 2012. http://hdl.handle.net/10442/hedi/39496