National Technical University of Athens (NTUA)
Ανάπτυξη και αξιολόγηση διαδραστικών μοντέλων εικονικής πραγματικότητας για το σχεδιασμό ρομποτικών συστημάτων παραγωγής
Abstract
dc:descriptionIn modern manufacturing systems, a need for Human - Industrial Robot Collaboration (HRC) and work-space sharing, to execute manufacturing tasks, has arisen. The key aim of this collaboration and coexistence between Human and Robot, in tasks that are typically performed manually, is to improve quality and productivity, by enhancing workers’ knowledge, cognitive skills and sensory-motor abilities with the strength, accuracy and repeatability of robots. In this case, rather than replacing the human’s work with robots in repetitive and alienating tasks, collaborative assistance of robots can lead workers to perform increased value-added work. Still, HRC remains under-exploited due to safety concerns. For a long time now, safety of HRC is addressed by segregation between humans and robots, and the existing safety techniques are built in a serial, “stop-and-go” fashion, which is unacceptable for highly collaborative tasks. This research investigates safety techniques for a fluent collaboration (“beyond stop-and-go” interaction type), as well as cognitive aids, to support human’s awareness of the robot motion, and anticipation of intent by both humans and robots. A highly-interactive and immersive Virtual Environment (VE) is developed, in order to study HRC and to serve as an experimentation platform for different HRC scenarios. During the collaboration of human with the industrial robot, the user is provided with real-time audiovisual stimuli (cognitive aids), aiming at enriching this collaboration with information. Two safety HRC strategies (techniques) are proposed: in the first, the robot slows down to a reduced, safe speed, when a potential H-R collision is detected; in the second, the robot moves back (retracts) and its trajectory is altered towards a new safe position, so that a potential collision is avoided.Thus, three major research questions arose and had to be dealt with. The first research question is twofold: the first is about is the efficiency of interactive VEs on modeling such a collaboration, and the second is about the acceptability of the VE by the user, as a tool for HRC modeling and research. The second research question concerns the use of different cognitive aids and their contribution to the perceived safety and awareness of the user. The third research question treats the use of the different safety strategies (slow down/move back), their acceptability, and their contribution to the safety and efficiency (fluency) of HRC.The first aim of the research was to build this system as a platform for experimentation of several H-R interaction techniques, as well as of the fluency of H-R collaboration inside the virtual world. The second goal was to investigate users’ enhanced experience and behavior inside the virtual world while cooperating with the robot; the system can be used to investigate the acceptability of H-R collaboration in regard to safety issues, by fostering human’s awareness of the robot motion, with the use of multisensorial cues and aids. Ultimately, the final goal of this research was to consider safety-based robot motion programming, by evaluating different collision avoidance techniques, based on motion awareness and anticipation of intention by both human and robot inside the VE. Therefore, Virtual Reality is used both as a tool for HRC modeling and research, and, as a research field, itself, that can reproduce and enhance the cognitive process of human-robot interaction. In order to respond to the research questions, a novel interactive VE was developed, the “beWare of the Robot” training demo application. “BeWare of the Robot” is a standalone Windows application implemented and assembled in the Unity 3D game engine platform, that can run in a typical PC. Two main 3D user interfaces are employed: (i) a Microsoft Kinect sensor is used as an input device for skeletal tracking and travelling of the user, and, (ii) a stereoscopic HMD (Oculus Rift or eMagin Z800) is used as an output device for 3D visual display, and as an input device for head motion tracking. The use case scenario represents several H-R collaborative tasks (handling, hand-over, holding, collaborative laying) during tape-laying for building aerospace parts, in a composites hand layout work-cell. The main actors of the virtual scene are the user and the industrial robot. A Stäubli RX90L robotic manipulator picks and transfers carbon patches towards the user, and holds the patch during collaborative laying. The user is represented in the VE by a realistic avatar which reproduces in real-time the tracked user movements. Two different use cases were developed. The first use case (beWare of the Robot v1.0 - v1.5) represents collaborative handling of carbon patches towards the user (synchronized collaboration type with spatial coincidence and temporal separation). The second use case (beWare of the Robot v2.0) represents collaborative handling, patch setup, adhesive cover removal, and finally collaborative and assisted laying of the patch on the mould (simultaneous and assisted collaboration type, with spatial and temporal coincidence). The implementation of H-R interaction tasks involves a wide variety of different interaction techniques (direct tracking, ray-casting, collision detection, events triggering etc). The use of markerless body and head tracking to control the avatar during the execution of collaborative tasks, lead to natural and direct interaction in all four generic interaction task types (selection, navigation, manipulation and system control). In addition, two novel interaction metaphors were developed, the “virtual lay metaphor” and the “virtual removal metaphor”. The real laying task is reproduced in the VE with the implementation of the “follow-my-hand” technique: the user has to follow with his hand a virtual hand-like index (guide) that moves along a predefined pattern. The developed safe collaboration techniques can be classified to two categories: passive/proactive techniques and active/adaptive techniques. Proactive techniques are based on the use of cognitive aids (visual and audio cues, alarms etc.), and they aim at facilitating HR communication awareness, and, thus, fostering human’s proactive behavior. On the other hand, adaptive techniques suggest adjustive kinematic behavior by the robot (slow down/move back), and their goal is collision avoidance, without stopping the robot motion. Two user tests (experiments) were set up, one for each use case, using both subjective satisfaction metrics (self-report measures) to investigate user experience, as well as performance metrics concerning HRC issues (collaboration time, robot velocity, detected H-R collisions), mainly for safety techniques testing. The results revealed the efficiency of the two safe HRC techniques, their contribution to safety issues, and their overall acceptance by the users. The system also scored great in HRC modeling capacity, in “presence by involvement”, and in perceived immersion issues. Eventually, overall results are positive and suggest a positive prospect for the use of such VR applications for training on H-R collaboration.
Degree
thesis:*- Grantor dc:publisher
- National Technical University of Athens (NTUA)
- Year dc:date
- 2015
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Matsas, Ilias
- Μάτσας, Ηλίας
Subjects
dc:subject × 15- Εικονική πραγματικότητα
- Εικονικά περιβάλλοντα
- Συνεργασία Ανθρώπου Ρομπότ
- Αλληλεπίδραση ανθρώπου μηχανής
- Virtual reality (VR)
- Virtual environments
- Human-Robot Collaboration
- Human-Robot Cooperation
- Interaction techniques
- Réalité Virtuelle
- Collaboration Homme Robot
- Επιστήμες Μηχανικού και Τεχνολογία
- Επιστήμη Μηχανολόγου Μηχανικού
- Engineering and Technology
- Mechanical Engineering
Rights
dc:rights- Statement dc:rights
-
- BY_NC_ND
- Language dc:language
- gre
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/36703