The market has been evolving lately, with the introduction of more and more digital tools that industries are making use to improve their overall operations within the Production process. The integration of digital tools within the Product realization process has major advantages in improving production performance. Many large industries make use of digital tools to digitize their products making them smart products. Implementing these digital tools can be beneficial for reshaping the organization which can lead to better customer satisfaction and improve business strategy. This project explores different digital tools that can be integrated with the product realization process and how these tools contribute to the different production development phases. This thesis presents a detailed study of the digital tools Simulation, Visualization, Emulation, and Digital twins which can be integrated with the product development process. A pre-study is conducted to gather knowledge regarding the application of these tools and further discover how these tools can support the Product realization process and is used to describe which tool works best at which stage of the product realization process, which can be used to improve the efficiency and accuracy of the production process. Implementing these digital tools within the production facility can be associated to smart factory paradigm of the Fourth industrial revolution Industry4.0.This research aims to contribute to the use of digital tools in the production processes and aids in bridging the gap between traditional and modern manufacturing methods. The outcome of this study is to clarify how the above-mentioned digital tools are linked to the product realization process to support an efficient and digitalized production development, also mentioning the strengths and weaknesses of these tools. The resulting analysis has provided a framework developed to support an efficient digitalized production development and preparation process for assembly tasks utilizing human and robot collaboration. This research paper can be used as a guide for companies that want to explore how implementing digital tools in their product realization process and how it may improve their productivity.

Ursprünglich wurden Industrieroboter hauptsächlich hinter Schutzzäunen betrieben, um den Sicherheitsanforderungen gerecht zu werden. Mit der Flexibilisierung der Produktion wurden diese scharfen Trennbereiche zunehmend aufgeweicht und externe Sicherheitstechnik, wie Abstandssensoren, genutzt, um Industrieroboter schutzzaunlos zu betreiben. Ausgehend vom Gedanken dieser Koexistenz bzw. Kooperation wurde die Sicherheitssensorik in den Roboter integriert, um eine wirkliche Kollaboration zu ermöglichen. Diese sogenannten kollaborierenden Roboter, oder Cobots, eröffnen neue Applikationsfelder und füllen somit die bestehenden Automatisierungslücken. Doch welche Automatisierungsvariante ist aus wirtschaftlichen Gesichtspunkten die geeignetste? Bisherige Forschung untersucht zum Großteil isoliert eine der beiden Technologien, ohne dabei einen Systemvergleich hinsichtlich technologischer Spezifika und Wirtschaftlichkeit anzustellen. Daher widmet sich diese Dissertation einer Methodik zum wirtschaftlichen Vergleich von kollaborierenden Robotern und Industrierobotern in schutzzaunlosen Maschinenbeladungssystemen. Besonderer Fokus liegt dabei auf dem Herausarbeiten der technischen Faktoren, die die Wirtschaftlichkeit maßgeblich beeinflussen, um ein Systemverständnis der wirtschaftlichen Struktur beider Robotertechnologievarianten zu erhalten. Zur Untersuchung werden die Inhalte eines solchen Planungsvorhabens beschrieben, kategorisiert, systematisiert und modularisiert. Auf wirtschaftlicher Seite wird ein geeignetes Optimierungsmodell vorgestellt, während auf technischer Seite vor allem die Machbarkeit hinsichtlich Greifbarkeit, Layoutplanung, Robotergeschwindigkeiten und Zykluszeitbestimmung untersucht wird. Mit deduktiven, simulativen, empirischen und statistischen Methoden wird das Systemverhalten für die einzelnen Planungsinhalte analysiert, um die Gesamtwirtschaftlichkeit mit einem Minimum an Investment,- Produktions,- und Zykluszeitinformationen a priori vorhersagen zu können. Es wird gezeigt, dass durch einen Reverse Engineering Ansatz die notwendigen Planungsdaten, im Sinne von Layoutkomposition, Robotergeschwindigkeiten und Taktzeiten, mithilfe von Frontloading zu Planungsbeginn zur Verfügung gestellt werden können. Dabei dient der Kapitalwert als wirtschaftliche Bewertungsgrundlage, dessen Abhängigkeit vom Mensch-Roboter-Interaktionsgrad in einem Vorteilhaftigkeitsdiagramm für die einzelnen Technologiealternativen dargestellt werden kann. Wirtschaftlich fundierte Entscheidungen können somit auf quantitiativer Basis getroffen werden.:1. Introduction 25 1.1 Research Domain 25 1.2 Research Niche 26 1.3 Research Structure 28 2. State of the Art and Research 31 2.1 Turning Machines and Machine Tending 31 2.1.1 Tooling Machine Market Trends and Machine Tending Systems 31 2.1.2 Workpiece System 34 2.1.3 Machine System 36 2.1.4 Logistics System 39 2.1.5 Handling System 41 2.2 Robotics 43 2.2.1 Robot Installation Development and Application Fields 43 2.2.2 Fenceless Industrial and Collaborative Robots 48 2.2.3 Robot Grippers 55 2.3 Planning and Evaluation Methods 56 2.3.1 Planning of General and Manual Workstations 56 2.3.2 Cell Planning for Fully Automated and Hybrid Robot Systems 59 2.3.3 Robot Safety Planning 61 2.3.4 Economic Evaluation Methods 70 2.4 Synthesis - State of the Art and Research 71 3. Solution Approach 77 3.1 Need for Research and General Solution Approach 77 3.2 Use Case Delineation and Planning Focus 80 3.3 Economic Module – Solution Approach 86 3.4 Gripper Feasibility Module – Solution Approach 89 3.5 Rough Layout Discretization Model – Solution Approach 94 3.6 Cycle Time Estimation Module – Solution Approach 97 3.7 Collaborative Speed Estimation Module – Solution Approach 103 3.7.1 General Approach 103 3.7.2 Case 1: Quasi-static Contact with Hand 107 3.7.3 Case 2: Transient Contact with Hand 109 3.7.4 Case 3: Transient Contact with Shoulder 111 3.8 Synthesis – Solution Approach 114 4. Module Development 117 4.1 Economic Module – Module Development 117 4.1.1 General Approach 117 4.1.2 Calculation Scheme for Manual Operation 117 4.1.3 Calculation Scheme for Collaborative Robots 118 4.1.4 Calculation Scheme for Industrial Robots 120 4.2 Gripper Feasibility Module – Module Development 121 4.3 Rough Layout Discretization Module – Module Development 122 4.3.1 General Approach 122 4.3.2 Two-Dimensional Layout Pattern 123 4.3.3 Three-Dimensional Layout Pattern 125 4.4 Cycle Time Estimation Module – Module Development 126 4.4.1 General Approach 126 4.4.2 Reachability Study 127 4.4.3 Simulation Results 128 4.5 Collaborative Speed Estimation Module – Module Development 135 4.5.1 General Approach 135 4.5.2 Case 1: Quasi-static Contact with Hand 135 4.5.3 Case 2: Transient Contact with Hand 143 4.5.4 Case 3: Transient Contact with Shoulder 145 4.6 Synthesis – Module Development 149 5. Practical Verification 155 5.1 Use Case Overview 155 5.2 Gripper Feasibility 155 5.3 Layout Discretization 156 5.4 Collaborative Speed Estimation 157 5.5 Cycle Time Estimation 158 5.6 Economic Evaluation 160 5.7 Synthesis – Practical Verification 161 6. Results and Conclusions 165 6.1 Scientific Findings and Results 165 6.2 Critical Appraisal and Outlook 173 / Initially, industrial robots were mainly operated behind safety fences to account for the safety requirements. With production flexibilization, these sharp separation areas have been increasingly softened by utilizing external safety devices, such as distance sensors, to operate industrial robots fenceless. Based on this idea of coexistence or cooperation, safety technology has been integrated into the robot to enable true collaboration. These collaborative robots, or cobots, open up new application fields and fill the existing automation gap. But which automation variant is most suitable from an economic perspective? Present research dealt primarily isolated with one technology without comparing these systems regarding technological and economic specifics. Therefore, this doctoral thesis pursues a methodology to economically compare collaborative and industrial robots in fenceless machine tending systems. A particular focus lies on distilling the technical factors that mainly influence the profitability to receive a system understanding of the economic structure of both robot technology variants. For examination, the contents of such a planning scheme are described, categorized, systematized, and modularized. A suitable optimization model is presented on the economic side, while the feasibility regarding gripping, layout planning, robot velocities, and cycle time determination is assessed on the technical side. With deductive, simulative, empirical, and statistical methods, the system behavior of the single planning entities is analyzed to predict the overall profitability a priori with a minimum of investment,- production,- and cycle time information. It is demonstrated that the necessary planning data, in terms of layout composition, robot velocities, and cycle times, can be frontloaded to the project’s beginning with a reverse engineering approach. The net present value serves as the target figure, whose dependency on the human-robot interaction grade can be illustrated in an advantageousness diagram for the individual technical alternatives. Consequently, sound economic decisions can be made on a quantitative basis.:1. Introduction 25 1.1 Research Domain 25 1.2 Research Niche 26 1.3 Research Structure 28 2. State of the Art and Research 31 2.1 Turning Machines and Machine Tending 31 2.1.1 Tooling Machine Market Trends and Machine Tending Systems 31 2.1.2 Workpiece System 34 2.1.3 Machine System 36 2.1.4 Logistics System 39 2.1.5 Handling System 41 2.2 Robotics 43 2.2.1 Robot Installation Development and Application Fields 43 2.2.2 Fenceless Industrial and Collaborative Robots 48 2.2.3 Robot Grippers 55 2.3 Planning and Evaluation Methods 56 2.3.1 Planning of General and Manual Workstations 56 2.3.2 Cell Planning for Fully Automated and Hybrid Robot Systems 59 2.3.3 Robot Safety Planning 61 2.3.4 Economic Evaluation Methods 70 2.4 Synthesis - State of the Art and Research 71 3. Solution Approach 77 3.1 Need for Research and General Solution Approach 77 3.2 Use Case Delineation and Planning Focus 80 3.3 Economic Module – Solution Approach 86 3.4 Gripper Feasibility Module – Solution Approach 89 3.5 Rough Layout Discretization Model – Solution Approach 94 3.6 Cycle Time Estimation Module – Solution Approach 97 3.7 Collaborative Speed Estimation Module – Solution Approach 103 3.7.1 General Approach 103 3.7.2 Case 1: Quasi-static Contact with Hand 107 3.7.3 Case 2: Transient Contact with Hand 109 3.7.4 Case 3: Transient Contact with Shoulder 111 3.8 Synthesis – Solution Approach 114 4. Module Development 117 4.1 Economic Module – Module Development 117 4.1.1 General Approach 117 4.1.2 Calculation Scheme for Manual Operation 117 4.1.3 Calculation Scheme for Collaborative Robots 118 4.1.4 Calculation Scheme for Industrial Robots 120 4.2 Gripper Feasibility Module – Module Development 121 4.3 Rough Layout Discretization Module – Module Development 122 4.3.1 General Approach 122 4.3.2 Two-Dimensional Layout Pattern 123 4.3.3 Three-Dimensional Layout Pattern 125 4.4 Cycle Time Estimation Module – Module Development 126 4.4.1 General Approach 126 4.4.2 Reachability Study 127 4.4.3 Simulation Results 128 4.5 Collaborative Speed Estimation Module – Module Development 135 4.5.1 General Approach 135 4.5.2 Case 1: Quasi-static Contact with Hand 135 4.5.3 Case 2: Transient Contact with Hand 143 4.5.4 Case 3: Transient Contact with Shoulder 145 4.6 Synthesis – Module Development 149 5. Practical Verification 155 5.1 Use Case Overview 155 5.2 Gripper Feasibility 155 5.3 Layout Discretization 156 5.4 Collaborative Speed Estimation 157 5.5 Cycle Time Estimation 158 5.6 Economic Evaluation 160 5.7 Synthesis – Practical Verification 161 6. Results and Conclusions 165 6.1 Scientific Findings and Results 165 6.2 Critical Appraisal and Outlook 173

In human-robot collaborative (HRC) scenarios where humans and robots work together sharing the same workspace, there is a risk of potential hazard that may occur. In this work, an AI-based risk analysis solution has been developed to identify any condition that may harm a robot and its environment. The information from the risk analysis is used in a risk mitigation module to reduce the possibility of being in a hazardous situation. The goal is to develop safety for HRC scenarios using different AI algorithms and to check the possibilities of improving efficiency of the system without any compromise on the safety. This report presents risk mitigation strategies that were built on top of the robot’s control system and based on the ISO 15066 standard. Each of them used semantic information (scene graph) about the robot’s environment and changed the robot’s movement by scaling speed. The first implementation of risk mitigation strategy used Fuzzy Logic System. This system analyzed the riskiest object’s properties to adjust the speed of the robot accordingly. The second implementation used Reinforcement Learning and considered every object’s properties. Three networks (fully connected network, convolutional neural network, and hybrid network) were implemented to estimate the Qvalue function. Additionally, local and edge computation architecture wereimplemented to measure the computational performance on the real robot. Each model was evaluated by measuring the safety aspect and the performance of the robot in a simulated warehouse scenario. All risk mitigation modules were able to reduce the risk of potential hazard. The fuzzy logic system was able to increase the safety aspect with the least efficiency reduction. The reinforcement learning model had safer operation but showed a more compromised efficiency than the fuzzy logic system. Generally, the fuzzy logic system performed up to 28% faster than reinforcement learning but compromised up to 23% in terms of safety (mean risk speed value). In terms of computational performance, edge computation was performed faster than local computation. The bottleneck of the process was the scene graph generation which analyzed an image to produce information for safety analysis. It took approximately 15 seconds to run the scene graph generation on the robot’s CPU and 0.3 seconds on an edge device. The risk mitigation module can be selected depending on KPIs of the warehouse operation while the edge architecture must be implemented to achieve a realistic performance. / I HRC-scenarier mellan människor och robotar där människor och robotar arbetar tillsammans och delar samma arbetsyta finns det risk för potentiell fara som kan uppstå. I detta arbete har en AI-baserad lösning för riskanalys utvecklats för att identifiera alla tillstånd som kan skada en robot och dess miljö. Informationen från riskanalys används i en riskreduceringsmodul för att minska risken för att vara i en farlig situation. Målet är att utveckla säkerhet för HRC-scenarier med olika AI-algoritmer och att kontrollera möjligheterna att förbättra systemets effektivitet utan att kompromissa med säkerheten.Denna rapport presenterar strategier för riskreducering som byggdes ovanpå robotens styrsystem och baserade på ISO 15066-standarden. Var och en av dem använder semantisk information (scendiagram) om robotens miljö och förändrar robotens rörelse genom skalning av hastighet. Den första implementetationen av riskreducerande strategi använder Fuzzy Logic System. Detta system analyserade de mest riskabla objektens egenskaper för att justera robotens hastighet i enlighet därmed. Den andra implementeringen använder förstärkningslärande och betraktade varje objekts egenskaper. Tre nätverk (fully connected network, convolutional neural network, and hybrid network) implementeras för att uppskatta Q-värde-funktionen. Dessutom implementerade vi också lokaloch edge-arkitektur för att beräkna beräkningsprestanda på den verkliga roboten. Varje modell utvärderas genom att mäta säkerhetsaspekten och robotens prestanda i ett simulerat lagerscenario. Alla riskreduceringsmoduler kunde minska risken för potentiell fara. Fuzzy logicsystem kunde öka säkerhetsaspekten med minsta effektivitetsminskning. Förstärkningsinlärningsmodellen har säkrare drift men har en mer begränsad effektivitet än det fuzzy logiska systemet. I allmänhet fungerar fuzzy logicsystem upp till 28 % snabbare än förstärkningslärande men komprometterar upp till 23 % när det gäller säkerhet (medelrisk hastighetsvärde). När det gäller beräkningsprestanda utfördes kantberäkningen snabbare än lokal beräkning. Flaskhalsen för processen var scengrafgenerering som analyserade en bild för att producera information för säkerhetsanalys. Det tog cirka 15 sekunder att köra scengrafgenerering på robotens CPU och 0,3 sekunder på en kantenhet. Modulen för riskreducering kan väljas beroende på KPI för lagerdriften medan edge-arkitekturen måste implementeras för att uppnå en realistisk prestanda.

Purpose: The thesis investigates the automation of screwing operation on moving assembly line, that can be integrated with the current workflow using automation technology and collaborative robots. The study focuses on reducing the number of manual tasks in screwing operation while considering the ergonomics and safety factor of the operator.    Method: The study uses mixed methods research approach, such as interviews and observation, along with literature review on the desired topics. The study focus on details of the company and their production layout. Practical challenges are derived from the combination of data, providing a guidance on developing an automated solution.    Findings: The research questions were answered, using the data derived from the interviews. The empirical data was compared with the theoretical data to enhance the validity. The resulted data identified to develop a new concept to satisfy all the technical functions.    Implications: The research finds out that a collaboration with an industrial robot, can help the operators to perform desired task. The robot needs to be supported with other aspects such as motion of robot, monitor system and safety. The research identified a conceptual design to overcome these challenges, and to change the production layout to accommodate them is recommended.    Delimitations: The study is focused on the screwing technology on a moving assembly line, and a concept is developed to overcome the challenges. There is no prototype constructed, the proposed idea is designed in robot studio to showcase the idea.    Keyword: Moving assembly line, Human-robot collaboration, Screwing technology, Automated screwing technology, industrial robots, Automobile manufacturing

BACKGROUND: The integration of robotics, and mixed reality has ushered in a substantial revolution within the realm of Industry 4.0. The incorporation of robots into the manufacturing sector plays a pivotal role in enhancing productivity, in which humans and robots collaborate with each other. However, the current robotic system operates within predefined pathways exclusively, lacking an automated mechanism for identifying obstacle free routes to facilitate the movement of robot . Also, in the Human Robot Collaboration , there exists a deficiency in visualising robot motion and status, consequently arise safety vulnerabilities for human operators. OBJECTIVES: This thesis aims to implement a pathfinding algorithm for the robot movement using a mixed reality environment. This Mixed Reality application is used to assign targets and handle obstacles in the robot movement path. The visual guide about the robot movement path, the state of the robot and the tasks to the user that will be displayed using MR. METHODS : In pursuit of the thesis objectives, a Mixed Reality environment was developed using Unity alongside MRTK plugins. Within this framework, an A Star pathfinding algorithm was implemented, facilitating the computation of obstacle free routes between source and destination points. This MR environment not only visualises the trajectory of the robot 's movement but also presents robot status updates and an intuitive interface for operator robot communication. The development process involved creating essential code using C# within the Visual Studio IDE. This code was subsequently deployed onto the HoloLens 2, the designated hardware device for MR applications. The positioning and alignment of virtual objects in relation to the physical world were achieved using the QR code methodology. In this context, source and destination points for the robot 's movement were symbolised as targets, while obstacles were represented by square game objects. For the control and communication of the ABB GoFa C RB 15000 robot, RAPID code was devised within Robot Studio.To guide the thesis, a constructivist philosophical paradigm was embraced, aiming to enhance efficacy. Ethical considerations were scrupulously considered for data collection, prioritising user privacy within the MR environment. Furthermore, commitment to sustainability was maintained throughout the thesis work, yielding environmental, economic, and societal advantages. ANALYSIS: The project that was developed underwent analysis through the scenarios, including both obstacle laden and obstacle free pathfinding situations. The A Star pathfinding algorithm, effectively calculated the obstacle free routes between targets and accomplished designated robotic tasks. This implementation not only offered visual path guidance but also supplied status updates. The analysis process involved observations, video recordings, and documentation. The findings indicated that the created Mixed Reality environment indeed enhanced safety and cognitive ergonomics for the operator. This section also outlines the industrial applications of the project developed. CONCLUSION: Successful development of a Mixed Reality environment has been achieved, aimed at enabling automated obstacle free pathfinding. This environment also offers visualisations for path and status information, with the goal of enhancing safety and cognitive ergonomics in Human Robot Collaboration. Throughout this thesis endeavour, strong attention has been paid to ethical considerations and sustainability.

Nowadays, the use of robots in industrial tasks is growing constantly. However, manual assembly is one area that is hard to make fully automated since manual assembly operations work with different shapes and products that require human finesse to do some operations. Humans, on the other hand, have a lot of limitations since this kind of task can be unergonomic and repetitive for operators, which can cause them stress, fatigue, repetitive stress injuries(RSI), and repetitive motion injuries. This project involved designing an insert for the gripper 2F-85 (version 3) that would allow the collaborative robot (UR5) to carry out more assembly tasks in order to relieve human workers of repetitive tasks. The insert has to handle cylindrical shapes in addition to bigger parts that the actual insert cannot handle due to its parallel stroke. For that, a detailed market analysis and insert research were conducted in the initial study. The new insert was then developed using a double-diamond design process. The needs were ranked using the Moscow prioritization method, and ideas were then generated using the brainstorming technique. The final concept was chosen using the weighted decision matrix method. After the final concept selection, computer-aided design (CAD) technology was employed to create the new insert's 3D model and its technical specifications. The mechanical behaviour of the new insert was analysed to reflect its range of workability, expressing the maximum force that it can withstand on each of its grip work surfaces without presenting plastic deformation. For this study, finite element analyses were conducted following the general method for linear structural analysis using Abaqus. Achieving an insert that can reach, transport, and assemble different shapes will help integrate collaborative robots into manual assembly processes, avoiding the cost of a new gripper.

Human-Robot Collaboration (HRC), where both humans and robots work in the same environment simultaneously, is an emerging field and has increased massively during the past decade. For this collaboration to be feasible and safe, robots need to perform a proper safety analysis to avoid hazardous situations. This safety analysis procedure involves complex computer vision tasks that require a lot of processing power. Therefore, robots with constrained computing resources cannot execute these tasks without any delays, thus for executing these tasks they rely on edge infrastructures, such as remote computational resources accessible over wireless communication. In some cases though, the edge may be unavailable, or connection to it may not be possible. In such cases, robots still have to navigate themselves around the environment, while maintaining high levels of safety. This thesis project focuses on reducing the complexity and the total number of parameters of pre-trained computer vision models by using model compression techniques, such as pruning and knowledge distillation. These model compression techniques have strong theoretical and practical foundations, but work on their combination is limited, therefore it is investigated in this work. The results of this thesis project show that in the test cases, up to 90% of the total number of parameters of a computer vision model can be removed without any considerable reduction in the model’s accuracy. / Människa och robot samarbete (förkortat HRC från engelskans Human-Robot Collaboration), där både människor och robotar arbetar samtidigt i samma miljö, är ett växande forskningsområde och har ökat dramatiskt över de senaste decenniet. För att detta samarbetet ska vara möjligt och säkert behöver robotarna genomgå en ordentlig säkerhetsanalys så att farliga situationer kan undvikas. Denna säkerhetsanalys inkluderar komplexa Computer Vision uppgifter som kräver mycket processorkraft. Därför kan inte robotar med begränsad processorkraft utföra dessa beräkningar utan fördröjning, utan måste istället förlita sig på utomstående infrastruktur för att exekvera dem. Vid vissa tillfällen kan dock denna utomstående infrastruktur inte finnas på plats eller vara svår att koppla upp sig till. Även vid dessa tillfällen måste robotar fortfarande kunna navigera sig själva genom en lokal, och samtidigt upprätthålla hög grad av säkerhet. Detta projekt fokuserar på att reducera komplexiteten och det totala antalet parametrar av för-tränade Computer Vision-modeller genom att använda modellkompressionstekniker så som: Beskärning och kunskapsdestilering. Dessa modellkompressionstekniker har starka teoretiska grunder och praktiska belägg, men mängden arbeten kring deras kombinerade effekt är begränsad, därför är just det undersökt i detta arbetet. Resultaten av det här projektet visar att up till 90% av det totala antalet parametrar hos en Computer Vision-modell kan tas bort utan någon noterbar försämring av modellens säkerhet.

Reinforcement Learning (RL) is popular to solve complex tasks in robotics, but using it in scenarios where humans collaborate closely with robots can lead to hazardous situations. In an autonomous warehouse, mobile robotic units share the workspace with human workers which can lead to collisions, because the positions of humans or non-static obstacles are not known by the robot. Such a scenario requires the robot to use some form of visual input from a lidar sensor or RGB camera, to learn how to adjusts its velocity commands to keep a safe distance and reduced speed when approaching obstacles. This is essential to train an RL-based robotic controller to be safe, however, it does not address the issue to make training itself safer, which in foresight is crucial to enable real-world training. This thesis proposes an agent setup with modified reward structure to train a local planner for a Turtlebot robot with lidar sensor that satisfies safety while maximizing the RL reward. Additionally, it presents a shielding approach that can intervene on a complex controller, by using a safe, sub-optimal backup policy in case the agent enters unsafe states. Two agents, an unshielded agent and one with shielding, are trained with this method in a simulated autonomous warehouse to investigate the effects of shielding during training. For evaluation we compare four conditions: Both agents are deployed once with activated shield and once without it. Those four conditions are analysed in regards to safety and efficiency. Finally, a comparison to the performance of the baseline Trajectory Planner is conducted. The results show that shielding during training facilitates task completion and reduces collisions by 25% compared to the unshielded agent. On the other hand, unshielded training yields better safety results during deployment. Generally, an active shield during deployment contributes to efficiency of the agent, independent of the training setup. The system design is integrated into the Robot Operating System (ROS) where its modular design makes the method compatible with different (RL) algorithms and deployable in OpenAI gym environments. / Reinforcement learning (RL) är en vanlig metod för att lösa komplexa uppgifter inom robotik. Användningen av den i scenarier där människor arbetar nära robotar kan dock leda till farliga situationer. I ett autonomt lager delar mobila robotenheter arbetsområdet med mänskliga arbetare, vilket kan leda till kollisioner eftersom roboten inte känner till människornas positioner eller icke-statiska hinder. I ett sådant scenario måste roboten använda någon form av visuell information från en lidarsensor eller RGB-kamera för att lära sig hur den ska anpassa sina hastighetsinstruktioner för att hålla ett säkert avstånd och minskad hastighet när den närmar sig hinder. Detta är viktigt för att träna RL-baserad robotstyrning så att den blir säker. Det löser dock inte problemet med att göra själva utbildningen säkrare, vilket är avgörande för att möjliggöra utbildning i den verkliga världen. I det här examensarbeten presenteras en agentuppsättning med en modifierad belöningsstruktur för att träna en lokal planerare för en Turtlebot robot med en lidarsensor. Detta ger säkerhet samtidigt som belöningen maximeras. Dessutom presenteras en skyddsmekanism som kan ingripa i det komplexa styrsystemet och byta till ett säkert, suboptimalt reservstyrprogram om agenten hamnar i osäkra tillstånd. Två agenter tränas med denna metod i ett simulerat autonomt lager, en agent utan och en med sköld, för att undersöka effekterna av sköldning under träningen. Fyra konfigurationer jämförs för utvärdering: Båda ämnena används en gång med skölden aktiverad och en gång utan. Dessa fyra konfigurationer analyseras med avseende på säkerhet och effektivitet. Slutligen görs en jämförelse med Trajectory Planner som utgångspunkt. Resultaten visar att skydd under träningen gör det lättare att slutföra uppgiften snabbare och minskar antalet kollisioner med 25% jämfört med en agent utan skydd. Å andra sidan leder träning utan avskärmning till bättre säkerhetsmätningar under arbetet. Generellt sett bidrar en aktiv sköld under installationen till agentens effektivitet, oavsett hur utbildningen är upplagd. Systemet är integrerat i Robot Operating System (ROS). Dess modulära utformning möjliggör kompatibilitet med olika RL-algoritmer, liksom användning av metoden i OpenAI gymmiljöer.

Collaborative robots, cobots, are seen as an alternative to traditional industrial robots since they are more flexible, less space-consuming, and can share the workspace with human operators. For small and medium-sized enterprises, SMEs, the adoption still is in an early stage. This study aims to examine the challenges for manufacturing SMEs when introducing collaborative robots in the business. A literature review is conducted as well as a case study, where managers and operators from five Swedish companies are interviewed about their experiences regarding the introduction of collaborative robots. Additional interviews with international researchers in the field are conducted as well. Since the aim is to understand the challenges in a rather new field, which human-robot collaboration still is for SMEs, this is a qualitative explorative study, with the purpose to gather rich insight about the field. The data has been analyzed in an inductive qualitative analysis. The results show that the biggest challenges for manufacturing SMEs when introducing collaborative robots are related to safety, performance, strategy, involvement, and training. Safety aspects are crucial since human operators work closely with collaborative robots and risk serious injuries even though the managers and operators in the case study do not seem to worry since they perceive the robots as quite slow and safe. Proper safety assessments are important as well, even though there is a concern about the lack of proper safety regulations. Other challenges are related to performance and strategy, e.g how to achieve cost-effectiveness with small production volumes and get the robotic investment to pay off in the long turn, but also to choose a proper cobot solution and a reliable supplier, find suitable work tasks, and obtain quality if the cobot fails to recognize a defective product or skewed inputs on the production line. The recommendation from the companies in the case study is to start with an easy task and to see it as a long-term investment. One important key to success is to find a flexible cobot solution that suits the company's individual needs. Employee involvement is another success factor since involving the operators from the beginning leads to better acceptance and understanding of the new technology and the changed work situation. There is a need for skilled, educated workers as well, although the case study shows that the SMEs highlight the importance of choosing a robot system that is easy to learn and easy to use for everyone. The researchers in the study highlight the need for smarter solutions equipped with enabling technologies and the SME managers call for flexible removable solutions with sensors and vision systems for quality control and the ability to handle surprises on the way.

Future manufacturing will be characterized by the complementarity between humans and automation (human-robot collaboration). This requires new methods and tools for the design and operation of optimized manufacturing workplaces in terms of ergonomics, safety, efficiency, complexity management and work satisfaction. There have been some efforts in the recent years to propose a tool for determining optimal human-automation levels for load balancing. Although the topic is quite new, it shares some similarities with some of the existing research in the area of robotic assembly line balancing. Therefore, it is crucial to review the existing literature and find the most similar models and methods to facilitate the development of new optimization models and algorithms. One of the two contributions that this thesis gives to the research world in the RALBP context is a literature review that involves high quality articles from 1993 to beginning 2018. This literature review includes visual and comprehensive tables—and a label system— where previous research patterns and trends are highlighted. Visualization of data and results obtained by assembly line optimization tools is a very important topic that has rarely been studied. Data visualization would provide a: 1. better comprehension of patterns, trends and qualitative data 2. more constructive information absorption 3. better visualization of relationships and patterns between operations, and 4. better contribution to data manipulation and interaction. The second contribution to research found in this thesis is the use of a human modelling (DHM) tool (called IPS), which is proposed as an assessment to the ergonomic risk that a robotic assembly line may involve. This kind of studies are necessary in order to reduce one of the most frequent reasons of work absence in our today society i.e. musculoskeletal disorders (MSDs). MSDs are often the result of poor work environments and they lead to reduced productivity and quality losses at companies. In view of the above, IPS was used in order to resolve the load handling problem between human and robot, depending on their skills and availability, while fulfilling essential ISO standards i.e. 15066 and 10218:1 and :2. The literature review made it possible to select highly useful documents in developing assumptions for the experiment and contributed to consider real features detected in the industry. Results show that even though IPS is not capable of calculating an entire robotic assembly with human-robot collaboration, it is able to simulate a workstation constituted of one robot and one human. Finite and assembly motions for both human and robot are expected to be implemented in future versions of the software. Finally, the main advantages of using DHM tools in assessing ergonomic risks in RALB can be extracted from the results of this thesis. This advantages include 1. ergonomic evaluation for assembly motions 2. ergonomic evaluation for a full working day (available in future version) and 3. essential ISO standard testing (available in future version).