<p>Object rearrangement is a fundamental problem in robotics with various practical applications ranging from managing warehouses to cleaning and organizing home kitchens. While existing research has primarily focused on single-agent solutions, real-world scenarios often require multiple robots to work together on rearrangement tasks. We propose a comprehensive learning-based framework for multi-agent object rearrangement planning, addressing the challenges of task sequencing and path planning in complex environments. The proposed method iteratively selects objects, determines their relocation regions, and pairs them with available robots under kinematic feasibility and task reachability for execution to achieve the target arrangement. Our experiments on a diverse range of environments demonstrate the effectiveness and robustness of the proposed framework. Furthermore, results indicate improved performance in terms of traversal time and success rate compared to baseline approaches. The videos and supplementary material are available at https://sites.google.com/view/maner-supplementary</p>

This dissertation presents a comprehensive exploration encompassing the design, development, control and the application of reinforcement learning-based force planning for the autonomous grasping capabilities of the innovative assistive robotic exoskeleton gloves. Exoskeleton devices have emerged as a promising avenue for providing assistance to individuals with hand disabilities, especially those who may not achieve full recovery through surgical interventions. Nevertheless, prevailing exoskeleton glove systems encounter a multitude of challenges spanning design, control, and human-machine interaction. These challenges have given rise to limitations, such as unwieldy bulkiness, an absence of precise force control algorithms, limited portability, and an imbalance between lightweight construction and the essential functionalities required for everyday activities. To address these challenges, this research undertakes a comprehensive exploration of various dimensions within the exoskeleton glove system domain. This includes the intricate design of the finger linkage mechanism, meticulous kinematic analysis, strategic kinematic synthesis, nuanced dynamic modeling, thorough simulation, and adaptive control. The development of two distinct types of series elastic actuators, coupled with the creation of two diverse exoskeleton glove designs based on differing mechanisms, constitutes a pivotal aspect of this study. For the exoskeleton glove integrated with series elastic actuators, a sophisticated dynamic model is meticulously crafted. This endeavor involves the formulation of a mathematical framework to address backlash and the subsequent mitigation of friction forces. The pursuit of accurate force control culminates in the proposition of a data-driven model-free force predictive control policy, compared with a dynamic model-based force control methodology. Notably, the efficacy of the system is validated through meticulous clinical experiments. Meanwhile, the low-profile exoskeleton glove design with a novel mechanism engages in a further reduction of size and weight. This is achieved through the integration of a rigid coupling hybrid mechanism, yielding pronounced advancements in wearability and comfortability. A deep reinforcement learning approach is adopted for the real-time force planning control policies. A simulation environment is built to train the reinforcement learning agent. In summary, this research endeavors to surmount the constraints imposed by existing exoskeleton glove systems. By virtue of advancing mechanism design, innovating control strategies, enriching perception capabilities, and enhancing wearability, the ultimate goal is to augment the functionality and efficacy of these devices within the realm of assistive applications. / Doctor of Philosophy / This dissertation presents a comprehensive exploration encompassing the design, development, control and the application of reinforcement learning-based force planning for the autonomous grasping capabilities of the innovative assistive robotic exoskeleton gloves. Exoskeleton devices hold significant promise as valuable aids for patients with hand disabilities who may not achieve full recuperation through surgical interventions. However, the present iteration of exoskeleton glove systems encounters notable limitations in terms of design, control mechanisms, and human-machine interaction. Specifically, prevailing systems often suffer from bulkiness, lack of portability, and an inadequate equilibrium between lightweight construction and the essential functionalities imperative for daily tasks. To address these challenges, this research undertakes a comprehensive exploration of diverse facets within the exoskeleton glove system domain. This encompasses a detailed focus on mechanical design, control strategies, and human-machine interaction. To address wearability and comfort, two distinct exoskeleton glove variations are devised, each rooted in different mechanisms. An innovative data-driven model-free force predictive control policy is posited to enable accurate force regulation. Rigorous clinical experiments are conducted to meticulously validate the efficacy of the system. Furthermore, a novel mechanism is seamlessly integrated into the design of a new low-profile exoskeleton glove, thereby augmenting wearability and comfort by minimizing size and weight. A deep reinforcement learning based control agent, which is trained within a simulation environment, is devised to facilitate real-time autonomous force planning. In summary, the overarching objective of this research lies in rectifying the limitations inherent in existing exoskeleton glove systems. By spearheading advancements in mechanical design, control methodologies, perception capabilities, and wearability, the ultimate aim is to substantially enhance the functionality and overall efficacy of these devices within the sphere of assistive applications.

Nowadays, more and more flexible and efficient processes are required in modern industrial applications. In this field, robots are a key technoligy. In this paper a application is considered, where a 6-axis-industrial robot has to pick-and-place objects time efficiently in a constantly changing environment. Therefore, a concept for automated motion planning is presented, which is composed of two steps which are path planning and trajectory generation. In this paper suitable and established model-based methods are analyzed and chosen. Eventually, the suitability of the presented concept for the considered task is shown by implementing the concept in Matlab and applying it to a 6-axis articulated robot arm.

No description available.

No description available.

No description available.

Multi-agent planning and control is an active and increasingly studied topic of research, with many practical applications, such as rescue missions, security, surveillance, and transportation. More specifically, cases that involve complex manipulator-endowed systems  deserve extra attention due to potential complex cooperative manipulation tasks and their interaction with the environment. This thesis addresses the problem of cooperative motion- and task-planning of multi-agent and multi-agent-object systems under complex specifications expressed as temporal logic formulas. We consider manipulator-endowed robotic agents that can coordinate in order to perform, among other tasks, cooperative object manipulation/transportation. Our approach is based on the integration of tools from the following areas: multi-agent systems, cooperative object manipulation, discrete abstraction design of multi-agent-object systems, and formal verification. More specifically, we divide the main problem into three different parts.The first part is devoted to the control design for the formation control of a team of rigid-bodies, motivated by its application to cooperative manipulation schemes. We propose decentralized control protocols such that desired position and orientation-based formation between neighboring agents is achieved. Moreover, inter-agent collisions and connectivity breaks are guaranteed to be avoided. In the second part, we design continuous control laws explicitly for the cooperative manipulation/transportation of an object by a team of robotic agents. Firstly, we propose robust decentralized controllers for the trajectory tracking of the object's center of mass.  Secondly, we design model predictive control-based controllers for the transportation of the object with collision and singularity constraints. In the third part, we design discrete representations of multi-agent continuous systems and synthesize hybrid controllers for the satisfaction of complex tasks expressed as temporal logic formulas. We achieve this by combining the results of the previous parts and by proposing appropriate trajectory tracking- and potential field-based continuous control laws for the transitions of the agents among the discrete states. We consider teams of unmanned aerial vehicles and mobile manipulators as well as multi-agent-object systems where the specifications of the objects are also taken into account.Numerical simulations and experimental results verify the claimed results. / <p>QC 20180219</p>

Dynamical systems that provably satisfy given specifications have become increasingly important in many engineering areas. For instance, safety-critical systems such as human-robot networks or autonomous driving systems are required to be safe and to also satisfy some complex specifications that may include timing constraints, i.e., when or in which order some tasks should be accomplished. Temporal logics have recently proven to be a valuable tool for these control systems by providing a rich specification language. Existing temporal logic-based control approaches discretize the underlying dynamical system in space and/or time, which is commonly referred to as the abstraction process. In other words, the continuous dynamical system is abstracted into a finite system representation, e.g., into a finite state automaton. Such approaches may lead to high computational burdens due to the curse of dimensionality, which makes it hard to use them in practice. Especially with respect to multi-agent systems, these methods do not scale computationally when the number of agents increases. We will address this open research question by deriving abstraction-free control methods for single- and multi-agent systems under signal temporal logic tasks. Another aim of this research is to consider robustness, which is partly taken care of by the robust semantics admitted by signal temporal logic as well as by the robustness properties of the derived control methods. In this work, we propose computationally-efficient frameworks that deal with the aforementioned problems for single- and multi-agent systems by using feedback control strategies such as optimization-based techniques, prescribed performance control, and control barrier functions in combination with hybrid systems theory that allows us to model some higher level decision-making. In each of these approaches, the temporal properties of the employed control methods are used to impose a temporal behavior on the closed-loop system dynamics, which eventually results in the satisfaction of the signal temporal logic task. With respect to the multi-agent case, we consider a bottom-up approach where each agent is subject to a local (individual) task. These tasks may depend on the behavior of other agents. Hence, the multi-agent system is subject to couplings induced on the task level as well as on the dynamical level. The main challenge then is to deal with these couplings and derive control methods that can still satisfy the given tasks or alternatively result in least violating solutions. The efficacy of the theoretical findings is demonstrated in simulations of single- and multi-agent systems under complex specifications. / <p>QC 20180502</p>

Transit operators are increasingly interested in improving efficiency, reliability, and performance of commuter trains while reducing their operating costs. In this context, the application of optimal control theory to the problem of train control can help towards achieving some of these objectives. However, the traction and braking systems of commuter trains often exhibit significant time delays, making the control of commuter trains highly challenging. Previous literature on optimal train control ignores delays in actuation due to the inherent difficulty present in the optimal control, and in general, the control, of input-delay systems. In this thesis, optimal control of a commuter train is presented under two cases: (i) equal, and (ii) unequal time delays in the train traction and braking commands. The solution approach uses the economic model predictive control framework, which involves formulating and solving numerical optimization problems to achieve minimum mixed energy-time optimal control in discretized spatial and time domains. The optimization problems are re-solved repeatedly along the track for the remainder of the trip, using the latest sensor measurements. This would essentially establish a feedback mechanism in the control to improve robustness to modelling errors. A key feature of the proposed methods is that they are model-based controllers, they explicitly incorporate model information, including time delays, in controller synthesis hence avoiding performance degradation and potential instability. To address the issue of input-delays, the well-established predictor approach is used to compensate for input-delays. The case of equal traction-braking delays is treated in discretized spatial domain, which uses an already developed convex approximation to the optimization problem. The use of the convex approximation allows for robust and rapid computation of the optimal control solution. The non-equal traction-braking delays scenario is formulated in time domain, leading to a nonconvex optimization problem. An alternative formulation for minimum-time optimal control problems is presented for delay-free systems that simplifies the solution of minimum-time optimal control problems compared to conventional minimum-time optimal control formulations. This formulation along with the predictor approach is used to help solve the train optimal control problem in the case of non-equal traction-braking delays. The non-equal traction-braking delay controller is compared with the equal traction-braking delay controller by insertion of an artificial delay to make the shorter delays equal to the longer delay. Results of numerical simulations demonstrate the validity and effectiveness of the proposed controllers. / Thesis / Master of Applied Science (MASc)

<p dir="ltr">Introduces a new framework and state-of-the-art algorithm in closed-loop prediction for motion planning under differential constraints. More specifically, this work introduces the idea of sampling on specific "sampling regions" rather than the entire workspace to speed-up the motion planning process by orders of magnitude.</p>