The task of modeling and controlling the evolution of dynamical sys- tems is one of the main objectives in mechatronics engineering. When approaching the problem of controlling physical or digital systems, the dynamical models have been historically divided into continuous-time, described by differential equations, and discrete-time, described by difference equations. In the last decade, a new class of models, known as hybrid dynamical systems, has gained popularity in the control community because of its high versatility. This framework combines continuous-time and discrete- time evolution, thus allowing for both the description of a broader class of systems and the achievement of better-performing controllers, compared to the traditional continuous-time alternatives. After the first rigorous introduction of the framework, several Lyapunov-based results were published in the literature, and numerous application areas were shown to benefit from the introduction of a hybrid dynamics, like systems involving impacts or physical systems connected to digital controllers (cyber-physical systems). In this thesis, we use the hybrid framework to study different mechatronics-inspired control problems. The applications we consider are diverse, so we split the presentation into three parts. In the first part we further analyze a particular hybrid control strategy, known as reset control, providing some new theoretical guarantees, together with an application to adaptive control. In the second part we consider two applications of the hybrid framework to the network dynamics field, specifically we analyze the problems of distributed state estimation and of uniform synchronization of nonlinear oscillators. In the third part, we use a hybrid approach to study two applications where this framework has been rarely employed, or not at all, namely smart agriculture and trajectory tracking for a bipedal walking robot. We study these application-inspired problems from a theoretical point of view, giving robust Lyapunov-based stability guarantees. We complement the theoretical analysis with numerical results, obtained from simulations or from experiments.

No description available.

The aim of this study is to investigate influence of physical activity on postural balance of children (12 - 15 years old). Method is measurment of postural balance on stabilometric desc in differently challenging positions. Three groups are tested (biathletes, oarsmen and control group), each in count 15 - 20 probands. We expect, young biathletes will have better postural stability than oarsmen and control group thanks to specific training. Keywords Postural balance, static balance, biathlon, rowing, sport, children, laterality, bipedal stance, unipedal stance

This thesis introduces a new measure of balance for bipedal robotics called the foot placement estimator (FPE). To develop this measure, stability first is defined for a simple biped. A proof of the stability of a simple biped in a controls sense is shown to exist using classical methods for nonlinear systems. With the addition of a contact model, an analytical solution is provided to define the bounds of the region of stability. This provides the basis for the FPE which estimates where the biped must step in order to be stable. By using the FPE in combination with a state machine, complete gait cycles are created without any precalculated trajectories. This includes gait initiation and termination. The bipedal model is then advanced to include more realistic mechanical and environmental models and the FPE approach is verified in a dynamic simulation. From these results, a 5-link, point-foot robot is designed and constructed to provide the final validation that the FPE can be used to provide closed-loop gait control. In addition, this approach is shown to demonstrate significant robustness to external disturbances. Finally, the FPE is shown in experimental results to be an unprecedented estimate of where humans place their feet for walking and jumping, and for stepping in response to an external disturbance.

This thesis introduces a new measure of balance for bipedal robotics called the foot placement estimator (FPE). To develop this measure, stability first is defined for a simple biped. A proof of the stability of a simple biped in a controls sense is shown to exist using classical methods for nonlinear systems. With the addition of a contact model, an analytical solution is provided to define the bounds of the region of stability. This provides the basis for the FPE which estimates where the biped must step in order to be stable. By using the FPE in combination with a state machine, complete gait cycles are created without any precalculated trajectories. This includes gait initiation and termination. The bipedal model is then advanced to include more realistic mechanical and environmental models and the FPE approach is verified in a dynamic simulation. From these results, a 5-link, point-foot robot is designed and constructed to provide the final validation that the FPE can be used to provide closed-loop gait control. In addition, this approach is shown to demonstrate significant robustness to external disturbances. Finally, the FPE is shown in experimental results to be an unprecedented estimate of where humans place their feet for walking and jumping, and for stepping in response to an external disturbance.

D'un point de vue énergétique, les robots marcheurs sont moins performants que les humains. Face à ce défi, cette thèse propose une approche pour contrôler et optimiser les allures de marche des robots bipèdes à la fois en 2D et 3D en considérant les fréquences propres du robot et par ajout de ressorts. L'étude porte essentiellement sur un robot bipède 2D à 5 corps et des pieds ponctuels ainsi qu'un robot bipède 3D à 8 corps avec des pieds sans masse à contact linéique. La commande en boucle fermée considérée est basée sur la méthode des contraintes virtuelles et la linéarisation par retour d'état. Suite à des études précédentes, la stabilité du robot bipède 2D est vérifiée par une section de Poincaré unidimensionnelle et étendue au robot bipède 3D à contact linéique avec le sol. L'optimisation est effectuée en utilisant la programmation quadratique séquentielle. Les paramètres optimisés incluent des coefficients de polynômes de Bézier et des paramètres posturaux. Des contraintes d'optimisation sont imposées pour assurer la validité de l'allure de marche. Pour le robot bipède 2D, deux configurations différentes de ressorts placés aux hanches sont étudiées. Ces deux configurations ont permis de réduire le coût énergétique. Pour le robot bipède 3D, les paramètres d'optimisation sont séparés en deux parties : ceux décrivant le mouvement dans le plan sagittal et ceux du plan frontal. Les résultats de l'optimisation montrent que ces deux types de paramètres doivent être optimisés. Ensuite, des ressorts sont ajoutés respectivement par rapport au plan sagittal, par rapport au plan frontal puis dans les deux plans. Les résultats montrent que l'ajout des ressorts dans le plan sagittal permet de réduire significativement le coût énergétique et que l'association de ressorts dans le plan frontal améliore encore plus la consommation d'énergie. / From an energy standpoint, walking robots are less efficient than humans. In facing this challenge, this study aims to provide an approach for controlling and optimizing the gaits of both 2D and 3D bipedal robots with consideration for exploiting natural dynamics and elastic couplings. A 5-link 2D biped with point feet and an 8-link 3D biped with massless line feet are studied. The control method is based on virtual constraints and feedback linearization. Following previous studies, the stability of the 2D biped is verified by computing scalar Poincaré map in closed form, and now this method also applies to the 3D biped because of its line-foot configuration. The optimization is performed using sequential quadratic programming. The optimization parameters include postural parameters and Bézier coefficients, and the optimization constraints are used to ensure gait validity. For the 2D biped, two different configurations of hip joint springs are investigated and both configurations successfully reduce the energy cost. For the 3D biped, the optimization parameters are further divided into sagittal parameters and coronal parameters, and the optimization results indicate that both these parameters should be optimized. After that, hip joint springs are added respectively to the sagittal plane, the coronal plane and both these planes. The results demonstrate that the elastic couplings in the sagittal plane should be considered first and that the additional couplings in the coronal plane reduce the energy cost even further.

The aim of this thesis is to recognize a walking person in a sequence of images by defining his or her reference points to compare the course of their movement and then to identify the scanned person. Methods „k-means“ and „mean shift“ are used to obtain the silhouette of the person. However “environment model estimation” method is used here before those mentioned above. It is a type of a difference method and it helps to specify the scanning area and shortens the time of segmentation. During the search for the reference points the thesis focuses on three areas: the centre of the head and both ankle joints. Those points are later determined on the previous image sequence and compared with the real locations of the centre of the head and ankle joints marked by the user. The thesis also focuses on comparing the movement courses of those points and tries to identify the people whose walks are being scanned. Problematic situations which occurred during the whole process are analyzed in the end. The result of the thesis is an algorithm which can locate a moving person in an image sequence (video) and determine the reference points (centre of the head and ankles) to compare them and identify the scanned person.

There is emerging evidence for the potential of occupational back-support exoskeletons (BSEs) to reduce physical demands, and thereby help control/prevent the risk of overexertion injuries associated with manual material handling. However, it is important to understand whether BSEs also introduce any unintended safety challenges. One potential risk associated with BSE use is increased risk of falls, since their extra weight, rigid structure, and external hip extension torque may increase demands on the postural control system. However, there is currently limited evidence on whether, and to what extent, BSE use alters postural stability and/or fall risk. The primary goal of this work was to understand the effects of exoskeleton use, and quantify the effects of exoskeleton design parameters, on balance and postural stability, with a focus on passive BSEs used for repetitive lifting work. A comprehensive evaluation of BSE use was performed under controlled laboratory conditions, focusing on three classes of human activity that form the basis of maintaining postural balance in diverse real-life scenarios: maintenance of a specified posture, voluntary movement, and reaction to an external perturbation. The first study demonstrated that during quiet bipedal stance, BSE use increased median frequency and velocity of the center of pressure in the anterior-posterior direction. In the second study on level walking, BSE use caused an increase in gait step width and gait variability, and decrease in the margin of stability. BSE use with high supportive torque led to adapted gait patterns in early-stance phase. Hip range of motion and peak hip flexion velocity also decreased, and participants exhibited different strategies to increase mechanical energy for propelling the leg in late-stance phase: these effects increased with increasing torque applied by the exoskeleton. In the final study, BSE use did not alter the maximal lean angle from which individuals could successfully execute single step balance recovery, following a forward loss of balance. However, several recovery responses were negatively affected by BSE use, including increased reaction time, impeded hip flexion, and reduced margin of stability in the high-torque condition. This is the first systematical investigation to quantify the effects of passive BSEs with multiple supportive torque levels on balance and postural stability. While exoskeleton effects on static balance were minimal, more substantial changes in gait spatiotemporal parameters, hip joint kinematics, and dynamic margins of stability were observed in the later studies. Our results indicate that postural stability deteriorated with exoskeleton use in dynamic conditions, and provide mechanistic insight into how stability is altered by different exoskeleton design factors such as added mass, restricted range of motion, and external hip extension torque. While our results are suggestive of increased fall risk, especially in the high-torque condition, fall risk in real life is moderated by a complex combination of individual and environmental conditions. Future work should consider more complex, realistic tasks and also include a more diverse sample that is studied under longer exposure durations, to further elucidate these findings. Our characterizations of a wide variety of postural responses as a function of exoskeleton torque settings are expected to contribute to improving both design and practice guidelines to facilitate the safe adoption of BSEs in the workplace. / Doctor of Philosophy / Occupational back-support exoskeletons (BSEs) – wearable mechanical systems designed to support, augment, and/or assist back extension – are expected to serve as an alternative workplace intervention to control and prevent overexertion injuries related to manual material handling tasks. While recent studies have shown the beneficial effects of BSE use in terms of physical load reduction on the low back, some concerns have also been raised on unexpected or unintended effects of exoskeletons. One potential risk associated with exoskeleton use is increased risk of falls, since a BSE's extra weight, rigid structure, and external hip extension torque are expected to place increased demands on the postural control system. Increase in fall risk is a critical safety concern, as occupational falls are a serious problem in terms of injuries, medical/industrial cost, and lost work time. However, there exists limited evidence on whether the use of a BSE alters postural stability and/or increases fall risk. Hence, the goal of our study was to quantify the effects of BSE use on postural stability in various conditions related to real-life scenarios, such as standing balance, walking stability and how one would respond to a loss of balance following an external perturbation. Our results showed that during quiet standing, BSE use slightly increased postural sway. In level walking tasks, BSE use had adverse effects on step length, step width, and dynamic stability. Furthermore, wearing a BSE with high supportive torque led to adapted gait patterns in early-stance phase, whereas participants showed different strategies to increase mechanical energy for propelling the leg in late-stance phase. In the final study investigating single step balance recovery following a forward loss of balance, we found that BSE use negatively affects balance recovery, mainly by impeding hip flexion. Thus, our work suggests that exoskeleton use can deteriorate balance and/or postural stability in situations of static standing, voluntary walking, and reacting to an external perturbation, thereby potentially leading to an increase in fall risk. These effects may be more pronounced among specific population sub-groups such as older workers, and may also affect individuals more severely under conditions of stress or fatigue. Hence, future studies must include more rigorous testing of BSE use using a variety of challenging and realistic scenarios, and also include more diverse population samples. The findings from this work are expected to contribute to improving design and practice guidelines to facilitate the safe adoption of BSEs in the workplace.

[pt] A aprendizagem por reforço, uma técnica influente para treinar sistemas inteligentes, ganhou destaque na academia e na indústria devido à sua capacidade de resolver problemas complexos sem modelos pré-existentes. No entanto, sua aplicação a sistemas do mundo real é desafiadora devido à sua complexidade causada por altas não linearidades, amostras limitadas e restrições. Consequentemente, a pesquisa nessa área tem se concentrado principalmente em simulação, onde os modelos podem ser facilmente testados e refinados. Neste trabalho, foi proposta uma estratégia de aprendizagem por reforço para um robô bípede do mundo real aprender o comportamento de caminhada do zero. Também é apresentado um desenho de sistema focado na redução de estresse e simplicidade, garantindo um desempenho robusto, incluindo uma placa de circuito impresso personalizada para o manuseio eficiente dos componentes elétricos. O software do sistema é dividido entre a placa do sistema mestre e o sistema baseado em ROS, permitindo a comunicação entre os componentes e resolvendo o problema de perda de dados e atraso na comunicação. A simulação do modelo do robô é desenvolvida na plataforma Mujoco, incorporando propriedades físicas e parâmetros ambientais. Os algoritmos DDPG, TD3 e SAC foram utilizados para aprendizado e avaliação da técnica de destilação de política para transferência de conhecimento para uma rede mais eficiente. Finalmente, foi avaliada a transferência do aprendizado para o mundo real apresentando um experimento preliminar de aprendizado do zero no mundo real. Os resultados demonstram a eficácia do projeto do sistema robótico e dos algoritmos de aprendizado, alcançando uma caminhada estável na simulação e um máximo de catorze passos na vida real com a destilação de política do algoritmo SAC. / [en] Reinforcement learning, an influential technique for training intelligent systems, has gained prominence in academia and industry due to its ability to solve complex problems without pre-existing models. However, its application to real-world systems is challenging due to its complexity caused by high non-linearities, limited samples, and constraints. Consequently, research in this area has mainly focused on simulation, where models can be easily tested and refined. In this work, a reinforcement learning strategy towards a real-world bipedal robot to learn walking behavior from scratch was proposed. We present a robot system design focused on stress reduction and simplicity, ensuring robust performance, including a custom printed circuit board (PCB) for efficient handling of electrical components. The system s software is divided into the master system board and the ROS system, allowing communication between components and addressing data loss and communication delay issues. The robot model simulation is developed on the Mujoco platform, incorporating physical properties and environmental parameters. We utilize Deep Deterministic Policy Gradient (DDPG), Twin-Delayed Deep Deterministic Policy Gradient (TD3), and Soft Actor-Critic (SAC) algorithms for learning and evaluating the policy distillation technique for transferring knowledge to a more efficient network. Finally, we evaluate the transfer of learning to the real world and present a preliminary experiment of learning from scratch in the real world. Our results demonstrate the effectiveness of the robotic system design and the learning algorithms, achieving stable walking in simulation and a maximum of fourteen steps in real life with the policy distillation of the SAC algorithm.

L’objectif général de ce travail doctoral était de comparer les effets de la fatigue musculaire des quadriceps femoris après un exercice musculaire volontaire (VOL) et un exercice musculaire électroinduit (ES) sur le contrôle postural bipodal, ainsi que sur la fatigue centrale. Les résultats montrent qu’à l’issue d’une tâche fatigante unilatérale ou bilatérale, l’exercice ES dégrade davantage la force usculaire que l’exercice VOL. Cependant, le contrôle postural bipodal est indifféremment perturbépar les deux exercices. En outre, les vitesses de récupération des capacités posturales et de force musculaire ne diffèrent pas à l’issue des exercices. Par ailleurs, l'exercice VOL altère davantage la commande centrale que l'exercice ES (immédiatement à l’issue de l’effort), tandis que celui-ci retarde l’apparition de la fatigue centrale et la maintient plus longuement. Etant donné que l'exercice VOL estinduit par la commande centrale et que l'exercice ES est généré par une stimulation artificielle externe, on peut émettre l’hypothèse que l'exercice VOL produit essentiellement une fatigue supraspinale, tandis que l'exercice ES engendre surtout une fatigue spinale. / The overall objective of this thesis was to compare the effect of fatigue of the quadriceps femoris after fatiguing voluntary contractions (VOL) and fatiguing neuromuscular electrical stimulation (ES) on bipedal postural control, and central fatigue. The results show that after unilateral or bilateral muscle fatigue, the ES exercise affected the muscle strength more than the VOL exercise. However, bipedal postural control was similarly deteriorated for both exercises. Moreover, the recovery speeds of postural control and muscle strength abilities did not differ for the both exercises. In addition, the VOL exercise alters central drive quicker than the ES exercise immediately after their completion while the ES exercise delays and prolongs the central fatigue. As the VOL exercise is induced by central command and the ES exercise is generated by artificial external stimulation, one can hypothesize that the VOL exercise especially produces supraspinal fatigue, while the ES exercise especially engenders spinal fatigue.