Ageing is linked to a decrease in mobility, which affects the quality of life of many elderly individuals. This is a growing challenge in industrialised societies since the proportion of elderly individuals is becoming larger. One potential solution that would keep these individuals active and independent is the use of mobility assist devices. These devices are designed to reduce the energy demand of the user with the use of electric motors providing torques at joints of the lower limb. Although promising, these devices have a problem: they become uncomfortable after prolonged usage. This is especially true for devices designed to produce substantial assistance. The research goal consisted of quantifying the performance of the physical interfaces, or points of attachments, of an experimental device with multiple interface adjustments. The device was fabricated with design criteria similar to active assist devices to simulate the mechanical behaviour of these particular devices. This analysis provided design recommendations that could ultimately enhance the performance of assist devices available on the market and thus the quality of life of many individuals. This research used force mapping and motion capture to quantify the kinetic and the kinematic compatibility of the device. Experimental results have shown that the position, shape and other parameters of the interfaces had an effect on the relative movement of the brace, or the brace performance. The device interface migration was greater when the interfaces were positioned furthest away form the joint. An increasing level of assistance showed more relative movement between the brace and the user. Interface geometry had a noticeable effect on force distribution over the interface. The results and methodology of this research offers an in depth understanding of the mechanical behavior of the physical interfaces of the developed assist device. Nevertheless, further research and development in the field of human machine interactions are needed in order to develop a physical human-machine interface that will ensure the success of powered assist devices in the future.

Le sens du toucher joue un rôle fondamental dans la façon dont nous percevons notre environnement, nous déplaçons, et interagissons délibérément avec d'autres objets ou êtres vivants. Ainsi, les forces de contact informent à la fois sur l'action réalisée et sa motivation. Néanmoins, l'utilisation de capteurs de force traditionnels est coûteuse, lourde, et intrusive. Dans cette thèse, nous examinons la perception haptique par la capture de mouvement. Ce problème est difficile du fait qu'un mouvement donné peut généralement être causé par une infinité de distributions de forces possibles, en multi-contact. Dans ce type de situations, l'optimisation sous contraintes physiques seule ne permet que de calculer des distributions de forces plausibles, plutôt que fidèles à celles appliquées en réalité. D'un autre côté, les méthodes d'apprentissage de type `boîte noire' pour la modélisation de structures cinématiquement et dynamiquement complexes sont sujettes à des limitations en termes de capacité de généralisation. Nous proposons une formulation du problème de la distribution de forces exploitant ces deux approches ensemble plutôt que séparément. Nous capturons ainsi la variabilité dans la façon dont on contrôle instinctivement les forces de contact tout en nous assurant de leur compatibilité avec le mouvement observé. Nous présentons notre approche à la fois pour la manipulation et les interactions corps complet avec l'environnement. Nous validons systématiquement nos résultats avec des mesures de référence et fournissons des données exhausives pour encourager et évaluer les travaux futurs sur ce nouveau sujet. / The human sense of touch is of fundamental importance in the way we perceive our environment, move ourselves, and purposefully interact with other objects or beings. Thus, contact forces are informative on both the realized task and the underlying intent. However, monitoring them with force transducers is a costly, cumbersome and intrusive process. In this thesis, we investigate the capture of haptic information from motion tracking. This is a challenging problem, as a given motion can generally be caused by an infinity of possible force distributions in multi-contact. In such scenarios, physics-based optimization alone may only capture force distributions that are physically compatible with a given motion, rather than those really applied. In contrast, machine learning techniques for the black-box modelling of kinematically and dynamically complex structures are often prone to generalization issues. We propose a formulation of the force distribution problem utilizing both approaches jointly rather than separately. We thus capture the variability in the way humans instinctively regulate contact forces while also ensuring their compatibility with the observed motion. We present our approach on both manipulation and whole-body interaction with the environment. We consistently back our findings with ground-truth measurements and provide extensive datasets to encourage and serve as benchmarks for future research on this new topic.

Conselho Nacional de Desenvolvimento Científico e Tecnológico / O objetivo do presente trabalho foi avaliar comparativamente parâmetros biomecânicos (tanto antropométricos, quanto cinemáticos) de dados obtidos a partir do console Microsoft Kinect (2010). A avaliação destes parâmetros foi realizada para validar seu uso para obter informações complementares à Análise Ergonomica do Trabalho (AET) e em outras pesquisas, cujos objetivos envolvem o diagnóstico de uso de produtos ou ambientes de trabalho a partir da análises posturais e interações da população que o utiliza. A pesquisa com este console em particular é justificada uma vez que seu lançamento modificou o cenário da biomecânica, já que se trata de um equipamento acessível e portátil. Porém, sua precisão em relação à outros equipamentos ainda está em aberto, sendo inclusive, objeto de estudo de muitas pesquisas em andamento. Os dados obtidos por meio de sistemas de captura de movimentos tridimensionais permitem a avaliação de produtos, atividades e análises de interações homem-objeto. No campo do Design, é uma importante realização, uma vez que permite que profissionais tenham acesso à ferramenta que, anteriormente, era limitada à nichos especializados. O console foi comparado com o sistema de captura de movimentos inercial MVN Biomech (XSENS TECHNOLOGIES) e com o tradicional registro por meio de vídeo. Para obter dados do console Kinect, um software disponível no mercado foi selecionado a partir de critérios predefinidos para obter dados cinemáticos do console. Dois experimentos laboratoriais foram realizados: o primeiro, teve como objetivo obter dados operacionais dos equipamentos e suas limitações de uso; e o segundo foi realizado de forma a obter dados biomecânicos e compará-los a partir de três parâmetros estáticos e um dinâmico. Os parâmetros estáticos envolveram ângulos articulares e segmentares em posturas selecionadas e dimensões segmentares, onde a proposta foi avaliar dados antropométricos e as características do modelo biomecânico referente à manter os corpos rígidos durante a movimentação. O parâmetro dinâmico foi realizado de forma a obter dados de deslocamento global das articulações em movimentações selecionadas. Para possibilitar esta análise, uma plataforma digital foi desenvolvida, constituindo um campo neutro para o tratamento dos dados. A plataforma mantém os dados originais dos sistemas, permitindo a distinção entre os modelos biomecânicos e a retirada de dados que possam ser comparados. Os experimentos realizados permitiram avaliar a usabilidade do console, fornecendo diretrizes para seu uso. Para avaliar a utilização do console em ambientes reais de trabalho, foram realizados registros preliminares em laboratórios químicos, os quais se mostraram viáveis se as limitações, semelhantes às de sistemas baseados em tecnologia ótica, sejam consideradas. Futuras análises devem ser conduzidas para validar estatisticamente os resultados obtidos. Porém, considerando o objetivo do trabalho, pode-se concluir que o sistema avaliado é uma alternativa confiável no contexto proposto. / The aim of the present study was to evaluate biomechanical parameters (both, anthropometric and kinematic) from data acquired through Microsoft Kinect (2010). The validation of its biomechanical characteristics will allow its use in gathering information to complement Ergonomic Work Analysis (EWA) and other user researches that provide product and work environment diagnosis through postural and dynamic assessment. The use of MS Kinect in this research is justified by the fact that is it has changed biomechanical scenario due to the fact that it is an inexpensive and portable alternative to the available motion capture systems available in the market. However, its accuracy has been the subject of many ongoing researches Data acquired from 3D motion capture systems provide means for evaluating products, activities and human-object interactions. In Design, its an important achievement, since it allows professionals to use the tool, considering that most motion capture systems available in the market are not accessible. The Microsoft console was compared to MVN Biomech inertial system (XSENS TECHNOLOGIES) and traditional 2D video data. In order to acquire kinematic data form MS Kinect, a software was chosen, following a few criteria. Two laboratorial experiments were held, where the first aimed to acquire operational details and limitations from the equipments, as for the second aimed to compare biomechanical data through three static parameters and one dynamic. The static parameters involved joint and segment angles, as well as a segments dimensional comparison, whereas the proposals were to assess anthropometric features and to understand if the biomechanical model considers the segments as rigid bodies. The dynamic comparison was based on joints global displacement in selected movements. In order to analyze data from different systems, a digital platform based on a game engine was developed, constituting an even ground for evaluation. The platform maintains original data from the biomechanical models and extracts kinematic parameters, which can be compared. The experiments have provided understanding on the consoles operations, providing guidelines for its usage. In order to also evaluate its usage in real work environments, trial recordings were held in chemical laboratories. These trials have shown the alternative to be viable if the limitations, similar to optical systems, are considered. Future analyses should be conducted in order to statistically validate the results. However, given the goals and context of this research, it can be concluded that the evaluated system is a reliable motion capture alternative.

Les environnements virtuels collaboratifs permettent à plusieurs utilisateurs d’interagir à distance par Internet. Ils peuvent partager une impression de téléprésence en animant à distance un avatar qui les représente. Toutefois, le contrôle de cet avatar peut être difficile et mal restituer les gestes de l’utilisateur. Ce travail vise à animer l’avatar à partir d’une acquisition 3D des gestes de l’utilisateur par vision monoculaire en temps réel, et à rendre la téléprésence virtuelle possible au moyen d’un PC grand public équipé d’une webcam. L’approche suivie consiste à recaler un modèle 3D articulé de la partie supérieure du corps humain sur une séquence vidéo. Ceci est réalisé en cherchant itérativement la meilleure correspondance entre des primitives extraites du modèle 3D d’une part et de l’image d’autre part. Le recalage en deux étapes peut procéder sur les régions, puis sur les contours. La première contribution de cette thèse est une méthode de répartition des itérations de calcul qui optimise la robustesse et la précision sous la contrainte du temps-réel. La difficulté majeure pour le suivi 3D à partir d’images monoculaires provient des ambiguïtés 3D/2D et de l’absence d’information de profondeur. Le filtrage particulaire est désormais une approche classique pour la propagation d’hypothèses multiples entre les images. La deuxième contribution de cette thèse est une amélioration du filtrage particulaire pour le recalage 3D/2D en un temps de calcul limité par des heuristiques, dont la contribution est démontée expérimentalement. Un paramétrage de l’attitude des bras par l’extrémité de leur chaîne cinématique est proposé qui permet de mieux modéliser l’incertitude sur la profondeur. Enfin, l’évaluation est accélérée par calcul sur GPU. En conclusion, l’algorithme proposé permet un suivi 3D robuste en temps-réel à partir d’une webcam pour une grande variété des gestes impliquant des occlusions partielles et des mouvements dans la direction de la profondeur. / Networked 3D virtual environments allow multiple users to interact with each other over the Internet. Users can share some sense of telepresence by remotely animating an avatar that represents them. However, avatar control may be tedious and still render user gestures poorly. This work aims at animating a user’s avatar from real time 3D motion capture by monoscopic computer vision, thus allowing virtual telepresence to anyone using a personal computer with a webcam. The approach followed consists of registering a 3D articulated upper-body model to a video sequence. This involves searching iteratively for the best match between features extracted from the 3D model and from the image. A two-step registration process matches regions and then edges. The first contribution of this thesis is a method of allocating computing iterations under real-time constrain that achieves optimal robustness and accuracy. The major issue for robust 3D tracking from monocular images is the 3D/2D ambiguities that result from the lack of depth information. Particle filtering has become a popular framework for propagating multiple hypotheses between frames. As a second contribution, this thesis enhances particle filtering for 3D/2D registration under limited computation constrains with a number of heuristics, the contribution of which is demonstrated experimentally. A parameterization of the arm pose based on their end-effector is proposed to better model uncertainty in the depth direction. Finally, evaluation is accelerated by computation on GPU. In conclusion, the proposed algorithm is demonstrated to provide robust real-time 3D body tracking from a single webcam for a large variety of gestures including partial occlusions and motion in the depth direction.

Articular fracture reduction is a complex surgical task that requires surgeons to be competent at multiple surgical skills to successfully complete. The list of skills needed includes the ability to use fluoroscopic images to build a 3D mental model of the fracture during reconstruction, the proper handling and use of surgical instruments, how to manipulate the fracture fragment into a reduced configuration with minimal hand motion, proper k-wire placement, and the preservation of surrounding soft tissues. Current training methodology is based on an apprenticeship model. The resident learns by watching a senior surgeon, and then preforms the procedure on live patients under the guidance of the senior surgeon to gain competence. This endangers the patient and does not provide the best outcome for either patient or resident. The work presented in this thesis is the early development of an articular fracture reduction simulator, the subsequent use of the simulator in the training of orthopaedic residents, and assessment of the improvement of residents after practice on the simulator. To date, the simulator has been tested on four different groups of residents,3 different groups from the University of Iowa and one group from the University of Minnesota. Considerable effort has been made to validate the improvement seen in resident performance through objective means. The Objective Structured Assessment of Technical Skills (OSATS) is a global rating score and procedural checklist that has been previously validated to objectively measure surgical skill. Other assessment metrics include hand motion capture to count the number of discrete actions and measure distance traveled during the surgical procedure, fluoroscopic usage and radiation exposure, articular `step-off', the surface deviation from an intact or ideal reconstruction, and contact stress exposure. The results indicate that the goals for the simulator have been met, that the simulator provides a means of training orthopaedic residents, assessing improvement, decreased the cost of training, and improved patient safety. The simulator is not without limitations including sample size, and radiation exposure. The task being trained is complex and can be broken down into basic subtasks that could be trained individually. Even with flaws, the simulator is an improvement over current training methods and is an excellent first step toward creating a surgical skills curriculum to comply with new mandates from orthopaedic surgery's governing bodies.

<p>Hasomed GmbH, a German company in the Field of medicine technology, intends to introduce a gait analysis system on the market. The system includes an inertial sensor which collects data used for generating movement patterns of the feet. This thesis describes the development and evaluation of a new version of the sensor, aimed at minimizing costs, maximizing performance and facilitating production.</p><p>Algorithms used in the gait analysis system are sensitive to noise. Noise sources and precautions taken in order to minimize noise levels are described and discussed. By minimizing the physical size of analogue electronics blocks, static noise and occasional high frequency components were substantially reduced.</p><p>New features including internal temperature sensors, firmware update via serial interface, self-test functions and a wireless link were implemented. Additional improvements are e.g. lower power consumption and an extension of the interface from 2 to 256 (theoretical limit) attached devices. By reducing the number of included components and PCB (Printed Circuit Board) layers, together with use of components that do not require advanced soldering techniques, easier and cheaper production was obtained.</p><p>Research and development presented in this thesis resulted in a sensor with overall good performance and new features.</p>

Hasomed GmbH, a German company in the Field of medicine technology, intends to introduce a gait analysis system on the market. The system includes an inertial sensor which collects data used for generating movement patterns of the feet. This thesis describes the development and evaluation of a new version of the sensor, aimed at minimizing costs, maximizing performance and facilitating production. Algorithms used in the gait analysis system are sensitive to noise. Noise sources and precautions taken in order to minimize noise levels are described and discussed. By minimizing the physical size of analogue electronics blocks, static noise and occasional high frequency components were substantially reduced. New features including internal temperature sensors, firmware update via serial interface, self-test functions and a wireless link were implemented. Additional improvements are e.g. lower power consumption and an extension of the interface from 2 to 256 (theoretical limit) attached devices. By reducing the number of included components and PCB (Printed Circuit Board) layers, together with use of components that do not require advanced soldering techniques, easier and cheaper production was obtained. Research and development presented in this thesis resulted in a sensor with overall good performance and new features.

The Niagara Foot (NF) is a relatively new prosthetic design, primarily intended for use in developing countries. It combines low cost and durability with high performance energy return features. The design has been successfully tested mechanically and in field trials, but to date there has been little quantitative gait data describing the performance of the foot. Biomechanical gait analysis techniques will be used to extract quantitative gait measures. The current study is designed to characterize the effect of heel section stiffness parameter differences between a NF normal heel and a NF with a reduced material heel section., on gait characteristics in persons with unilateral trans-tibial amputations (TTA). Standardized biomechanical gait analysis techniques, adapted for this population, were used to extract quantitative gait measures. Five persons with TTA performed walking tasks while 3D ground reaction forces were recorded via an embedded force platform. A motion capture system also recorded the 3D segmental motion of the lower limbs and torso of each subject. These were combined to calculate net joint moments and mechanical power at the hip and knee of both limbs. These data were compared between a normal NF and a NF with a modified heel. Each participant had a period of two-week adaptation prior to any testing. An EMG system and a prosthesis evaluation questionnaire were used to help analyze the condition. The overall hypothesis of this study was that modification of the heel section stiffness would change several aspects of gait. Although the gait pattern differences between participants and the low participant number produced no significant differences between the conditions for all variables, trends were observed in multiple outcomes. These results report preliminary evidence that for some participants the heel material reduction does impact their gait by showing a different loading phase during the transition between the heel strike and the full contact with the ground. The NF2 may move the gait toward a more flexed knee position. Furthermore, despite a reduction in the material of the heel section results showed that the overall foot stiffness increased. This may be the result of the one-piece design and mechanics of the NF. Further investigations with a bigger cohort of people with TTA are required to look at the importance of the impact of the prosthetic foot heel stiffness.

The loss of a hand or arm is a devastating life event that results in many months of healing and challenging rehabilitation. Technology has allowed the development of an electronic replacement for a lost limb but similar advancements in therapy have not occurred. The situation is made more challenging because people with amputations often do not live near specialized rehabilitation centres. As a result, delays in therapy can worsen common complications like nerve pain and joint stiffness. For children born without a limb, poor compliance with the use of their prosthesis leads to delays in therapy and may affect their development. In many parts of the world, amputation rehabilitation does not exist. Fortunately, we live in an age where advances in technology and engineering can help solve these problems. Virtual reality creates a simulated world or environment through computer animation much like what is seen in modern video games. An experienced team of rehabilitation doctors, therapists, engineers and computer scientists are required to realize a system such as this. A person with an amputation will be taught to control objects in the virtual world by wearing a modified electronic prosthesis. Using computers, it will be possible to analyze his or her movements within the virtual world and improve the wearer's skills. The goals of this system include making the system portable and internet compatible so that people living in remote areas can also receive therapy. The novel approach of using virtual reality to rehabilitate people with upper limb amputations will help them return to normal activities by providing modern and appropriate rehabilitation, reducing medical complications, improving motivation (via gaming modules), advancing health care technology and reducing health care costs. The use of virtual reality technology in the field of amputee rehabilitation is in its earliest stages of development world wide. A virtual environment (VE) will facilitate the early rehabilitation of a patient before they are clinically ready to be fitted with an actual prosthesis. In order to create a successful virtual reality rehabilitation system such as this, an accurate method of tracking the arm in real-time is necessary. A linear displacement sensor and a microelectromechanical system (MEMS) inertial measurement unit (IMU) were used to create a device for capturing the motion of a user's movement with the intent that the data provided by the device be used along with a VE as a virtual rehabilitation tool for new upper extremity amputation patients. This thesis focuses on the design and testing of this motion capture device in order to determine the suitability of current commercially available sensing components as used in this system. Success will be defined by the delivery of accurate position and orientation data from the device so that that data can be used in a virtual environment. Test results show that with current MEMS sensors, the error introduced by double integrating acceleration data is too significant to make an IMU an acceptable choice for position tracking. However, the device designed here has proven to be an excellent cable emulator, and would be well suited if used as an orientation tracker.

It is my thesis that a cost-effective motion capture system for wireless 3D controllers can be developed through the use of low-cost inertial measurement devices and camera systems. Current optical motion capture systems require a number of expensive high-speed cameras. The use of such systems is impractical for many applications due to its high cost. This is particularly true for consumer-level wireless 3D controllers. More importantly, optical systems are capable of directly tracking an object with only three degrees of freedom. The proposed system attempts to solve these issues by combining a low-cost camera system with low-cost micro-machined inertial measurement devices such as accelerometers and gyro sensors to provide accurate motion tracking with a full six degrees of freedom. The proposed system combines the data collected from the various sensors in the system to obtain position information about the wireless 3D controller with 6 degrees of freedom. The system utilizes a number of calibration, error correction, and sensor fusion techniques to accomplish this task. The key advantage of the proposed system is that it combines the high long-term accuracy and low frequency nature of the camera system and complements it with the low long-term accuracy and high frequency nature of the inertial measurement devices to produce a system with a high level of long-term accuracy with detailed high frequency information about the motion of the wireless 3D controller.