Human activity analysis has attracted great interest from computer vision researchers due to its promising applications in many areas such as automated visual surveillance, computer-human interactions, and motion-based identification and diagnosis. This dissertation presents work in two areas: general human activity recognition from video, and human activity analysis for the purpose of identifying pathological gait from both 3D captured data and from video. Even though the research in human activity recognition has been going on for many years, still there are many issues that need more research. This includes the effective representation and modeling of human activities and the segmentation of sequences of continuous activities. In this thesis we present an algorithm that combines shape and motion features to represent human activities. In order to handle the activity recognition from any viewing angle we quantize the viewing direction and build a set of Hidden Markov Models (HMMs), where each model represents the activity from a given view. Finally, a voting based algorithm is used to segment and recognize a sequence of human activities from video. Our method of representing activities has good attributes and is suitable for both low resolution and high resolution video. The voting based algorithm performs the segmentation and recognition simultaneously. Experiments on two sets of video clips of different activities show that our method is effective. Our work on identifying pathological gait is based on the assumption of gait symmetry. Previous work on gait analysis measures the symmetry of gait based on Ground Reaction Force data, stance time, swing time or step length. Since the trajectories of the body parts contain information about the whole body movement, we measure the symmetry of the gait based on the trajectories of the body parts. Two algorithms, which can work with different data sources, are presented. The first algorithm works on 3D motion-captured data and the second works on video data. Both algorithms use support vector machine (SVM) for classification. Each of the two methods has three steps: the first step is data preparation, i.e., obtaining the trajectories of the body parts; the second step is gait representation based on a measure of gait symmetry; and the last step is SVM based classification. For 3D motion-captured data, a set of features based on Discrete Fourier Transform (DFT) is used to represent the gait. We demonstrate the accuracy of the classification by a set of experiments that shows that the method for 3D motion-captured data is highly effective. For video data, a model based tracking algorithm for human body parts is developed for preparing the data. Then, a symmetry measure that works on the sequence of 2D data, i.e. sequence of video frames, is derived to represent the gait. We performed experiments on both 2D projected data and real video data to examine this algorithm. The experimental results on 2D projected data showed that the presented algorithm is promising for identifying pathological gait from video. The experimental results on the real video data are not good as the results on 2D projected data. We believe that better results could be obtained if the accuracy of the tracking algorithm is improved.

After amputation possibilities of human body motion are very limited. Amputation usually changes inert characteristics of human body parts and asymmetry of gait is visible. After prosthetics, gait with prosthesis remains asymmetric in relation with impaired body balance control. Loss of proprioreception in amputated side reduces regulation of stance. To retrieve stance skills and to train body balance pneumatic prosthesis is usually applied. The aim of this investigation was to assess influence of pneumatic prosthesis to stance and walking characteristics. To achieve this aim there were two main objectives 1) to evaluate influence of pneumatic prosthesis to stance symmetry in early period of prosthetics; 2) to evaluate influence of pneumatic prosthesis to gait symmetry in early period of prosthetics. Investigation was conducted using computerised pedobarograph „Parotec System“. Changes of weight center position were analyzed at the beginning and the end of rehabilitation period, time characteristics of weight bearing phases were assessed, vertical force and index of gait asymmetry were calculated. Investigation was performed at the department of Physical medicine and rehabilitation of Joint-stock company „Ortopedijos technika“. Patients who underwent below knee amputation were included. Testing was performed twice for every patient: at the beginning and the end of prosthetics. Weight center position in regard to both lower limbs was analyzed. At the end of prosthetics gait... [to full text]

The ubiquitous nature of symmetry lends itself to be taken for granted, however the breath of research on symmetry encompasses several disciplines. In engineering, studies centered on symmetry often address issues in dynamic systems theory, robotics, and gait rehabilitation. This thesis presents findings on two specific topics dealing with passively induced symmetry; dissimilar rotating systems and human gait. Past studies on passive symmetry in dynamic systems often incorporate physical coupling or a controller. This thesis presents a technique to passively induce symmetry between two dissimilar systems that are not physically connected. This work also presents a human gait study consisting of several elements that merge to provide a unique look at how walking symmetry and altered physical parameters (leg length and added weight) of the lower limbs are related. One aspect of this thesis shows the successful development of a general method to induce synchronization between any two dissimilar, uncoupled, rotating systems given the same degrees of freedom, initial angular dynamics, and applied torque. This method is validated with a simulation and subsequent comparison with two physical experiments. The results are in agreement, with slight variations due to the friction and damping of the physical systems. This is further expanded to include the induced symmetry of two systems that experience an external collision. Due to the highly non-linear nature of such systems, an analytical solution was not found; instead a numerical solution is presented that resulted in partial symmetry between systems. The gait study demonstrated that weighted walking and altered leg length have both independent and combined spatio-temporal effects on lower limb symmetry. While altered leg length alone resulted in higher gait asymmetry, the combination of the two physical changes increases this asymmetry to affect the same limb. This study also showed that cognitive and physically distracted walking does not have an added effect to the gait symmetry with passive physical changes. In addition, this study was able to demonstrate that the arm swinging that occurs during natural walking does not significantly alter spatial or temporal gait parameters.

Having a device with the capability of measure motions from gait produced by a human being, could be of most importance in medicine and sports. Physicians or researchers could measure and analyse key features of a person's gait for the purpose of rehabilitation or science, regarding neurological disabilities. Also in sports, professionals and hobbyists could use such a device for improving their technique or prevent injuries when performing. In this master thesis, I present the research of what technology is capable of today, regarding gait analysis devices. The research that was done has then help the development of a suggested standalone hardware sensor node for a Body Area Network, that can support research in gait analysis. Furthermore, several algorithms like for instance UWB Real-Time Location and Dead Reckoning IMU/AHRS algorithms, have been implemented and tested for the purpose of measuring motions and be able to run on the sensor node device. The work in this thesis shows that a IMU sensor have great potentials for generating high rate motion data while performing on a small mobile device. The UWB technology on the other hand, indicates a disappointment in performance regarding the intended application but can still be useful for wireless communication between sensor nodes. The report also points out the importance of using a high performance micro controller for achieving high accuracy in measurements.

L'évaluation de la démarche humaine est l'une des composantes essentielles dans les soins de santé. Les systèmes à base de marqueurs avec plusieurs caméras sont largement utilisés pour faire cette analyse. Cependant, ces systèmes nécessitent généralement des équipements spécifiques à prix élevé et/ou des moyens de calcul intensif. Afin de réduire le coût de ces dispositifs, nous nous concentrons sur un système d'analyse de la marche qui utilise une seule caméra de profondeur. Le principe de notre travail est similaire aux systèmes multi-caméras, mais l'ensemble de caméras est remplacé par un seul capteur de profondeur et des miroirs. Chaque miroir dans notre configuration joue le rôle d'une caméra qui capture la scène sous un point de vue différent. Puisque nous n'utilisons qu'une seule caméra, il est ainsi possible d'éviter l'étape de synchronisation et également de réduire le coût de l'appareillage. Notre thèse peut être divisée en deux sections: reconstruction 3D et analyse de la marche. Le résultat de la première section est utilisé comme entrée de la seconde. Notre système pour la reconstruction 3D est constitué d'une caméra de profondeur et deux miroirs. Deux types de capteurs de profondeur, qui se distinguent sur la base du mécanisme d'estimation de profondeur, ont été utilisés dans nos travaux. Avec la technique de lumière structurée (SL) intégrée dans le capteur Kinect 1, nous effectuons la reconstruction 3D à partir des principes de l'optique géométrique. Pour augmenter le niveau des détails du modèle reconstruit en 3D, la Kinect 2 qui estime la profondeur par temps de vol (ToF), est ensuite utilisée pour l'acquisition d'images. Cependant, en raison de réflections multiples sur les miroirs, il se produit une distorsion de la profondeur dans notre système. Nous proposons donc une approche simple pour réduire cette distorsion avant d'appliquer les techniques d'optique géométrique pour reconstruire un nuage de points de l'objet 3D. Pour l'analyse de la démarche, nous proposons diverses alternatives centrées sur la normalité de la marche et la mesure de sa symétrie. Cela devrait être utile lors de traitements cliniques pour évaluer, par exemple, la récupération du patient après une intervention chirurgicale. Ces méthodes se composent d'approches avec ou sans modèle qui ont des inconvénients et avantages différents. Dans cette thèse, nous présentons 3 méthodes qui traitent directement les nuages de points reconstruits dans la section précédente. La première utilise la corrélation croisée des demi-corps gauche et droit pour évaluer la symétrie de la démarche, tandis que les deux autres methodes utilisent des autoencodeurs issus de l'apprentissage profond pour mesurer la normalité de la démarche. / The problem of assessing human gaits has received a great attention in the literature since gait analysis is one of key components in healthcare. Marker-based and multi-camera systems are widely employed to deal with this problem. However, such systems usually require specific equipments with high price and/or high computational cost. In order to reduce the cost of devices, we focus on a system of gait analysis which employs only one depth sensor. The principle of our work is similar to multi-camera systems, but the collection of cameras is replaced by one depth sensor and mirrors. Each mirror in our setup plays the role of a camera which captures the scene at a different viewpoint. Since we use only one camera, the step of synchronization can thus be avoided and the cost of devices is also reduced. Our studies can be separated into two categories: 3D reconstruction and gait analysis. The result of the former category is used as the input of the latter one. Our system for 3D reconstruction is built with a depth camera and two mirrors. Two types of depth sensor, which are distinguished based on the scheme of depth estimation, have been employed in our works. With the structured light (SL) technique integrated into the Kinect 1, we perform the 3D reconstruction based on geometrical optics. In order to increase the level of details of the 3D reconstructed model, the Kinect 2 with time-of-flight (ToF) depth measurement is used for image acquisition instead of the previous generation. However, due to multiple reflections on the mirrors, depth distortion occurs in our setup. We thus propose a simple approach for reducing such distortion before applying geometrical optics to reconstruct a point cloud of the 3D object. For the task of gait analysis, we propose various alternative approaches focusing on the problem of gait normality/symmetry measurement. They are expected to be useful for clinical treatments such as monitoring patient's recovery after surgery. These methods consist of model-free and model-based approaches that have different cons and pros. In this dissertation, we present 3 methods that directly process point clouds reconstructed from the previous work. The first one uses cross-correlation of left and right half-bodies to assess gait symmetry while the other ones employ deep auto-encoders to measure gait normality.