The aim of this work was to implement and compare several activity recognition algorithms which could be used in a smart home environment and would be able to determine the current activity of an observed subject (virtual agent) in the smart home using only data gathered by elementary observations of the environment. Such algorithms are useful in several areas, for example to improve behavior of various virtual agents, making them more aware of actions of the other agents. The algorithms used in this thesis are based on Dynamic Bayesian Networks and have ability to determine whether the observed activity has been completed or just interrupted. An easily extensible 3D interactive simulator of a smart home environment was created to meet the needs of activity recognition and used to gather data for the learning and testing phases of the algorithms. The test subjects were human-controlled virtual agents.

Building smart home environments which automatically or semi-automatically assist and comfort occupants is an important topic in the pervasive computing field, especially with the coming of cheap, easy-to-install sensors. This has given rise to the indispensable need for human activity recognition from ubiquitous sensors whose purpose is to observe and understand what occupants are trying to do from sensory data. The main approach to the problem of human activity recognition is a probabilistic one so as to handle the complication of uncertainty, the overlapping of human behaviours and environmental noise. This thesis develops a probabilistic model as a framework for human activity recognition using multiple multi-modal sensors in complex pervasive environments. The probabilistic model to be developed is adapted and based on the abstract hidden Markov model (AHMM) with one layer to fuse multiple sensors. The concept of factored state representation is employed in the model to parsimoniously represent the state transitions for reducing the number of required parameters. The exact method is used in learning the model’s parameters and performing inference. To be able to incorporate a large number of sensors, several more parsimonious representations including the mixtures of smaller multinomials and sigmoid functions are investigated to model the state transitions, resulting in a reduction of the number of parameters and time required for training. / We examine the approximate variational method to significantly reduce the time required for training the model instead of using the exact method. A system of fixed point equations is derived to iteratively update the free variational parameters. We also present the factored model in the case where all variables are continuous with the use of the conditional Gaussian distribution to model state transitions. The variational method is still employed in this case to speed up the model’s training process. The developed model is implemented and applied in recognizing daily activity in our smart home and the Nokia lab from multiple sensors. The experimental results show that the model is appropriate for fusing multiple sensors in activity recognition with a reasonable recognition performance.