Master´s thesis deals with current problems of face detection and its parts in the infrared thermographic spectrum. Most previously published literature deals with the detection in the visible spectrum, making the thermographic detection range an interesting alternative. The work deals with the processing of image signals, images and faces in thermographic spectrum, selected methods of face detection and its parts and also deals with practical system design for detecting facial parts in this spectrum and its subsequent testing.

This master’s Thesis focuses on image processing on Android platform and development of an application, that is able to do face detection and recognition in real scene. Thesis gives highlight of modern algorithms of face detection. It first examines and compares the standard features of Android platform (FaceDetector a FaceDetectionListener) and JJIL, OpenIMAJ, OpenCV libraries experiment, and presents the results. For purposes of face recognition was selected OpenCV library. Three different algorithms of identification were tested: FisherFaces, EigenFaces a Local Binary Patterns Histograms. Based on performance comparison best methods were implemented in developed application.

The thesis deals with automatic control the font size by the distance from the reader. It includes theoretical acquaintance with the face detection and subsequent tracking of the detected area during the scene. Furthermore, there is a comparison of the tracking algorithms. Then the calculation of distance is decribed. It is based on the user’s calibration and based on the outcome occurs the font size is automatically corrected. There is also a description of a separate application Automatical controller of the text size, with the recommended settings of the program.

Ziel dieser Diplomarbeit ist es, eine flexibel zu verwendende Plattform für Visual Servoing-Aufgaben zu Erstellen, mit der eine Vielzahl von verschiedenen Anwendungsfällen abgedeckt werden kann. Kernaufgabe der Arbeit ist es dabei, verschiedene Verfahren der Gesichtserkennung (face detection) am Beispiel der Haar-Kaskade und -wiedererkennung (face recognition) am Beispiel von Eigenfaces und Fisherfaces zu betrachten und an ausführlichen Beispielen vorzustellen. Dabei sollen allgemeine Grundbegriffe der Bildverarbeitung und bereits bekannte Verfahren vorgestellt und ihre Implementierung im Detail dargestellt werden. Aus den dadurch gewonnen Erkenntnissen und dem sich ergebenden Anforderungsprofil an die zu entwickelnde Plattform leitet sich anschließend die Realisierung als eigenständige Anwendung ab. Hierbei ist weiterhin zu untersuchen, wie die neu zu entwickelnde Software zukunftssicher und in Hinblick auf einen möglichen Einsatz in Praktika einfach zu verwenden realisiert werden kann. Sämtliche während der Arbeit entstandenen Programme und Quellcodes werden auf einem separaten Datenträger zur Verfügung gestellt. Eine komplett funktionsfähige Entwicklungsumgebung wird als virtuelle Maschine beigelegt.

Facial expression recognition (FER) is still a challenging concept, and machines struggle to comprehend effectively the dynamic shifts in facial expressions of human emotions. The existing systems, which have proven to be effective, consist of deeper network structures that need powerful and expensive hardware. The deeper the network is, the longer the training and the testing. Many systems use expensive GPUs to make the process faster. To remedy the above challenges while maintaining the main goal of improving the accuracy rate of the recognition, we create a generic hierarchical structure with variable settings. This generic structure has a hierarchy of three convolutional blocks, two dropout blocks and one fully connected block. From this generic structure we derived four different network structures to be investigated according to their performances. From each network structure case, we again derived six network structures in relation to the variable parameters. The variable parameters under analysis are the size of the filters of the convolutional maps and the max-pooling as well as the number of convolutional maps. In total, we have 24 network structures to investigate, and six network structures per case. After simulations, the results achieved after many repeated experiments showed in the group of case 1; case 1a emerged as the top performer of that group, and case 2a, case 3c and case 4c outperformed others in their respective groups. The comparison of the winners of the 4 groups indicates that case 2a is the optimal structure with optimal parameters; case 2a network structure outperformed other group winners. Considerations were done when choosing the best network structure, considerations were; minimum accuracy, average accuracy and maximum accuracy after 15 times of repeated training and analysis of results. All 24 proposed network structures were tested using two of the most used FER datasets, the CK+ and the JAFFE. After repeated simulations the results demonstrate that our inexpensive optimal network architecture achieved 98.11 % accuracy using the CK+ dataset. We also tested our optimal network architecture with the JAFFE dataset, the experimental results show 84.38 % by using just a standard CPU and easier procedures. We also compared the four group winners with other existing FER models performances recorded recently in two studies. These FER models used the same two datasets, the CK+ and the JAFFE. Three of our four group winners (case 1a, case 2a and case 4c) recorded only 1.22 % less than the accuracy of the top performer model when using the CK+ dataset, and two of our network structures, case 2a and case 3c came in third, beating other models when using the JAFFE dataset. / Electrical and Mining Engineering

Every second, major companies such as Google, Apple, Amazon and Microsoft are col- lecting a great amount of data from users. Photos, voice and texts etc. are stored in the companies massive server parks. With this amount of data, along with technical benefits such as computing power and exceeding algorithms, the companies can train their ma- chine learning models to levels which is hard for a local computing landscape to reach up to.Nowadays, the companies allow developers to use their services and this paper proclaims the benefits of using these. The aim for this thesis is to show how cloud based face recognition and speech recognition can be utilized to create a virtual assistant in Magic Mirror. This new concept opens new possibilities for human-computer interaction.The use case for the assistant was to aid visitors who comes into an office for an appointment with an employee. The prototype of the assistant showed 94% accuracy when identifying faces and fulfilled the task well when the employee name was internationally known, while having difficulties with others, e.g. Swedish names.

L’objectif du travail de cette thèse est la contribution au développement de nouvelles techniques dans le domaine dessystèmes de détection sans marqueur pour une utilisation dans trois domaines vitaux de la santé en utilisant des capteursinnovants et peu coûteux. Pour la réalisation de nos objectifs nous avons eu recours principalement à de l’électroniqueembarquées et du traitement du signal en utilisant le capteur Kinect. Des résultats encourageants ont été obtenus et sontprésentés tout au long de cette thèse. Dans la première partie de ce travail, nous présentons un nouveau système desurveillance visuelle sans marqueur en temps réel pour détecter et suivre les personnes âgées et surveiller leurs activitésdans leur environnement intérieur en utilisant un réseau de capteurs Kinect. Le système identifie également l’événementde chute des personnes âgées sous surveillance. Dans la deuxième partie nous utilisons également le capteur Kinectmais cette fois ci pour la détection sans marqueur des mouvements de la tête d’un patient lors d’un examen utilisant LaTomographie par Emission de Positons (CT/PET) du cerveau. Ce travail est basé sur la compensation de la dégradationde l’image TEP due aux mouvements de la tête du patient. Pour nos essais un cobaye dit « fantôme » a été réalisé,les résultats sur le fantôme sont prometteur ce qui a donné lieu à un test sur un vrai patient volontaire. Les résultatsfinaux montrent l’efficacité de ce nouveau système. La troisième partie du travail présente la mise en oeuvre d’un nouveausystème intelligent pour contrôler un fauteuil roulant électrique par des mouvements spéciaux de la tête toujours sansmarqueur. Un algorithme adapté est conçu pour détecter en continu les degrés des mouvements du visage en utilisant lecapteur Kinect. Fautes de fauteuil roulant électrique, le système a été testé sur un véhicule radio commandé. / The objective of the work of this thesis is the contribution in developing novel technical methods in the field of marker-lesssensing systems for use in three vital health areas by using new inexpensive sensors. Several scientific areas are involvedin achieving our objective such as; electronics and signal processing by using the Kinect sensor. Encouraging results wereachieved as presented throughout this thesis. In the first part of this work we present a new real-time marker-less visualsurveillance system for detecting and tracking seniors and monitoring their activities in the indoor environment by usingnetwork of Kinect sensors. The system also identifies the fall event with the elderly. In the second part, we present anew approach for a marker-less movement detection system for influential head movements in the brain Positron EmissionTomography imaging (CT/PET) by employing the Kinect sensor. This work addresses the compensation of the PET imagedegradation due to subject’s head movements. A developed particular phantom and volunteer studies were carried out.The experimental results show the effectiveness of this new system. The third part of the work presents the design andimplementation of a new smart system for controlling an electric wheelchair by special mark-less head movements. Anadaptable algorithm is designed to continuously detect the rotation degrees of the face pose using the Kinect sensor inreal-time that are interpreted as controlling signals through a hardware interface for the electric wheelchair actuators.

Modern vehicles are designed to protect occupants in the event of a crash with some vehicles better at this than others. However, passenger protection during an accident has shown to be not enough in many high impact crashes. Statistics have shown that the human error is the number one contributor to road accidents. This research study explores how driver error can be reduced through technology which observes driver behaviour and reacts when certain unwanted patterns in behaviour have been detected. Finally a system that detects driver fatigue and driver distraction has been developed using non-invasive machine vision concepts to monitor observable driver behaviour. / Electrical Engineering / M. Tech. (Electrical Engineering)

Diplomová práce je zaměřena na problematiku detekce a sledování polohy hlavy v obraze jako jednu s možností jak zlepšit možnosti interakce mezi počítačem a člověkem. Hlavním přínosem diplomové práce je využití inovativních hardwarových a softwarových technologií jakými jsou Microsoft Kinect, Point Cloud Library a CImg Library. Na úvod je představeno shrnutí předchozích prací na podobné téma. Následuje charakteristika a popis databáze, která byla vytvořena pro účely diplomové práce. Vyvinutý systém pro detekci a sledování polohy hlavy je založený na akvizici 3D obrazových dat a registračním algoritmu Iterative Closest Point. V závěru diplomové práce je nabídnuto hodnocení vzniklého systému a jsou navrženy možnosti jeho budoucího zlepšení.

The project is focused on face detection in video. Firstly, it contains a summary of basic color models. Secondly, you can find the description and comparison of the basic methods for detection of human skin with a practical example of implementation of parametric detector. Thirdly, a theoretical basis for face detection and face tracking in a video containing a list of basic concepts and methods of this issue follows. Greater emphasis is placed on the description of machine learning algorithm AdaBoost and description of the possible application of the Kalman filter for the purpose of face tracking. Design, implementation and testing of library accomplished within the master thesis are listed in the final part of this thesis.