No description available.

This thesis presents a framework for a hybrid model-free marker-less inertial-visual camera pose tracking with an integrated sensor fusion mechanism. The proposed solution addresses the fundamental problem of pose recovery in computer vision and robotics and provides an improved solution for wide-area pose tracking that can be used on mobile platforms and in real-time applications. In order to arrive at a suitable pose tracking algorithm, an in-depth investigation was conducted into current methods and sensors used for pose tracking. Preliminary experiments were then carried out on hybrid GPS-Visual as well as wireless micro-location tracking in order to evaluate their suitability for camera tracking in wide-area or GPS-denied environments. As a result of this investigation a combination of an inertial measurement unit and a camera was chosen as the primary sensory inputs for a hybrid camera tracking system. After following a thorough modelling and mathematical formulation process, a novel and improved hybrid tracking framework was designed, developed and evaluated. The resulting system incorporates an inertial system, a vision-based system and a recursive particle filtering-based stochastic data fusion and state estimation algorithm. The core of the algorithm is a state-space model for motion kinematics which, combined with the principles of multi-view camera geometry and the properties of optical flow and focus of expansion, form the main components of the proposed framework. The proposed solution incorporates a monitoring system, which decides on the best method of tracking at any given time based on the reliability of the fresh vision data provided by the vision-based system, and automatically switches between visual and inertial tracking as and when necessary. The system also includes a novel and effective self-adjusting mechanism, which detects when the newly captured sensory data can be reliably used to correct the past pose estimates. The corrected state is then propagated through to the current time in order to prevent sudden pose estimation errors manifesting as a permanent drift in the tracking output. Following the design stage, the complete system was fully developed and then evaluated using both synthetic and real data. The outcome shows an improved performance compared to existing techniques, such as PTAM and SLAM. The low computational cost of the algorithm enables its application on mobile devices, while the integrated self-monitoring, self-adjusting mechanisms allow for its potential use in wide-area tracking applications.

L'oculométrie est un ensemble de techniques dédié à enregistrer et analyser les mouvements oculaires. Dans cette thèse, je présente l'étude, la conception et la mise en œuvre d'un système oculométrique numérique, non-intrusif permettant d'analyser les mouvements oculaires en temps réel avec une webcam à distance et sans lumière infra-rouge. Dans le cadre de la réalisation, le système oculométrique proposé se compose de quatre modules: l'extraction des caractéristiques, la détection et le suivi des yeux, l'analyse de la variété des mouvements des yeux à partir des images et l'estimation du regard par l'apprentissage. Nos contributions reposent sur le développement des méthodes autour de ces quatre modules: la première réalise une méthode hybride pour détecter et suivre les yeux en temps réel à partir des techniques du filtre particulaire, du modèle à formes actives et des cartes des yeux (EyeMap); la seconde réalise l'extraction des caractéristiques à partir de l'image des yeux en utilisant les techniques des motifs binaires locaux; la troisième méthode classifie les mouvements oculaires selon la variété générée par le Laplacian Eigenmaps et forme un ensemble de données d'apprentissage; enfin, la quatrième méthode calcul la position du regard à partir de cet ensemble d'apprentissage. Nous proposons également deux méthodes d'estimation:une méthode de la régression par le processus gaussien et un apprentissage semi-supervisé et une méthode de la catégorisation par la classification spectrale (spectral clustering). Il en résulte un système complet, générique et économique pour les applications diverses dans le domaine de l'oculométrie. / Gaze tracker offers a powerful tool for diverse study fields, in particular eye movement analysis. In this thesis, we present a new appearance-based real-time gaze tracking system with only a remote webcam and without infra-red illumination. Our proposed gaze tracking model has four components: eye localization, eye feature extraction, eye manifold learning and gaze estimation. Our research focuses on the development of methods on each component of the system. Firstly, we propose a hybrid method to localize in real time the eye region in the frames captured by the webcam. The eye can be detected by Active Shape Model and EyeMap in the first frame where eye occurs. Then the eye can be tracked through a stochastic method, particle filter. Secondly, we employ the Center-Symmetric Local Binary Patterns for the detected eye region, which has been divided into blocs, in order to get the eye features. Thirdly, we introduce manifold learning technique, such as Laplacian Eigen-maps, to learn different eye movements by a set of eye images collected. This unsupervised learning helps to construct an automatic and correct calibration phase. In the end, as for the gaze estimation, we propose two models: a semi-supervised Gaussian Process Regression prediction model to estimate the coordinates of eye direction; and a prediction model by spectral clustering to classify different eye movements. Our system with 5-points calibration can not only reduce the run-time cost, but also estimate the gaze accurately. Our experimental results show that our gaze tracking model has less constraints from the hardware settings and it can be applied efficiently in different real-time applications.

La navigation inertielle grâce aux capteurs intégrés dans les smartphones permet d’assurer une géolocalisation continue même en absence de signal GNSS. Ces capteurs bas coût délivrent néanmoins des mesures bruitées qui engendrent une dérive de la trajectoire. La technique PDR qui est une technique de navigation inertielle par détection de pas souffre de deux limites principales. La première est l’estimation de la longueur de pas car cette dernière dépend des caractéristiques physiques de chaque utilisateur, et la seconde est le résultat d’une dérive angulaire combinée avec un biais lié au portage du capteur à la main. Dans le contexte du projet HAPPYHAND, ce travail s’intéresse à l’exploitation de la carte pour corriger ces différentes erreurs. Un réseau de navigation topologique est exploité pour corriger à la fois les erreurs angulaires et calibrer le modèle de longueur de pas. Ce modèle est ensuite augmenté par un processus de mise à jour de position par détection de points d’intérêt. / Smartphone navigation using the low-cost embedded sensors in off the shelf smartphones can provide a continuous solution in GNSS-denied environments. The most widely adopted approach is Pedestrian Dead Reckoning (PDR) that uses acceleration and angular velocity to estimate the user’s position. Yet, consumer grade sensors deliver noisy measurements that may result into a drift in the estimated trajectory. One major challenge is to estimate accurately step length information since it depends on physiological features that are specific to each user. In addition, angular biases are more likely to be introduced in the orientation estimation process with handheld devices. This is mainly due to the high degree of freedom of hand motion. In the context of a national project called HAPPYHAND, the main goal of this work is to exploit map information as far as possible in order to mitigate the previous inherent limitations to the PDR approach. First, a topological network extracted from the map is proposed in order to correct the angular errors and calibrate the step length model. Second, context awareness is adopted in order to provide regular and frequent position updates thanks to a point of interest online detection scheme.

Electrical contacts provide a well-proven solution to switching various loads in a wide variety of applications, such as power distribution, control applications, automotive and telecommunications. However, electrical contacts are known for limited reliability due to degradation effects upon the switching contacts due to arcing and fretting. Essentially, the life of the device may be determined by the limited life of the contacts. Failure to trip, spurious tripping and contact welding can, in critical applications such as control systems for avionics and nuclear power application, cause significant costs due to downtime, as well as safety implications. Prognostics provides a way to assess the remaining useful life (RUL) of a component based on its current state of health and its anticipated future usage and operating conditions. In this thesis, the effects of contact wear on a set of electromagnetic relays used in an avionic power controller is examined, and how contact resistance combined with a prognostic approach, can be used to ascertain the RUL of the device. Two methodologies are presented, firstly a Physics based Model (PbM) of the degradation using the predicted material loss due to arc damage. Secondly a computationally efficient technique using posterior degradation data to form a state space model in real time via a Sliding Window Recursive Least Squares (SWRLS) algorithm. Health monitoring using the presented techniques can provide knowledge of impending failure in high reliability applications where the risks associated with loss-of-functionality are too high to endure. The future states of the systems has been estimated based on a Particle and Kalman-filter projection of the models via a Bayesian framework. Performance of the prognostication health management algorithm during the contacts life has been quantified using performance evaluation metrics. Model predictions have been correlated with experimental data. Prognostic metrics including Prognostic Horizon (PH), alpha-Lamda (α-λ), and Relative Accuracy have been used to assess the performance of the damage proxies and a comparison of the two models made.

<p>The aim of the Master’s Thesis work is to study and develop algorithms for autonomous travel of a UGV (Unmanned Ground Vehicle). A vehicle for the mounting of sensors has been constructed in order to perform the work. Since the UGV is to be used outdoor in urban areas, GPS can be used. To improve precision and robustness, inertial navigation is used in addition to GPS, since GPS reception is likely to be diminished in such areas. The sensors used for navigation are consequently GPS, magnetometers, accelerometers, gyroscopes, tachometers and ultra sonic sensors measuring distance to be used in detection of obstacles. The system has been implemented in Matlab. Two alternative methods of navigation with sensor fusion have been developed; one is a decentralized method with Kalman filtering using an error model and the other is a centralized particle filter using an all-embracing model of the vehicle. The two methods have been evaluated and compared. Test results show that the two methods perform equivalently.</p><p>The autonomous travel is undertaken between predetermined waypoints. In order to steer the vehicle a PID-controller based on the error between heading and its reference value is used. The computation of the reference value is based on position and heading in comparison to the desired path. The system has been tested using different routes and the results show an evident improvement of the precision in navigation compared to using only GPS-data. This holds for both navigation methods. Simulation of collision avoidance using virtual force fields shows satisfying results as well as terrain navigation with coordinate map referencing.</p> / <p>Examensarbetet är en studie i utveckling av algoritmer för autonom förflyttning av en UGV (eng Unmanned Ground Vehicle). För ändamålet har en farkost konstruerats där budgetsensorer för navigering används. Farkosten är tänkt att färdas utomhus i tätbebyggt område och GPS används. För förbättring av noggrannhet och robusthet vid dålig GPS-mottagning används även sensorer för tröghetsnavigering vilket här innebär magnetometrar, accelerometrar, gyron och tachometrar. För hinderdetektering finns avståndsmätande ultraljudssonar. Systemet som tagits fram har implementerats i realtid i Matlab. Två olika navigeringsmetoder med sensorfusion har utprovats; en decentraliserad variant med kalmanfilter som är uppbyggd kring felmodeller och en centraliserad variant med ett partikelfilter som använder en helhetsmodell för farkosten. De båda navigeringsmetoderna har utvärderats och jämförts. Resultat visar att de båda metoderna presterar likvärdigt.</p><p>Den autonoma förflyttningen utförs mellan förutbestämda brytpunkter. För att styra farkosten har en PID-regulator baserad på felet mellan kurs och börvärde använts. Börvärdet på kurs baseras på nuvarande position och riktning relativt den önskade färdvägen. Olika körsituationer har testats och resultaten visar en markant förbättring av navigeringsprecisionen jämfört med endast GPS-mätningar för både kalman- och partikelfilter. Simuleringar på vektorfältsstyrning med virtuella kraftfält för att undvika hinder har utförts med goda resultat liksom simuleringar av kartreferenspositionering.</p>

A solution to the vehicle state estimation problem is given using the Kalman filtering and the Particle filtering theories. Vehicle states are necessary for an active or a semi-active suspension control system, which is intended to enhance ride comfort, road handling and stability of the vehicle. Due to a lack of information on road disturbances, conventional estimation techniques fail to provide accurate estimates of all the required states. The proposed estimation algorithm, named Supervisory Kalman Filter (SKF), consists of a Kalman filter with an extra update step which is inspired by the particle filtering technique. The extra step, called a supervisory layer, operates on the portion of the state vector that cannot be estimated by the Kalman filter. First, it produces N randomly generated state vectors, the particles, which are distributed based on the Kalman filter’s last updated estimate. Then, a resampling stage is implemented to collect the particles with higher probability. The effectiveness of the SKF is demonstrated by comparing its estimation results with that of the Kalman filter and the particle filter when a test vehicle is passing over a bump. The estimation results confirm that the SKF precisely estimates those states of the vehicle that cannot be estimated by either the Kalman filter or the particle filter, without any direct measurement of the road disturbance inputs. Once the vehicle states are provided, a suspension control law, the Skyhook strategy, processes the current states and adjusts the damping forces accordingly to provide a better and safer ride for the vehicle passengers. This thesis presents a novel systematic and practical methodology for the design and implementation of the Skyhook control strategy for vehicle’s semi-active suspension systems. Typically, the semi-active control strategies (including the Skyhook strategy) have switching natures. This makes the design process difficult and highly dependent on extensive trial and error. The proposed methodology maps the discontinuous control system model to a continuous linear region, where all the time/frequency design techniques, established in the conventional control system theory, can be applied. If the semiactive control law is designed to satisfy ride and stability requirements, an inverse mapping offers the ultimate control law. The effectiveness of the proposed methodology in the design of a semi-active suspension control system for a Cadillac SRX 2005 is demonstrated by real-time road tests. The road tests results verify that the use of the newly developed systematic design methodology reduces the required time and effort in real industrial problems.

The aim of this master thesis was to develop a versatile and reliable experimentalplatform of mobile robots, solving tracking problems, for education and research.Evaluation of parallel bearings-only tracking and control algorithms on a multi-corearchitecture has been performed. The platform was implemented as a mobile wirelesssensor network using multiple mobile robots, each using a mounted camera for dataacquisition. Data processing was performed on the mobile robots and on a server,which also played the role of network communication hub. A major focus was toimplement this platform in a flexible manner to allow for education and futureresearch in the fields of signal processing, wireless sensor networks and automaticcontrol. The implemented platform was intended to act as a bridge between the idealworld of simulation and the non-ideal real world of full scale prototypes.The implemented algorithms did estimation of the positions of the robots, estimationof a non-cooperating target's position and regulating the positions of the robots. Thetracking algorithms implemented were the Gaussian particle filter, the globallydistributed particle filter and the locally distributed particle filter. The regulator triedto move the robots to give the highest possible sensor information under givenconstraints. The regulators implemented used model predictive control algorithms.Code for communicating with filters in external processes were implementedtogether with tools for data extraction and statistical analysis.Both implementation details and evaluation of different tracking algorithms arepresented. Some algorithms have been tested as examples of the platformscapabilities, among them scalability and accuracy of some particle filtering techniques.The filters performed with sufficient accuracy and showed a close to linear speedupusing up to 12 processor cores. Performance of parallel particle filtering withconstraints on network bandwidth was also studied, measuring breakpoints on filtercommunication to avoid weight starvation. Quality of the sensor readings, networklatency and hardware performance are discussed. Experiments showed that theplatform was a viable alternative for data acquisition in algorithm development and forbenchmarking to multi-core architecture. The platform was shown to be flexibleenough to be used a framework for future algorithm development and education inautomatic control.

The aim of the Master’s Thesis work is to study and develop algorithms for autonomous travel of a UGV (Unmanned Ground Vehicle). A vehicle for the mounting of sensors has been constructed in order to perform the work. Since the UGV is to be used outdoor in urban areas, GPS can be used. To improve precision and robustness, inertial navigation is used in addition to GPS, since GPS reception is likely to be diminished in such areas. The sensors used for navigation are consequently GPS, magnetometers, accelerometers, gyroscopes, tachometers and ultra sonic sensors measuring distance to be used in detection of obstacles. The system has been implemented in Matlab. Two alternative methods of navigation with sensor fusion have been developed; one is a decentralized method with Kalman filtering using an error model and the other is a centralized particle filter using an all-embracing model of the vehicle. The two methods have been evaluated and compared. Test results show that the two methods perform equivalently. The autonomous travel is undertaken between predetermined waypoints. In order to steer the vehicle a PID-controller based on the error between heading and its reference value is used. The computation of the reference value is based on position and heading in comparison to the desired path. The system has been tested using different routes and the results show an evident improvement of the precision in navigation compared to using only GPS-data. This holds for both navigation methods. Simulation of collision avoidance using virtual force fields shows satisfying results as well as terrain navigation with coordinate map referencing. / Examensarbetet är en studie i utveckling av algoritmer för autonom förflyttning av en UGV (eng Unmanned Ground Vehicle). För ändamålet har en farkost konstruerats där budgetsensorer för navigering används. Farkosten är tänkt att färdas utomhus i tätbebyggt område och GPS används. För förbättring av noggrannhet och robusthet vid dålig GPS-mottagning används även sensorer för tröghetsnavigering vilket här innebär magnetometrar, accelerometrar, gyron och tachometrar. För hinderdetektering finns avståndsmätande ultraljudssonar. Systemet som tagits fram har implementerats i realtid i Matlab. Två olika navigeringsmetoder med sensorfusion har utprovats; en decentraliserad variant med kalmanfilter som är uppbyggd kring felmodeller och en centraliserad variant med ett partikelfilter som använder en helhetsmodell för farkosten. De båda navigeringsmetoderna har utvärderats och jämförts. Resultat visar att de båda metoderna presterar likvärdigt. Den autonoma förflyttningen utförs mellan förutbestämda brytpunkter. För att styra farkosten har en PID-regulator baserad på felet mellan kurs och börvärde använts. Börvärdet på kurs baseras på nuvarande position och riktning relativt den önskade färdvägen. Olika körsituationer har testats och resultaten visar en markant förbättring av navigeringsprecisionen jämfört med endast GPS-mätningar för både kalman- och partikelfilter. Simuleringar på vektorfältsstyrning med virtuella kraftfält för att undvika hinder har utförts med goda resultat liksom simuleringar av kartreferenspositionering.

A solution to the vehicle state estimation problem is given using the Kalman filtering and the Particle filtering theories. Vehicle states are necessary for an active or a semi-active suspension control system, which is intended to enhance ride comfort, road handling and stability of the vehicle. Due to a lack of information on road disturbances, conventional estimation techniques fail to provide accurate estimates of all the required states. The proposed estimation algorithm, named Supervisory Kalman Filter (SKF), consists of a Kalman filter with an extra update step which is inspired by the particle filtering technique. The extra step, called a supervisory layer, operates on the portion of the state vector that cannot be estimated by the Kalman filter. First, it produces N randomly generated state vectors, the particles, which are distributed based on the Kalman filter’s last updated estimate. Then, a resampling stage is implemented to collect the particles with higher probability. The effectiveness of the SKF is demonstrated by comparing its estimation results with that of the Kalman filter and the particle filter when a test vehicle is passing over a bump. The estimation results confirm that the SKF precisely estimates those states of the vehicle that cannot be estimated by either the Kalman filter or the particle filter, without any direct measurement of the road disturbance inputs. Once the vehicle states are provided, a suspension control law, the Skyhook strategy, processes the current states and adjusts the damping forces accordingly to provide a better and safer ride for the vehicle passengers. This thesis presents a novel systematic and practical methodology for the design and implementation of the Skyhook control strategy for vehicle’s semi-active suspension systems. Typically, the semi-active control strategies (including the Skyhook strategy) have switching natures. This makes the design process difficult and highly dependent on extensive trial and error. The proposed methodology maps the discontinuous control system model to a continuous linear region, where all the time/frequency design techniques, established in the conventional control system theory, can be applied. If the semiactive control law is designed to satisfy ride and stability requirements, an inverse mapping offers the ultimate control law. The effectiveness of the proposed methodology in the design of a semi-active suspension control system for a Cadillac SRX 2005 is demonstrated by real-time road tests. The road tests results verify that the use of the newly developed systematic design methodology reduces the required time and effort in real industrial problems.