Este projeto consiste em um sistema de navegação autônomo baseado em redes neurais nebulosas modulares capacitando o robô a alcançar alvos, ou pontos metas, em ambientes desconhecidos. Inicialmente, o sistema não tem habilidade para a navegação, após uma fase de experimentos com algumas colisões, o mecanismo de navegação aprimora-se guiando o robô ao alvo de forma eficiente. Uma arquitetura híbrida inteligente é apresentada para este sistema de navegação, baseada em redes neurais artificiais e lógica nebulosa. A arquitetura é hierárquica e costitiui-se de dois módulos responsáveis por gerar comportamentos inatos de desvio de obstáculos e de busca ao alvo. Um mecanismo de aprendizagem por reforço, baseada em uma extensão da lei de Hebb, pondera os comportamentos inatos conflitantes ajustando os pesos sinápticos das redes neurais nos instantes de captura do alvo e de colisão contra obstáculos. A abordagem consolidada em simulação é validada em ambientes reais neste trabalho. Para tanto, este sistema foi implementado e testado no simulador Saphira, ambiente de simulação que acompanha o robô Pioneer I e que denota um estágio anterior aos testes em ambientes reais por apresentar comportamentos do robô similares aos comportamentos do robô móvel. Modificações na arquitetura híbrida foram necessárias para adaptar o sistema de navegação simulado ao sistema incorporado no Pioneer I. Experimentos em ambientes reais demonstraram a eficiência e a capacidade de aprendizagem do sistema de navegação, validando a arquitetura híbrida inteligente para aplicação em robôs móveis / This project consists in a autonomous navigation system based on modular neuro-fuzzy networks that is able to guide the robot in unknown environments from a initial point to the goal. Initially, the system is not able to navigate, but after a trial and error period and some collisions, it improves in guiding the robot to the goal efficiently. A intelligent hybrid architecture is presented for this naviga tion system based on artificial neural networks and fuzzy logic. This architecture is hierarquical and consists in two modules that generate innate behaviors, like obstacles avoiding and target reaching. A reinforcement learning mecanism, based on the extended Hebb law, balances this conflicting innate behaviors adjusting the neural network synaptic weights as obstacle and collision avoidance and target reaching takes place. In this project, the approach is consolidated in simulation and validated in real environments. To this end, this system has been implemented by using Saphira simulator and Pioneer I simulation environment. This simulated evironment is a previous stage of tests performed real time and presents simulated robot behaviors similar to real mobile robot behaviors. The hybrid architecture was modified to adapt the simulated navigation system into Pioneer I software. Experiments in a real environments show the efficiency and learning capabilities of the navigation system, validating the intelligent hybrid architecture for mobile robots applications

<div><div><div><p>Globally, there are more than 727 million people aged 65 years and older in the world, and the elderly population is expected to grow more than double in the next three decades. Families search for affordable and quality care for their senior loved ones will have an effect on the care-giving profession. A personal robot assistant could help with daily tasks such as carrying things for them and keeping track of their routines, relieving the burdens of human caregivers. Performing mentioned tasks usually requires the robot to autonomously navi- gate. An autonomous navigation robot should collect the knowledge of its surroundings by mapping the environment, find its position in the map and calculate trajectories by avoiding obstacles. Furthermore, to assign specific tasks which are in various locations, robot has to categorize the rooms in addition to memorizing the respective coordinates. In this research, methods have been developed to achieve autonomous navigation and room categorization of a mobile robot within indoor environments. A Simultaneously Localization and Map- ping (SLAM) algorithm has been used to build the map and localize the robot. Gmapping, a method of SLAM, was applied by utilizing an odometry and a 2D Light Detection and Ranging (LiDAR) sensor. The trajectory to achieve the goal position by an optimal path is provided by path planning algorithms, which is divided into two parts namely, global and local planners. Global path planning has been produced by DIJKSTRA and local path planning by Dynamic Window Approach (DWA). While exploring new environments with Gmapping and trajectory planning algorithms, rooms in the generated map were classified by a powerful deep learning algorithm called Convolutional Neural Network (CNN). Once the environment is explored, the robots localization in the 2D space is done by Adaptive Monte Carlo Localization (AMCL). To utilize and test the methods above, Gazebo software by The Robotic Operating System (ROS) was used and simulations were performed prior to real life experiments. After the trouble-shooting and feedback acquired from simulations, the robot was able to perform above tasks and later tested in various indoor environments. The environment was mapped successfully by Gmapping and the robot was located within the map by AMCL. Compared to the theoretical maximum efficient path, the robot was able to plan the trajectory with acceptable deviation. In addition, the room names were classified with minimum of 85% accuracy by CNN algorithm. Autonomous navigation results show that the robot can assist elderly people in their home environment by successfully exploring, categorizing and navigating between the rooms.</p></div></div></div>

[pt] Neste trabalho, aborda-se a modelagem e controle de um quadricóptero para navegação autônoma em ambientes agrícolas. Os modelos cinemático e dinâmico do veículo aéreo são computados a partir do formalismo de Newton-Euler, incluindo efeitos aerodinâmicos e características das hélices. O sistema de movimento do quadricóptero pode ser dividido em dois subsistemas, um translacional e outro rotacional, responsáveis pelo controle de posição nos eixos x, y, z, and atitude do veículo no espaço Cartesiano. A primeira abordagem de controle é linear, se presenta dois controladores, um controlador proporcional-derivativo (PD) e o adaptativo baseado no espaço de estados. A segunda abordagem é não-linear e baseada em um controlador adaptativo a fim de lidar com a presença de incertezas nos parâmetros do sistema. Simulações numéricas são executadas em Matlab para ilustrar o desempenho e a viabilidade da metodologia de controle proposta. Simulações computacionais 3D são executadas em Gazebo para verificar a navegação autônoma em um campo agrícola. / [en] In this work, we address the modeling and control design of a quadrotor for autonomous navigation in agricultural environments. The kinematic and dynamic models of the aerial vehicle are derived following the Newton-Euler formalism. The motion system of the quadrotor can be split into two subsystems, that is, translational and rotational subsystems, responsible for controlling the position along the longitudinal, transverse and vertical axes of the Cartesian space as well as its orientation about the corresponding axes. The first linear control approach is based on the proportional-derivative (PD) controller, whereas the second nonlinear control approach is based on an adaptive controller in order to deal with the presence of uncertainties in the system parameters. Numerical simulations are carried out in Matlab to illustrate the performance and feasibility of the proposed control methodology. Gazebo was used to perform the 3D simulations for verifying autonomous navigation in agricultural fields.

Autonomous drone navigation in classical approaches typically involves constructing a map representation and employing path planning and collision checking algorithms within that map. Recently, novel deep learning techniques combined with depth camera observations have emerged as alternative approaches capable of achieving comparable collision-free performance. While these methods have demonstrated effective collision-free performance in dense environments, they rely on low-noise range or visual data, which may not be feasible in extreme degraded environments characterized by factors such as dust, smoke, weak geometries, or low-texture areas. A possible alternative is to leverage recent progress in mmWave radar imaging, which previously has produced data of insufficient resolution for such purposes. Through the use of a Variational Autoencoder and existing collision prediction algorithms, the goal of this study is to prove the use of mmWave radar for navigating difficult environments. The results of the study exhibit successful navigation in simulated scenarios featuring sparse obstacles. Additionally, results of utilizing real-world mmWave radar data in example scenarios is provided to demonstrate the potential for further application of this technology. / Autonom navigation för drönare i klassiska tillvägagångssätt innebär vanligtvis att man konstruerar en kartrepresentation och använder vägplanerings- och kollisionskontrollalgoritmer inom den kartan. Nyligen har nya djupinlärningstekniker kombinerat med djupkameraobservationer framträtt som alternativa tillvägagångssätt som kan uppnå jämförbar prestanda utan kollisioner. Även om dessa metoder har visat effektiv prestanda utan kollisioner i täta miljöer, är de beroende av störningsfria avstånds- eller visuella data, vilket kanske inte är genomförbart i extrema försämrade miljöer som karakteriseras av faktorer som damm, rök, svaga geometrier eller områden med låg textur. Ett möjligt alternativ är att dra nytta av de senaste framstegen inom mmWave-radaravbildning, vilket tidigare har producerat data med otillräcklig upplösning för sådana ändamål. Genom användning av en varieabel autoencoder och befintliga kollisionsprognosalgoritmer syftar denna studie till att bevisa användningen av mmWave-radar för att navigera i svåra miljöer. Resultaten från studien visar framgångsrik navigering i simulerade scenarier med glesa hinder. Dessutom presenteras resultat från användning av verkliga mmWave-radardata i exempelscenarier för att visa potentialen för ytterligare tillämpningar av denna teknik.

<p dir="ltr">The Global Navigation Satellite System (GNSS) is heavily relied on for the navigation of Earth satellites. For satellites in cislunar space and beyond, GNSS is not readily available. As a result, other sources such as NASA's Deep Space Network (DSN) must be relied on for navigation. However, DSN is overburdened and can only support a small number of satellites at a time. Furthermore, communication with external sources can become interrupted or deprived in these environments. Given NASA's current efforts towards cislunar space operations and the expected increase in cislunar satellite traffic, there will be a need for more autonomous navigation options in cislunar space and beyond.</p><p dir="ltr">In this thesis, a navigation system capable of accurate and computationally efficient orbit determination in these communication-deprived environments is proposed and investigated. The emphasis on computational efficiency is in support of cubesats which are constrained in size, cost, and mass; this makes navigation even more challenging when resources such as GNSS signals or ground station tracking become unavailable.</p><p dir="ltr">The proposed navigation system, which is called GRAVNAV in this thesis, involves a two-satellite formation orbiting a planet. The primary satellite hosts an Extended Kalman Filter (EKF) and is capable of measuring the relative position of the secondary satellite; accurate attitude estimates are also available to the primary satellite. The relative position measurements allow the EKF to estimate the absolute position and velocity of both satellites. In this thesis, the proposed navigation system is investigated in the two-body and three-body problems.</p><p dir="ltr">The two-body analysis illuminates the effect of the gravity model error on orbit determination performance. High-fidelity gravity models can be computationally expensive for cubesats; however, celestial bodies such as the Earth and Moon have non-uniform and highly-irregular gravity fields that require complex models to describe the motion of satellites orbiting in their gravity field. Initial results show that when a second-order zonal harmonic gravity model is used, the orbit determination accuracy is poor at low altitudes due to large gravity model errors while high-altitude orbits yield good accuracy due to small gravity model errors. To remedy the poor performance for low-altitude orbits, a Gravity Model Error Compensation (GMEC) technique is proposed and investigated. Along with a special tuning model developed specifically for GRAVNAV, this technique is demonstrated to work well for various geocentric and lunar orbits.</p><p><br></p><p dir="ltr">In addition to the gravity model error, other variables affecting the state estimation accuracy are also explored in the two-body analysis. These variables include the six Keplerian orbital elements, measurement accuracy, intersatellite range, and satellite formation shape. The GRAVNAV analysis shows that a smaller intersatellite range results in increased state estimation error. Despite the intersatellite range bounds, semimajor axis, measurement model, and measurement errors being identical for both orbits, the satellite formation shape also has a strong influence on orbit determination accuracy. Formations that place both satellites in different orbits significantly outperform those that place both satellites in the same orbit.</p><p dir="ltr">The three-body analysis primarily focuses on characterizing the unique behavior of GRAVNAV in Near Rectilinear Halo Orbits (NRHOs). Like the two-body analysis, the effect of the satellite formation shape is also characterized and shown to have a similar impact on the orbit determination performance. Unlike the two-body problem, however, different orbits possess different stability properties which are shown to significantly affect orbit determination performance. The more stable NRHOs yield better GRAVNAV performance and are also less sensitive to factors that negatively impact performance such as measurement error, process noise, and decreased intersatellite range.</p><p dir="ltr">Overall, the analyses in this thesis show that GRAVNAV yields accurate and computationally efficient orbit determination when GMEC is used. This, along with the independence of GRAVNAV from GNSS signals and ground-station tracking, shows that GRAVNAV has good potential for navigation in cislunar space and beyond.</p>

The Unmanned Aerial Vehicle (UAV) has over the last years become an increasingly prevalent technology in several sectors of modern society. Many UAVs are today used in a wide series of applications, from disaster relief to surveillance. A recent initiative by the Swedish Sea Rescue Society (SSRS) aims to implement UAVs in their emergency response. By quickly deploying drones to an area of interest, an assessment can be made, prior to personnel getting there, thus saving time and increasing the likelihood of a successful rescue operation. An aircraft like this, that will travel great distances, have to rely on a navigation system that does not require an operator to continuously see the vehicle. To travel to its goal, or search an area, the operator should be able to define a travel route that the UAV follows, by feeding it a series of waypoints. As an initial step towards that kind of system, this thesis has developed and tested the concept of waypoint navigation on a small and slow airship/blimp, in a simulated indoor environment. Mainly, two commonly used navigation algorithms were tested and compared. One is inspired by a sub-category of machine learning: reinforcement learning (RL), and the other one is based on the rapidly exploring random tree (RRT) algorithm. Four experiments were conducted to compare the two methods in terms of travel distance, average speed, energy efficiency, as well as robustness towards changes in the waypoint configurations. Results show that when the blimp was controlled by the best performing RL-based version, it generally travelled a more optimal (distance-wise) path than the RRT-based method. It also, in most cases, proved to be more robust against changes in the test tracks, and performed more consistently over different waypoint configurations. However, the RRT approach usually resulted in a higher average speed and energy efficiency. Also, the RL algorithm had some trouble navigating tracks where a physical obstacle was present. To sum up, the choice of algorithm depends on which parameters are prioritized by the blimp operator for a certain track. If a high velocity and energy efficiency is desirable, the RRT-based method is recommended. However, if it is important that the blimp travels as short a distance as possible between waypoints, and a higher degree of consistency in its performance is wanted, then the RL-method should be used. Moving forward from this report, toward the future implementation of both methods in rescue operations, it would be reasonable to analyze their performance under more realistic conditions. This can be done using a real indoor airship. Looking at how hardware that do not exceed the payload of the blimp can execute both methods and how the blimp will determine its position and orientation is recommended. It would also be interesting to see how different reward function affect the performance of the blimp. / Den obemannade luftfarkosten (UAV) har under de senaste åren blivit en teknik vars användning blivit allt vanligare i flera sektorer av det moderna samhället. Olika sorters UAV robotar associeras idag med en omfattande serie användningsområden, från katastrofhjälp till övervakning. Ett nyligen påbörjat initiativ från svenska sjöräddningssällskapet (SSRS) syftar till att implementera drönare i deras utryckningar. Genom att snabbt sända drönare till platsen i fråga, kan en bedömning göras innan personal kommer dit, vilket sparar tid och ökar sannolikheten för en framgångsrik räddningsaktion. En farkost som denna, som kommer att resa långa sträckor, måste förlita sig på ett navigationssystem som inte kräver att en operatör kontinuerligt ser farkosten. För att resa till sitt mål, eller söka av ett område, bör operatören kunna definiera en resväg som drönaren följer genom att ge den en serie vägpunkter. Som ett inledande steg mot den typen av system har denna uppsats utvecklat och testat begreppet vägpunktsnavigering på ett litet och långsamt luftskepp/blimp, i en simulerad inomhusmiljö. Huvudsakligen testades och jämfördes två vanligt förekommande navigationsalgoritmer. En inspirerad av en underkategori till maskininlärning: förstärkningsinlärning (RL), och den andra baserad på rapidly exploring random tree (RRT) algoritmen. Fyra experiment utfördes för jämföra båda metoderna med avseende på färdsträcka, medelhastighet, energieffektivitet samt robusthet gentemot ändringar i färdpunktskonfigurationerna. Resultaten visar att när blimpen kontrollerades av den bästa RL-baserade versionen åkte den generellt en mer avståndsmässigt optimal väg än när den RRT-baserade metoden användes. I de flesta fallen visade sig även RL-metoden vara mer robust mot förändringar i testbanorna, och presterade mer konsekvent över olika vägpunktskonfigurationer. RRT-metoden resulterade dock vanligtvis i en högre medelhastighet och energieffektivitet. RL-algoritmen hade också problem med att navigera banor där den behövde ta sig runt ett hinder. Sammanfattningsvis beror valet av algoritm på vilka parametrar som prioriteras av blimpoperatören för en viss bana. Om en hög hastighet och energieffektivitet är önskvärd rekommenderas den RRT-baserade metoden. Men om det är viktigt att blimpen reser så kort avstånd som möjligt mellan färdpunkterna, och har en jämnare prestanda, bör RL-metoden användas. För att ta nästa steg, mot en framtida implementering av båda metoder i räddningsoperationer, vore det rimligt att analysera deras prestanda under mer realistiska förhållanden. Detta skulle kunna göras inomhus med ett riktigt luftskepp. Författarna rekommenderar att undersöka om hårdvara som inte överstiger blimpens maxlast kan utföra båda metodernas beräkningar och hur blimpen bestämmer sin position och orientering. Det skulle också vara intressant att se hur olika belöningsfunktioner påverkar blimpens prestanda.

Approved for public release, distribution is unlimited / This thesis is part of an ongoing research conducted at the Naval Postgraduate School to achieve the autonomous shipboard landing of Unmanned Aerial Vehicles (UAV). Two main problems are addressed in this thesis. The first is to establish communication between the UAV's ground station and the Autonomous Landing Flight Control Computer effectively. The second addresses the design and implementation of an autonomous landing controller using classical control techniques. Device drivers for the sensors and the communications protocol were developed in ANSI C. The overall system was implemented in a PC104 computer running a real-time operating system developed by The Mathworks, Inc. Computer and hardware in the loop (HIL) simulation, as well as ground test results show the feasibility of the algorithm proposed here. Flight tests are scheduled to be performed in the near future. / Lieutenant Junior Grade, Mexican Navy

Alors que l’utilisation d’un fauteuil roulant permet aux personnes en situation de handicap de compenser une perte de la mobilité, certaines personnes se voient privées de l’utilisation d’un fauteuil roulant électrique. En effet, la présence de troubles cognitifs ou de la perception visuelle altère la capacité à conduire sans danger. Dans ce contexte, l’accès à la mobilité peut être amélioré par l’apport d’aides techniques adaptées permettant de compenser la perte de mobilité dans tous types d’environnements. Alors que les premiers travaux sur les fauteuils roulants intelligents datent du début des années 80, aucune solution n’est à ce jour sur le marché ou dans les centres de rééducation. Ce travail vise à proposer un ensemble de solutions d’aide à la conduite de fauteuil roulant électrique conçu en collaboration. Le développement de telles aides techniques constitue de multiples défis robotiques mêlant techniques de détection innovantes et méthodes de contrôle partagé avec l’utilisateur. Dans ce travail, un simulateur de conduite visant à appuyer la recherche et le développement de nouvelles solutions robotiques est proposé. Puis des solutions bas coût d’assistance semiautonome à la conduite en intérieur et en extérieur sont détaillées. L’évaluation avec des participants sains nous permet de valider les méthodes mathématiques mises en oeuvre et de fournir des preuves de concept des solutions proposées. Enfin, les premières évaluations cliniques avec des usagers au Pôle MPR Saint Hélier montrent la validation de de la méthode proposée en termes de satisfaction des utilisateurs. / While the use of a wheelchair allows people with disabilities to compensate for a loss of mobility, people with severe disabilities are denied the use of a power wheelchair. Indeed, cognitive or visual perception impairments can affect the ability to drive safely. In this context, access to mobility can be improved by providing appropriate assistive technologies to compensate for loss of mobility in all types of environments. While the first research on smart wheelchairs dates back to the early 1980s, no solutions have yet been proposed on the market or in rehabilitation centers and other specialized structures. This work aims to propose a set of solutions for power wheelchair navigation assistance designed in close collaboration with users and therapists. The development of such assistive solutions faces multiple robotic challenges combining innovative detection techniques, shared control with the user. In this work, a driving simulator supporting research and development of new robotic solutions for wheelchair navigation assistance is proposed. Then low-cost semi-autonomous assistance solutions for navigation assistance in indoor and outdoor environments are detailed. The evaluation with able-bodied participants allows to validate the mathematical methods and provide proof of concept of the proposed solutions. Finally, the first clinical evaluations with regular users at Pôle MPR Saint Hélier show the validation of the proposed framework in terms of user satisfaction.

In this research work, we develop an obstacle detection and emergency exit sign recognition system on a mobile phone by extending the feature from accelerated segment test detector with Harris corner filter. The first step often required for many vision based applications is the detection of objects of interest in an image. Hence, in this research work, we introduce emergency exit sign detection method using colour histogram. The hue and saturation component of an HSV colour model are processed into features to build a 2D colour histogram. We backproject a 2D colour histogram to detect emergency exit sign from a captured image as the first task required before performing emergency exit sign recognition. The result of classification shows that the 2D histogram is fast and can discriminate between objects and background with accuracy. One of the challenges confronting object recognition methods is the type of image feature to compute. In this work therefore, we present two feature detectors and descriptor methods based on the feature from accelerated segment test detector with Harris corner filter. The first method is called Upright FAST-Harris and binary detector (U-FaHB), while the second method Scale Interpolated FAST-Harris and Binary (SIFaHB). In both methods, feature points are extracted using the accelerated segment test detectors and Harris filter to return the strongest corner points as features. However, in the case of SIFaHB, the extraction of feature points is done across the image plane and along the scale-space. The modular design of these detectors allows for the integration of descriptors of any kind. Therefore, we combine these detectors with binary test descriptor like BRIEF to compute feature regions. These detectors and the combined descriptor are evaluated using different images observed under various geometric and photometric transformations and the performance is compared with other detectors and descriptors. The results obtained show that our proposed feature detector and descriptor method is fast and performs better compared with other methods like SIFT, SURF, ORB, BRISK, CenSurE. Based on the potential of U-FaHB detector and descriptor, we extended it for use in optical flow computation, which we termed the Nearest-flow method. This method has the potential of computing flow vectors for use in obstacle detection. Just like any other new methods, we evaluated the Nearest flow method using real and synthetic image sequences. We compare the performance of the Nearest-flow with other methods like the Lucas and Kanade, Farneback and SIFT-flow. The results obtained show that our Nearest-flow method is faster to compute and performs better on real scene images compared with the other methods. In the final part of this research, we demonstrate the application potential of our proposed methods by developing an obstacle detection and exit sign recognition system on a camera phone and the result obtained shows that the methods have the potential to solve this vision based object detection and recognition problem.

Ce mémoire décrit mes travaux de thèse de doctorat menés au sein de l’équipe ComSee (Computers that See) rattachée à l’axe ISPR (Image, Systèmes de Perception et Robotique) de l’Institut Pascal. Celle-ci a été financée par la Région Auvergne et le Fonds Européen de Développement Régional. Les travaux présentés s’inscrivent dans le cadre d’applications de localisation pour la robotique mobile et la Réalité Augmentée. Le framework réalisé au cours de cette thèse est une approche générique pour l’implémentation d’applications de SLAM : Simultaneous Localization And Mapping (algorithme de localisation par rapport à un modèle simultanément reconstruit). L’approche intègre une multitude de contraintes dans les processus de localisation et de reconstruction. Ces contraintes proviennent de données capteurs mais également d’a priori liés au contexte applicatif. Chaque contrainte est utilisée au sein d’un même algorithme d’optimisation afin d’améliorer l’estimation du mouvement ainsi que la précision du modèle reconstruit. Trois problèmes ont été abordés au cours de ce travail. Le premier concerne l’utilisation de contraintes sur le modèle reconstruit pour l’estimation précise d’objets 3D partiellement connus et présents dans l’environnement. La seconde problématique traite de la fusion de données multi-capteurs, donc hétérogènes et asynchrones, en utilisant un unique algorithme d’optimisation. La dernière problématique concerne la génération automatique et efficace d’algorithmes d’optimisation à contraintes multiples. L’objectif est de proposer une solution temps réel 1 aux problèmes de SLAM à contraintes multiples. Une approche générique est utilisée pour concevoir le framework afin de gérer une multitude de configurations liées aux différentes contraintes des problèmes de SLAM. Un intérêt tout particulier a été porté à la faible consommation de ressources (mémoire et CPU) tout en conservant une grande portabilité. De plus, la méta-programmation est utilisée pour générer automatiquement et spécifiquement les parties les plus complexes du code en fonction du problème à résoudre. La bibliothèque d’optimisation LMA qui a été développée au cours de cette thèse est mise à disposition de la communauté en open-source. Des expérimentations sont présentées à la fois sur des données de synthèse et des données réelles. Un comparatif exhaustif met en évidence les performances de la bibliothèque LMA face aux alternatives les plus utilisées de l’état de l’art. De plus, le framework de SLAM est utilisé sur des problèmes impliquant une difficulté et une quantité de contraintes croissantes. Les applications de robotique mobile et de Réalité Augmentée mettent en évidence des performances temps réel et un niveau de précision qui croît avec le nombre de contraintes utilisées. / This report describes my thesis work conducted within the ComSee (Computers That See) team related to the ISPR axis (ImageS, Perception Systems and Robotics) of Institut Pascal. It was financed by the Auvergne Région and the European Fund of Regional Development. The thesis was motivated by localization issues related to Augmented Reality and autonomous navigation. The framework developed during this thesis is a generic approach to implement SLAM algorithms : Simultaneous Localization And Mapping. The proposed approach use multiple constraints in the localization and mapping processes. Those constraints come from sensors data and also from knowledge given by the application context. Each constraint is used into one optimization algorithm in order to improve the estimation of the motion and the accuracy of the map. Three problems have been tackled. The first deals with constraints on the map to accurately estimate the pose of 3D objects partially known in the environment. The second problem is about merging multiple heterogeneous and asynchronous data coming from different sensors using an optimization algorithm. The last problem is to write an efficient and real-time implementation of the SLAM problem using multiple constraints. A generic approach is used to design the framework and to generate different configurations, according to the constraints, of each SLAM problem. A particular interest has been put in the low computational requirement (in term of memory and CPU) while offering a high portability. Moreover, meta-programming techniques have been used to automatically and specifically generate the more complex parts of the code according to the given problem. The optimization library LMA, developed during this thesis, is made available of the community in open-source. Several experiments were done on synthesis and real data. An exhaustive benchmark shows the performances of the LMA library compared to the most used alternatives of the state of the art. Moreover, the SLAM framework is used on different problems with an increasing difficulty and amount of constraints. Augmented Reality and autonomous navigation applications show the good performances and accuracies in multiple constraints context.