Vision-based conventional landing of a fixed wing UAV is addressed in this thesis. The work includes mathematical modeling, interface to a software for rendering the outside scenery, image processing techniques, control law development and outdoor experimentation. This research focuses on detecting the lines or the edges that flank the landing site, use them as visual cues to extract the geometrical parameters such as the line co-ordinates and the line slopes, that are mapped to the control law, to align and conventionally land the fixed wing UAV. Pre-processing and image processing techniques such as Canny Edge detection and Hough Transforms have been used to detect the runway lines or the edges of a landing strip. A Vision-in-the-Loop Simulation (VILS) set up on a personal computer or laptop, has been developed, without any external camera/equipment or networking cables that enables visual serving toper form vision-based studies and simulation. UAV mass, inertia, engine and aero data from literature has been used along withUAV6DOF equations to represent the UAV mathematical model. The UAV model is interfaced to a software using UDP data packets via ports, for rendering the outside scenery in accordance with the UAV’s translation and orientation. The snapshots of the outside scenery, that is passed through an internet URL by including the ‘http’ protocol, is image processed to detect the lines and the line parameters for the control. VILS set has been used to simulate UAV alignment to the runway and landing. Vision-based alignment is achieved by rolling the UAV such that the landing strip that is off center is brought to the center of the image plane. A two stage proportional aileron control input using the line co-ordinates, bringing the midpoints of the top ends of the runway lines to the center of the image, followed by bringing the mid points of the bottom ends of the runway lines to the center of the image has been demonstrated through simulation. A vision-based control for landing has been developed, that consists of an elevator command that is commiserate with the acceptable range of glide slope followed by a flare command till touch down, which is a function of the flare height and estimated height from the 3rd order polynomial of the runway slope obtained by characterization. The feasibility of using the algorithms for a semi-prepared or unprepared landing strip with no visible runway lines have also been demonstrated. Landing on an empty tract of land and in poor visibility condition, by synthetically drawing the runway lines based on a single 3rd order slope. vs height polynomial solution are also presented. A fixed area, and a dynamic area search for the Hough peaks in the Hough accumulator array for the correct detection of lines are addressed. A novel technique for crosswind landing, quite different from conventional techniques, has been introduced, using only the aileron control input for correcting the drift. Three different strategies using the line co-ordinates and the line slopes, with varying levels of accuracy have been presented and compared. About 125 landing data of a manned instrumented prototype aircraft have been analysed to corroborate the findings of this research. Outdoor experiments are also conducted to verify the feasibility of using the line detection algorithm in a realistic scenario and to generate experimental evidence for the findings of this research. Computation time estimates are presented to establish the feasibility of using vision for the problem of conventional landing. The thesis concludes with the findings and direction for future work.

Dans cette thèse, nous nous intéressons au problème de l’atterrissage lunaire autonome et nous proposons une méthode innovante amenant une alternative à l’utilisation de capteurs classiques qui peuvent se révéler encombrants, énergivores et très onéreux.La première partie est consacrée au développement et à la construction de capteurs de mouvement inspirés de la vision des insectes volants et mesurant le flux optique.Le flux optique correspond à la vitesse angulaire relative de l’environnement mesurée par la rétine d’un agent. Dans un environnement fixe, les mouvements d’un robot génèrent un flux optique contenant des informations essentielles sur le mouvement de ce dernier. En utilisant le principe du « temps de passage », nous présentons les résultats expérimentaux obtenus en extérieur avec deux versions de ces capteurs.Premièrement, un capteur mesurant le flux optique dans les deux directions opposées est développé et testé en laboratoire. Deuxièmement un capteur adapté à la mesure des faibles flux optiques similaires à ceux pouvant être mesurés lors d’un alunissage est développé, caractérisé et enfin testé sur un drone hélicoptère en conditions extérieures.Dans la seconde partie, une méthode permettant de réaliser le guidage, la navigation et la commande (GNC pour Guidance Navigation and Control) du système est proposée. L’innovation réside dans le fait que l’atterrissage en douceur est uniquement assuré par les capteurs de flux optique. L’utilisation des capteurs inertiels est réduite au maximum. Plusieurs capteurs orientés dans différentes directions de visée, et fixés à la structure de l’atterrisseur permettent d’atteindre les conditions finales définies par les partenaires industriels. Les nombreuses informations décrivant la position et l’attitude du système contenues dans le flux optique sont exploitées grâce aux algorithmes de navigation qui permettent d’estimer les flux optiques ventraux et d’expansion ainsi que le tangage.Nous avons également montré qu’il est possible de contrôler l’atterrisseur planétaire en faisant suivre aux flux optiques estimés une consigne optimale au sens de la consommation d’énergie. Les simulations réalisées durant la thèse ont permis de valider le fonctionnement et le potentiel de la solution GNC proposée en intégrant le code du capteur ainsi que des images simulées du sol de la lune. / In this PhD thesis, the challenge of autonomous lunar landing was addressed and an innovative method was developed, which provides an alternative to the classical sensor suites based on RADAR, LIDAR and cameras, which tend to be bulky, energy consuming and expensive. The first part is devoted to the development of a sensor inspired by the fly’s visual sensitivity to optic flow (OF). The OF is an index giving the relative angular velocity of the environment sensed by the retina of a moving insect or robot. In a fixed environment (where there is no external motion), the self-motion of an airborne vehicle generates an OF containing information about its own velocity and attitude and the distance to obstacles. Based on the “Time of Travel” principle we present the results obtained for two versions of 5 LMSs based optic flow sensors. The first one is able to measure accurately the OF in two opposite directions. It was tested in the laboratory and gave satisfying results. The second optic flow sensor operates at low velocities such as those liable to occur during lunar landing was developed. After developing these sensors, their performances were characterized both indoors and outdoors, and lastly, they were tested onboard an 80-kg helicopter flying in an outdoor environment. The Guidance Navigation and Control (GNC) system was designed in the second part on the basis of several algorithms, using various tools such as optimal control, nonlinear control design and observation theory. This is a particularly innovative approach, since it makes it possible to perform soft landing on the basis of OF measurements and as less as possible on inertial sensors. The final constraints imposed by our industrial partners were met by mounting several non-gimbaled sensors oriented in different gaze directions on the lander’s structure. Information about the lander’s self-motion present in the OF measurements is extracted by navigation algorithms, which yield estimates of the ventral OF, expansion OF and pitch angle. It was also established that it is possible to bring the planetary lander gently to the ground by tracking a pre-computed optimal reference trajectory in terms of the lowest possible fuel consumption. Software-in-the-loop simulations were carried out in order to assess the potential of the proposed GNC approach by testing its performances. In these simulations, the sensor firmware was taken into account and virtual images of the lunar surface were used in order to improve the realism of the simulated landings.