Are drones revolutionary? Reading about military unmanned aerial vehicles (UAVs), or 'drones', one could be led to believe that drones are a revolutionary technology, set to fundamentally change warfare. Their fast proliferation, the association with Science Fiction, combined with the secrecy that surrounds drone use has led many to conclude that the 'Unmanned Revolution' is upon us. This thesis studies the Unmanned Revolution. It develops a framework based on the concept of the 'Revolution in Military Affairs' and applies it to the study of three countries' drone uses and integration into their armed forces. It furthermore explores the role that the designation as revolutionary has played for the integration and use of UAVs in the United States, Germany, and the United Kingdom. It shows that drones have proven their worth in military operations and compares the three countries' experiences. This thesis' detailed assessment of how the different countries have adopted drones and what implication this adoption has had, makes it a work of reference, in particular with regard to the German and British case studies. Assessing five types of changes - operational, doctrinal, strategic, organisational, and social and societal - this thesis argues that the most fundamental, and possibly revolutionary, change caused by military drones is social, namely, the fundamentally changed experience of war by combatants. In addition, it highlights country-specific changes. It concludes that the designation of drones as revolutionary has had an important impact in one country, Germany, although in the opposite way than initially expected. Namely, the intense debate around UAVs has hindered drone procurement and doctrinal thinking. In the other two countries, the Unmanned Revolution narrative was less prevalent and hence less influential. As drones are proliferating globally, I hope my thesis can be of use to policy-makers, military decision-makers as well as researchers worldwide.

Os Veículos Aéreos Não Tripulados (VANTs) são ideais para operações de risco e estressante para o ser humano são as chamadas dull, dirty and dangerous missions. Portanto, uma importante aplicação desse tipo de robô aéreo diz respeito a operações de busca envolvendo múltiplos VANTs cooperativos, em que há risco de colisões entre aeronaves e o tempo de um voo é limitado, entre outros fatores, pela capacidade de um piloto trabalhar sem descanso. Entretanto, apesar de atualmente verificar-se um crescente número de pesquisas envolvendo VANTs e do grande potencial existente na utilização de VANTs, operações de busca cooperativas ainda não estão ocorrendo. Esse assunto é uma área de estudo multidisciplinar e nascente, que possui diversas linhas de pesquisa. Diferentes algoritmos de navegação e padrões de busca foram estudados visando selecionar o(s) mais adequado(s). Além disso, apresenta-se, neste trabalho, uma visão geral sobre os mecanismos de coordenação multiagente e avalia a adequação de cada uma delas à coordenação distribuída de agentes (VANTs), visando cooperação. Assim, com o objetivo de melhorar o desempenho de uma operação de busca, esta pesquisa de mestrado propõe um modelo de VANTs cooperativos que combina mecanismos de coordenação multiagente, algoritmos de navegação e padrões de busca estabelecidos pelos principais órgãos responsáveis pelas operações de busca e salvamento. Visando avaliar a sensibilidade do percentual médio de detecção de objetos, bem como o tempo médio de busca, foi desenvolvido um simulador e milhares de simulações foram realizadas. Observou-se que, utilizando o modelo, VANTs cooperativos podem reduzir, em média, 57% do tempo de busca (comparando com uma busca de dois VANTs não cooperativos no mesmo cenário), mantendo a probabilidade média de detecção dos objetos próxima de 100% e sobrevoando apenas 30% do espaço de busca. / There are an increasing number of researches into UAV (Unmanned Aerial Vehicle) in the literature. These robots are quite suitable to dull, dirty and dangerous missions. Thus, an important application of these vehicles is the search operations involving multiple UAVs in which there is risk of collisions among aircrafts and the flight time is limited by the maximum time of pilot working hours. However, despite the huge potential use of the UAVs, cooperative search operations with this kind of flying robots are not yet occurring. This research topic is a new and multidisciplinary area of study in its beginning and there are several issues that can be studied, such as centralized versus decentralized control, path planning for cooperative flights, agent reasoning for UAV tactical planning, safety assessments, reliability in automatic target reconnaissance by cameras, agent coordination mechanisms applied to UAV cooperation and the application itself. Different path planning algorithms were studied aiming to attain the most suitable to these kinds of operations, and the conclusions are presented. In addition, official documents of Search and Rescue operations are also studied in order to know the best practices already established for this kind of operations, and, finally, an overview of the coordination multi-agent theory is presented and evaluated to achieve the UAV coordination. This work proposes a model that combines path planning algorithms, search patterns and multi-agent coordination techniques to obtain a cooperative UAV model. The great goal for cooperative UAV is to achieve such performance that the performance of the group overcomes the sum of the individual performances isolatedly. Then, aiming to analyze the average percentage of objects detection, and the average search time, a simulator was developed and thousands of simulations were run. It was observed that, using the proposed model, two cooperative UAVs can perform a search operation 57% faster than two non cooperative UAVs, keeping the average probability of objects detection approaching at 100% and flying only 30% of the search space.

In the emerging industry of small unmanned vehicles, pioneered by small businesses and research institutions, a suitable combat system test platform is needed. Computer simulations are useful, but do not provide the definitive proof of effective operation necessary for deployment of a combat system. What is needed is an affordable simulated weapons system that enables live flight testing without the used of live weaponry. A framework is developed here for the construction of a simulated weapon using Free Space Optical (FSO) infrared communication. It is developed in such a way to ensure compatibility with a variety of platforms including ground and aerial vehicles, so that identical but configurable modules can be used on any vehicle that is to take place in a live combat simulation. A proof-of-concept implementation of this modular laser combat system framework is also presented and tested. The implemented system shows the value of such a simulated weapons system and future areas of improvement are also explored.

O presente documento tem por objetivo apresentar a tese desenvolvida no programa de doutorado em Ciência da Computação e Matemática Computacional do ICMC/USP. Esta tese aborda o desenvolvimento de sistemas autônomos, de baixo custo, para supervisão de missão e segurança de voo em Veículos Aéreos Não Tripulados (VANTs). A supervisão da missão é assegurada através da implementação de um sistema do tipo Mission Oriented Sensor Array (MOSA), responsável pelo adequado cumprimento da missão. A segurança de voo é garantida pelo sistema In-Flight Awareness (IFA), que visa monitorar o funcionamento da aeronave. Os assuntos missão e segurança são complexos e os sistemas MOSA e IFA foram idealizados e desenvolvidos de forma independente, fundamentando-se na ideia de separação de interesses. O desenvolvimento desses sistemas foi baseado em dois modelos de referência: MOSA e IFA, propostos pela literatura. Em trabalhos anteriores da literatura, alguns sistemas do tipo MOSA e IFA foram propostos para situações específicas de missão. Numa outra abordagem, esta tese propõe um único sistema MOSA e IFA capaz de se adequar a um conjunto distinto de missões. Neste trabalho, foi desenvolvida toda arquitetura de comunicação que integra os sistemas MOSA e IFA. No entanto, apenas esses dois sistemas não são suficientes para fazer a execução da missão com segurança, necessitando-se de um sistema capaz de se comunicar com o Piloto Automático (AP) do VANT. Logo, um sistema capaz de enviar requisições e comandos ao AP foi também implementado. Através desses três sistemas, missões autônomas com desvio de obstáculos puderam ser realizadas sem intervenção humana, mesmo diante de situações críticas ao voo. Assegurar os aspectos de segurança e missão pode se tornar conflitante durante o voo, pois em situações emergenciais deve-se abortar a missão. Diferentes estratégias para planejamento e replanejamento de rotas, baseadas em computação evolutiva e heurísticas, foram desenvolvidas e integradas nos sistemas MOSA e IFA. Os sistemas, aqui propostos, foram validados em quatro etapas: (i) experimentos com o simulador de voo FlightGear; (ii) simulações com a técnica Software-In-The-Loop (SITL); (iii) simulações com a técnica Hardware-In- The-Loop (HITL); (iv) voos reais. Na última etapa, os sistemas foram embarcados em dois modelos de VANTs, desenvolvidos pelo grupo de pesquisa. Durante a experimentação, alguns modelos de pilotos automáticos (APM e Pixhawk), computadores de bordo (Raspberry Pi 3, Intel Edison e BeagleBone Black), planejadores de missão e replanejadores de rotas emergenciais foram avaliados. Ao todo, três planejadores de rotas e oito replanejadores são suportados pela plataforma autônoma. O sistema autônomo desenvolvido permite alterar missões com diferentes características de hardware e de software de forma fácil e transparente, sendo, desse modo, uma arquitetura com características plug and play. / This document aims to present the thesis developed in the doctoral program in Computer Science and Computational Mathematics at ICMC/USP. This thesis addresses the development of low- cost autonomous systems for mission supervision and flight safety in Unmanned Aerial Vehicles (UAVs). The mission supervision is ensured through the implementation of a Mission Oriented Sensor Array (MOSA) system, which is responsible for the proper fulfillment of the mission. The flight safety is guaranteed by the In-Flight Awareness (IFA) system, which aims to monitor the aircraft operation. The mission and safety issues are complex, and the MOSA and IFA systems were idealized and developed independently, based on the idea of separation of concerns. The development of these systems was based on two reference models: MOSA and IFA, proposed in the literature. In previous works of the literature, some MOSA and IFA systems have been proposed for specific mission situations. In another approach, this thesis proposes a single MOSA and IFA system capable of adapting to a distinct set of missions. All the communication architecture that integrates the MOSA and IFA systems were developed in this work. However, only these two systems are not sufficient to carry out the mission safely; a system that can communicate with the AutoPilot (AP) of the UAV its also needed. In this way, a system that is capable of sending commands and requests to the AP was implemented in this work. Through these three systems, autonomous missions with a diversion of obstacles could be carried out without human intervention, even in critical situations to the flight. Ensuring the safety and mission aspects can become conflicting during the flight because in hazards situations the mission must be aborted. Different strategies for path planning and path replanning, based on evolutionary computation and heuristics, were developed and integrated into the MOSA and IFA systems. The systems proposed here were validated in four stages: (i) experiments with FlightGear flight simulator; (ii) simulations using Software-In-The-Loop (SITL); (iii) simulations using Hardware- In-The-Loop (HITL); (iv) real flights. In the last stage, the systems were embedded in two models of UAVs, developed by the research group. During the experiment were evaluated some models of autopilots (APM and Pixhawk), companion computers (Raspberry Pi 3, Intel Edison and BeagleBone Black), mission planners and emergency route planners. In all, three route planners and eight replanners are supported by the autonomous platform. The developed autonomous system allows changing missions with different hardware and software characteristics in an easy and transparent way, being, therefore, an architecture with Plug and play characteristics.

North American civil infrastructures are aging. According to recent (2016) Canadian infrastructure report card, 33% of the Canadian municipal infrastructures are either in fair or below fair condition. The current deficit of replacing fair and poor municipal bridges (covers 26% of bridges) is 13 billion dollars. According to the latest report (2017) by American Society of Civil Engineers, the entire American infrastructure have been given a D+ condition rating. This includes some of the structural elements of infrastructures that pose a significant risk and there is an urgent need for frequent and effective inspection to ensure the safety of people. Visual inspection is a commonly used technique to detect and identify surface defects in bridge structures as it has been considered the most feasible method for decades. However, this currently used methodology is inadequate and unreliable as it is highly dependent on subjective human judgment. This labor-intensive approach for inspection requires huge investment in terms of an arrangement of temporary scaffoldings/permanent platforms, ladders, snooper trucks, and sometimes helicopters. To address these issues associated with visual inspection, the completed research suggests three innovative methods; 1) Combined use of Fuzzy logic and Image Processing Algorithm to quantify surface defects, 2) Unmanned Aerial Vehicle (UAV)-assisted American Association of State Highway and Transportation Officials (AASHTO) guideline-based damage assessment technique, and 3) Patent-pending multi-device robotics-based sensor data acquisition system for mapping and assessing defects in civil structures. To detect and quantify subsurface defects such as voids and delamination using a UAV system, another patent-pending UAV-based acoustic method is developed. It is a novel inspection apparatus that comprises of an acoustic signal generator coupled to a UAV. The acoustic signal generator includes a hammer to produce an acoustic signal in a structure using a UAV. An outcome of this innovative research is the development of a model to refine multiple commercially available NDT techniques’ data to detect and quantify subsurface defects. To achieve this, a total of nine 1800 mm × 460 mm reinforced concrete slabs with varying thicknesses of 100 mm, 150 mm and 200 mm are prepared. These slabs are designed to have artificially simulated defects like voids, debonding, honeycombing, and corrosion. To determine the performance of five NDT techniques, more than 300 data points are considered for each test. The experimental research shows that utilizing multiple techniques on a single structure to evaluate the defects, significantly lowers error and increases accuracy compared to that from a standalone test. To visualize the NDT data, two-dimensional NDT data maps are developed. This work presents an innovative method to interpret NDT data correctly as it compares the individual data points of slabs with no defects to slabs with simulated damage. For the refinement of NDT data, significance factor and logical sequential determination factor are proposed. / Graduate / 2020-09-06

UAV development and usage has increased dramatically in the last 15 years. In this time frame the potential has been realized for deployable UAVs to the extent that a new class of UAV was defined for these systems. Inflatable wing UAVs provide a unique solution for deployable UAVs because they are highly packable (some collapsing to 5-10% of their deployed volume) and have the potential for the incorporation of wing shaping. In this thesis, aerodynamic coefficients and aileron effectiveness were derived from the equations of motion of aircraft as necessary parameters for autonomous flight. A wind tunnel experiment was performed to determine the aerodynamic performance of a bumpy inflatable wing airfoil for comparison with the baseline smooth airfoil from which it was derived. Results showed that the bumpy airfoil has improved aerodynamics over the smooth airfoil at low-Re. The results were also used to create aerodynamic performance curves to supplement results of aerodynamic modeling with a smooth airfoil. A modeling process was then developed to calculate the aileron effectiveness of a wing shaping demonstrator aircraft. Successful autonomous flight tests were then performed with the demonstrator aircraft including in-flight aileron doublets to validate the predicted aileron effectiveness, which matched within 8%.

Instrumented umanned aerial vehicles represent a new way of measuring turbulence in the atmospheric boundary layer. However, autonomous measurements require control methods with disturbance-rejection and altitude command-following capabilities. Filtered dynamic inversion is a control method with desirable disturbance-rejection and command-following properties, and this controller requires limited model information. We implement filtered dynamic inversion as the pitch controller in an altitude-hold autopilot. We design and numerically simulate the continuous-time and discrete-time filtered-dynamic-inversion controllers with anti-windup on a nonlinear aircraft model. Finally, we present results from a flight experiment comparing the filtered-dynamic-inversion controller to a classical proportional-integral controller. The experimental results show that the filtered-dynamic-inversion controller performs better than a proportional-integral controller at certain values of the parameter.

An urban operation of unmanned aerial vehicles (UAVs) demands a high level of autonomy for tasks presented in a cluttered environment. While fixed-wing UAVs are well suited for long-endurance missions at a high altitude, enabling them to navigate inside an urban area brings another level of challenges. Their inability to hover and low agility in motion cause more difficulties on finding a feasible path to move safely in a compact region, and the limited payload allows only low-grade sensors for state estimation and control. We address the problem of achieving vision-based autonomous navigation for a small fixed-wing in an urban area with contributions to the following several key topics. Firstly, for robust attitude estimation during dynamic maneuvering, we take advantage of the line regularity in an urban scene, which features vertical and horizontal edges of man-made structures. The sensor fusion with gravity-related line segments and gyroscopes in a Kalman filter can provide driftless and realtime attitude for ight stabilization. Secondly, as a prerequisite to sensor fusion, we present a convenient self-calibration scheme based on the factorization method. Natural references such as gravity, vertical edges, and distant scene points, available in urban fields, are sufficient to find intrinsic and extrinsic parameters of inertial and vision sensors. Lastly, to generate a dynamically feasible motion plan, we propose a discrete planning method that encodes a path into interconnections of finite trim states, which allow a significant dimension reduction of a search space and result in naturally implementable paths integrated with ight controllers. The most probable path to reach a target is computed by the Markov Decision Process with motion uncertainty due to wind, and a minimum target observation time is imposed on the final motion plan to consider a camera's limited field-of-view. In this thesis, the effectiveness of our vision-based navigation system is demonstrated by what we call an "air slalom" task in which the UAV must autonomously search and localize multiple gates, and pass through them sequentially. Experiment results with a 1m wing-span airplane show essential navigation capabilities demanded in urban operations such as maneuvering passageways between buildings.

This dissertation describes the development of a requirements analysis methodology that takes into account the concept of operations and the hierarchical decomposition of aerospace systems. At the core of the methodology, the Analytic Network Process (ANP) is used to ensure the traceability between the qualitative and quantitative information present in the hierarchical model. The proposed methodology is implemented to the requirements definition of a hurricane tracker Unmanned Aerial Vehicle. Three research objectives are identified in this work; (1) improve the requirements mapping process by matching the stakeholder expectations with the concept of operations, systems and available resources; (2) reduce the epistemic uncertainty surrounding the requirements and requirements mapping; and (3) improve the requirements down-selection process by taking into account the level of importance of the criteria and the available resources. Several challenges are associated with the identification and definition of requirements. The complexity of the system implies that a large number of requirements are needed to define the systems. These requirements are defined early in the conceptual design, where the level of knowledge is relatively low and the level of uncertainty is large. The proposed methodology intends to increase the level of knowledge and reduce the level of uncertainty by guiding the design team through a structured process. To address these challenges, a new methodology is created to flow-down the requirements from the stakeholder expectations to the systems alternatives. A taxonomy of requirements is created to classify the information gathered during the problem definition. Subsequently, the operational and systems functions and measures of effectiveness are integrated to a hierarchical model to allow the traceability of the information. Monte Carlo methods are used to evaluate the variations of the hierarchical model elements and consequently reduce the epistemic uncertainty. The proposed methodology is applied to the design of a hurricane tracker Unmanned Aerial Vehicles to demonstrate the origin and impact of requirements on the concept of operations and systems alternatives. This research demonstrates that the hierarchical modeling methodology provides a traceable flow-down of the requirements from the problem definition to the systems alternatives phases of conceptual design.

This research work provides the development of an Adaptive Flight Control System (AFCS) for autonomous hover of a Rotary-wing Unmanned Aerial Vehicle (RUAV). Due to the complex, nonlinear and time-varying dynamics of the RUAV, indirect adaptive control using the Model Predictive Control (MPC) is utilised. The performance of the MPC mainly depends on the model of the RUAV used for predicting the future behaviour. Due to the complexities associated with the RUAV dynamics, a neural network based black box identification technique is used for modelling the behaviour of the RUAV. Auto-regressive neural network architecture is developed for offline and online modelling purposes. A hybrid modelling technique that exploits the advantages of both the offline and the online models is proposed. In the hybrid modelling technique, the predictions from the offline trained model are corrected by using the error predictions from the online model at every sample time. To reduce the computational time for training the neural networks, a principal component analysis based algorithm that reduces the dimension of the input training data is also proposed. This approach is shown to reduce the computational time significantly. These identification techniques are validated in numerical simulations before flight testing in the Eagle and RMAX helicopter platforms. Using the successfully validated models of the RUAVs, Neural Network based Model Predictive Controller (NN-MPC) is developed taking into account the non-linearity of the RUAVs and constraints into consideration. The parameters of the MPC are chosen to satisfy the performance requirements imposed on the flight controller. The optimisation problem is solved numerically using nonlinear optimisation techniques. The performance of the controller is extensively validated using numerical simulation models before flight testing. The effects of actuator and sensor delays and noises along with the wind gusts are taken into account during these numerical simulations. In addition, the robustness of the controller is validated numerically for possible parameter variations. The numerical simulation results are compared with a base-line PID controller. Finally, the NN-MPCs are flight tested for height control and autonomous hover. For these, SISO as well as multiple SISO controllers are used. The flight tests are conducted in varying weather conditions to validate the utility of the control technique. The NN-MPC in conjunction with the proposed hybrid modelling technique is shown to handle additional disturbances successfully. Extensive flight test results provide justification for the use of the NN-MPC technique as a reliable technique for control of non-linear complex dynamic systems such as RUAVs.