This thesis focuses on vision-based detection and observation of small, slow-moving targets using a gimballed fixed-wing unmanned aircraft system (UAS). Generally, visual tracking algorithms are tuned to detect motion of relatively large objects in the scene with noticeably significant motion; therefore, applications such as high-altitude visual searches for human motion often ignore target motion as noise. Furthermore, after a target is identified, arbitrary maneuvers for transitioning to overhead orbits for better observation may result in temporary or permanent loss of target visibility. We present guidelines for tuning parameters of the Visual Multiple Target Tracking (Visual MTT) algorithm to enhance its detection capabilities for very small, slow-moving targets in high-resolution images. We show that the tuning approach is able to detect walking motion of a human described by 10-15 pixels from high altitudes. An algorithm is then presented for defining rotational bounds on the controllable degrees of freedom of an aircraft and gimballed camera system for maintaining visibility of a known ground target. Critical rotations associated with the fastest loss or acquisition of target visibility are also defined. The accuracy of these bounds are demonstrated in simulation and simple applications of the algorithm are described for UAS. We also present a path planning and control framework for defining and following both dynamically and visually feasibly transition trajectories from an arbitrary point to an orbit over a known target for further observation. We demonstrate the effectiveness of this framework in maintaining constant target visibility while transitioning to the intended orbit as well as in transitioning to a lower altitude orbit for more detailed visual analysis of the intended target.

<p>Civil engineering structures must provide an adequate and safe performance during their time of service, and the owners of these structures must have a reliable inspection strategy to ensure time-dependent damage does not become excessive. Visual inspection is the first step in every structural inspection; however, many elements in the majority of structures are difficult to access and require specialized personal and equipment. In an attempt to reduce the risk of the inspector and the cost of additional equipment, the use of Unmanned Aircraft Systems (UAS) has been increasing in the last years. The absence of standards and regulations regarding the use of UAS in inspection of structures has allowed the market to widely advertise Unmanned Aerial Vehicles (UAV) without protocols or qualifications that prove their effectiveness, leaving the owners of the structures to solely rely on claims of the vendors before deciding which technology suits their particular inspection needs. Focusing primarily on bridge inspection, this research aimed to address the lack of performance-based evaluation and standards for UAS, developing a validation criterion to evaluate a given UAS based on a repeatable test that resembles typical conditions in a structure. </p><p><br></p><p>Current applications of UAS in inspection of structures along with its advantages and limitations were studied to determine the current status of UAS technologies. A maximum typical rotor-tip-to-rotor-tip distance of an UAV was determined based on typical UAVs used in bridge inspection, and two main parameters were found to be relevant when flying close to structures: proximity effects in the UAV and availability of visual line of sight. Distances where proximity effects are relevant were determined based on several field inspections and flights close to structures. In addition, the use of supplementary technologies such as Global Positioning System (GPS) and Inertial Measurement Units (IMU) was studied to understand their effect during inspection. </p><p><br></p><p>Following the analysis, the author introduces the idea of a series of obstacles and elements inside an enclosed space that resemble components of bridge structures to be inspected using UAVs, allowing repeatability of the test by controlling outside parameters such as lighting condition, wind, precipitation, temperature, and GPS signal. Using distances based on proximity effects, maximum typical rotor-tip-to-rotor-tip distance, and a gallery of bridges and situations when flying close to bridge structures, a final arrangement of elements is presented as the evaluation chamber. Components inside the evaluation chamber include both “real” steel and concrete specimens as well as those intended to simulate various geometric configurations on which other features are mounted. Pictures of damages of steel and concrete elements have been placed in the internal faces of the obstacles that can be assessed either in real-time flight or in post-processing work. A detailed comparison between the objectives of this research project and the results obtained by the evaluation chamber was performed using visual evaluation and resolution charts for the images obtained, the availability of visual line of sight during the test, and the absence of GPS signal.</p><p><br></p><p>From the comparison and analysis conducted and based on satisfactory flight results as images obtained during flights, the evaluation chamber is concluded to be a repeatable and reliable tool to apply to any UAS prior to inspect bridges and other structures, and the author recommends to refrain from conducting an inspection if the UAS does not comply with the minimum requirements presented in this research work. Additionally, this research provided a clearer understanding of the general phenomenon presented when UAVs approach structures and attempts to fill the gap of knowledge regarding minimum requirements and criterion for the use of UAS technologies in inspection of structures.</p>