Building facades, serving mainly to protect occupants and structural components from natural forces, require periodic inspections for the detection and assessment of building façade anomalies. Over the past years, a growing trend of utilizing camera-equipped drones for periodical building facade inspection has emerged. Building façade anomalies, such as cracks and erosion, can be detected through analyzing drone-captured video, photographs, and infrared images. Such anomalies are known to have an impact on various building performance aspects, e.g., thermal, energy, moisture control issues. Current research efforts mainly focus on the design of drone flight schema for building inspection, 3D building model reconstruction through drone-captured images, and the detection of specific façade anomalies with these images. However, there are several research gaps impeding the improvement of automation level during the processes of building façade inspection with UAV (Unmanned Aerial Vehicle). These gaps are (1) lack effective ways to store multi-type data captured by drones with the connection to the spatial information of building facades, (2) lack high-performance tools for UAV-image analysis for the automated detection of building façade anomalies, and (3) lack a comprehensive management (i.e., storage, retrieval, analysis, and display) of large amounts and multi-media information for cyclic façade inspection. When seeking inspirations from nature, the process of drone-based facade inspection can be compared with caching birds' foraging food through spatial memory, visual sensing, and remarkable memories. This dissertation aims at investigating ways to improve the management of UAV-captured data and the automation level of drone-based façade anomaly inspection with inspirations from caching birds' foraging behavior. Firstly, a 2D spatial model of building façades was created in the geographic information system (GIS) for the registration and storage of UAV-images to assign façade spatial information to each image. Secondly, computational methods like computer vision and deep learning neural networks were applied to develop algorithms for automated extraction of visual features of façade anomalies within UAV-captured images. Thirdly, a GIS-based database was designed for the comprehensive management of heterogeneous inspection data, such as the spatial, multi-spectral, and temporal data. This research will improve the automation level of storage, retrieval, analysis, and documentation of drone-captured images to support façade inspection during a building's service lifecycle. It has promising potential for supporting the decision-making of early-intervention or maintenance strategies to prevent façade failures and improve building performance. / Doctor of Philosophy / Building facades require periodic inspections and maintenance to protect occupants and structures from natural forces like the sun, wind, rain, and snow. Over the past years, a growing trend of utilizing drones for periodical building facade inspection has emerged. Building façade anomalies, such as cracks and corrosion, can be detected from the drone-captured photographs or video. Such anomalies are known to have an impact on various building performance aspects, such as moisture issues, abnormal heat loss, and additional energy consumptions. Existing practices for detecting façade anomalies from drone-captured photographs mainly rely on manual checking by going through numerous façade images and repetitively zooming in and out these high-resolution images, which is time-consuming and labor-intensive with potential risks of human errors. Besides, this manual checking process impedes the management of drone-captured data and the documentation of façade inspection activities.
At the same time, the emerging technologies of computer vision (CV) and artificial intelligence (AI) have provided many opportunities to improve the automation level of façade anomaly detection and documentation. Previous research efforts have explored the image-based generation of 3D building models using computer vision techniques, as well as image-based detection of specific anomalies using deep learning techniques. However, few studies have looked into the comprehensive management, including the storage, retrieval, analysis, and display, of drone-captured images with the spatial coordinate information of building facades; there is also a lack of high-performance image analytics tools for the automated detection of building façade anomalies.
This dissertation aims at investigating ways to improve the automation level of analyzing and managing drone-captured images as well as documenting building façade inspection information. To achieve this goal, a building façade model was created in the geographic information system (GIS) for the semi-automated registration and storage of drone-captured images with spatial coordinates by using computer vision techniques. Secondly, deep learning was applied for automated detection of façade anomalies in drone-captured images. Thirdly, a GIS-based database was designed as the platform for the automated analysis and management of heterogeneous data for drone-captured images, façade model information, and detected façade anomalies. This research will improve the automation level of drone-based façade inspection throughout a building's service lifecycle. It has promising potential for supporting the decision-making of maintenance strategies to prevent façade failures and improve building performance.
| Identifer | oai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/108759 |
| Date | 27 August 2020 |
| Creators | Chen, Kaiwen |
| Contributors | Myers-Lawson School of Construction, Reichard, Georg, Moore, Ignacio T., Kim, Mintai, Akanmu, Abiola Abosede |
| Publisher | Virginia Tech |
| Source Sets | Virginia Tech Theses and Dissertation |
| Detected Language | English |
| Type | Dissertation |
| Format | ETD, application/pdf |
| Rights | In Copyright, http://rightsstatements.org/vocab/InC/1.0/ |
Page generated in 0.0019 seconds