This dissertation presents an approach to reconstruct degenerate near-planar road surface in three-dimensional (3D) while automatically detect road defects. Three techniques are developed in this dissertation to establish the proposed approach. The first technique is proposed to reconstruct the degenerate near-planar road surface into 3D from one camera. Unlike the traditional Structure from Motion (SfM) technique which has the degeneracy issue for near-planar object 3D reconstruction, the uniqueness of the proposed technique lies in the use of near-planar characteristics of surfaces in the 3D reconstruction process, which solves the degenerate road surface reconstruction problem using only two images. Following the accuracy-enhanced 3D reconstructed road surface, the second technique automatically detects and estimates road surface defects. As the 3D surface is inversely solved from 2D road images, the detection is achieved by jointly identifying irregularities from the 3D road surfaces and the corresponding image information, while clustering road defects and obstacles using a mean-shift algorithm with flat kernel to estimate the depth, size, and location of the defects. To enhance the physics-driven automatic detection reliability, the third technique proposes and incorporates a self-supervised learning structure with data-driven Convolutional Neural Networks (CNN). Different from supervised learning approaches which need labeled training images, the road anomaly detection network is trained by road surface images that are automatically labeled based on the reconstructed 3D surface information. In order to collect clear road surface images on the public road, a road surface monitoring system is designed and integrated for the road surface image capturing and visualization. The proposed approach is evaluated in both simulated environment and through real-world experiments. The parametric study of the proposed approach shows the small error of the 3D road surface reconstruction influenced by different variables such as the image noise, camera orientation, and the vertical movement of the camera in a controlled simulation environment. The comparison with traditional SfM technique and the numerical results of the proposed reconstruction using real-world road surface images then indicate that the proposed approach effectively reconstructs high quality near-planar road surface while automatically detects road defects with high precision, accuracy, and recall rates without the degenerate issue. / Doctor of Philosophy / Road is one of the key infrastructures for ground transportation. A good road surface condition can benefit mainly on three aspects: 1. Avoiding the potential traffic accident caused by road surface defects, such as potholes. 2. Reducing the damage to the vehicle initiated by the bad road surface condition. 3. Improving the driving and riding comfort on a healthy road surface. With all the benefits mentioned above, it is important to examine and check the road surface quality frequently and efficiently to make sure that the road surface is in a healthy condition.
In order to detect any road surface defects on public road in time, this dissertation proposes three techniques to tackle the road surface defects detection problem: First, a near-planar road surface three-dimensional (3D) reconstruction technique is proposed. Unlike traditional 3D reconstruction technique, the proposed technique solves the degenerate issue for road surface 3D reconstruction from two images. The degenerate issue appears when the object reconstructed has near-planar surfaces. Second, after getting the accuracy-enhanced 3D road surface reconstruction, this dissertation proposes an automatic defects detection technique using both the 3D reconstructed road surface and the road surface image information. Although physics-based detection using 3D reconstruction and 2D images are reliable and explainable, it needs more time to process these data. To speed up the road surface defects detection task, the third contribution is a technique that proposes a self-supervised learning structure with data-driven Convolutional Neural Networks (CNN). Different from traditional neural network-based detection techniques, the proposed combines the 3D road information with the CNN output to jointly determine the road surface defects region. All the proposed techniques are evaluated using both the simulation and real-world experiments. Results show the efficacy and efficiency of the proposed techniques in this dissertation.
| Identifer | oai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/98671 |
| Date | 02 June 2020 |
| Creators | Hu, Yazhe |
| Contributors | Mechanical Engineering, Furukawa, Tomonari, Southward, Steve C., Sandu, Corina, Huang, Jia-Bin |
| Publisher | Virginia Tech |
| Source Sets | Virginia Tech Theses and Dissertation |
| Detected Language | English |
| Type | Dissertation |
| Format | ETD, application/pdf |
| Rights | In Copyright, http://rightsstatements.org/vocab/InC/1.0/ |
Page generated in 0.0024 seconds