Cette recherche vise à la modélisation 3D depuis un système de vision fisheye embarqué, utilisée pour une application GNSS dans le cadre du projet Predit CAPLOC. La propagation des signaux satellitaires en milieu urbain est soumise à des réflexions sur les structures, altérant la précision et la disponibilité de la localisation. L’ambition du projet est (1) de définir un système de vision omnidirectionnelle capable de fournir des informations sur la structure 3D urbaine et (2) de montrer qu’elles permettent d’améliorer la localisation.Le mémoire expose les choix en (1) calibrage automatique, (2) mise en correspondance entre images, (3) reconstruction 3D ; chaque algorithme est évalué sur images de synthèse et réelles. De plus, il décrit une manière de corriger les réflexions des signaux GNSS depuis un nuage de points 3D pour améliorer le positionnement. En adaptant le meilleur de l’état de l’art du domaine, deux systèmes sont proposés et expérimentés. Le premier est un système stéréoscopique à deux caméras fisheye orientées vers le ciel. Le second en est l’adaptation à une unique caméra.Le calibrage est assuré à travers deux étapes : l’algorithme des 9 points adapté au modèle « équisolide » couplé à un RANSAC, suivi d’un affinement par optimisation Levenberg-Marquardt. L’effort a été porté sur la manière d’appliquer la méthode pour des performances optimales et reproductibles. C’est un point crucial pour un système à une seule caméra car la pose doit être estimée à chaque nouvelle image.Les correspondances stéréo sont obtenues pour tout pixel par programmation dynamique utilisant un graphe 3D. Elles sont assurées le long des courbes épipolaires conjuguées projetées de manière adaptée sur chaque image. Une particularité est que les distorsions ne sont pas rectifiées afin de ne pas altérer le contenu visuel ni diminuer la précision. Dans le cas binoculaire il est possible d’estimer les coordonnées à l’échelle. En monoculaire, l’ajout d’un odomètre permet d’y arriver. Les nuages successifs peuvent être calés pour former un nuage global en SfM.L’application finale consiste dans l’utilisation du nuage 3D pour améliorer la localisation GNSS. Il est possible d’estimer l’erreur de pseudodistance d’un signal après multiples réflexions et d’en tenir compte pour une position plus précise. Les surfaces réfléchissantes sont modélisées grâce à une extraction de plans et de l’empreinte des bâtiments. La méthode est évaluée sur des paires d’images fixes géo-référencées par un récepteur bas-coût et un récepteur GPS RTK (vérité terrain). Les résultats montrent une amélioration de la localisation en milieu urbain. / This research deals with 3D modelling from an embedded fisheye vision system, used for a GNSS application as part of CAPLOC project. Satellite signal propagation in urban area implies reflections on structures, impairing localisation’s accuracy and availability. The project purpose is (1) to define an omnidirectional vision system able to provide information on urban 3D structure and (2) to demonstrate that it allows to improve localisation.This thesis addresses problems of (1) self-calibration, (2) matching between images, (3) 3D reconstruction ; each algorithm is assessed on computer-generated and real images. Moreover, it describes a way to correct GNSS signals reflections from a 3D point cloud to improve positioning. We propose and evaluate two systems based on state-of-the-art methods. First one is a stereoscopic system made of two sky facing fisheye cameras. Second one is the adaptation of the former to a single camera.Calibration is handled by a two-steps process: the 9-point algorithm fitted to “equisolid” model coupled with a RANSAC, followed by a Levenberg-Marquardt optimisation refinement. We focused on the way to apply the method for optimal and repeatable performances. It is a crucial point for a system composed of only one camera because the pose must be estimated for every new image.Stereo matches are obtained for every pixel by dynamic programming using a 3D graph. Matching is done along conjugated epipolar curves projected in a suitable manner on each image. A distinctive feature is that distortions are not rectified in order to neither degrade visual content nor to decrease accuracy. In the binocular case it is possible to estimate full-scale coordinates.In the monocular case, we do it by adding odometer information. Local clouds can be wedged in SfM to form a global cloud.The end application is the usage of the 3D cloud to improve GNSS localisation. It is possible to estimate and consider a signal pseudodistance error after multiple reflections in order to increase positioning accuracy. Reflecting surfaces are modelled thanks to plane and buildings trace fitting. The method is evaluated on fixed image pairs, georeferenced by a low-cost receiver and a GPS RTK receiver (ground truth). Study results show the localisation improvement ability in urban environment.

<p>Many different approaches have been taken towards solving the stereo correspondence problem and great progress has been made within the field during the last decade. This is mainly thanks to newly evolved global optimization techniques and better ways to compute pixel dissimilarity between views. The most successful algorithms are based on approaches that explicitly model smoothness assumptions made about the physical world, with image segmentation and plane fitting being two frequently used techniques.</p><p>Within the project, a survey of state of the art stereo algorithms was conducted and the theory behind them is explained. Techniques found interesting were implemented for experimental trials and an algorithm aiming to achieve state of the art performance was implemented and evaluated. For several cases, state of the art performance was reached.</p><p>To keep down the computational complexity, an algorithm relying on local winner-take-all optimization, image segmentation and plane fitting was compared against minimizing a global energy function formulated on pixel level. Experiments show that the local approach in several cases can match the global approach, but that problems sometimes arise – especially when large areas that lack texture are present. Such problematic areas are better handled by the explicit modeling of smoothness in global energy minimization.</p><p>Lastly, disparity estimation for image sequences was explored and some ideas on how to use temporal information were implemented and tried. The ideas mainly relied on motion detection to determine parts that are static in a sequence of frames. Stereo correspondence for sequences is a rather new research field, and there is still a lot of work to be made.</p>

Many different approaches have been taken towards solving the stereo correspondence problem and great progress has been made within the field during the last decade. This is mainly thanks to newly evolved global optimization techniques and better ways to compute pixel dissimilarity between views. The most successful algorithms are based on approaches that explicitly model smoothness assumptions made about the physical world, with image segmentation and plane fitting being two frequently used techniques. Within the project, a survey of state of the art stereo algorithms was conducted and the theory behind them is explained. Techniques found interesting were implemented for experimental trials and an algorithm aiming to achieve state of the art performance was implemented and evaluated. For several cases, state of the art performance was reached. To keep down the computational complexity, an algorithm relying on local winner-take-all optimization, image segmentation and plane fitting was compared against minimizing a global energy function formulated on pixel level. Experiments show that the local approach in several cases can match the global approach, but that problems sometimes arise – especially when large areas that lack texture are present. Such problematic areas are better handled by the explicit modeling of smoothness in global energy minimization. Lastly, disparity estimation for image sequences was explored and some ideas on how to use temporal information were implemented and tried. The ideas mainly relied on motion detection to determine parts that are static in a sequence of frames. Stereo correspondence for sequences is a rather new research field, and there is still a lot of work to be made.

空載光達系統於建置國土測繪基本資料扮演關鍵角色，依國土測繪法，為確保測繪成果品質，應依測量計畫目的及作業精度需求辦理儀器校正。國土測繪中心已於102年度建置航遙測感應器系統校正作業中，提出矩形建物之平屋頂面做為空載光達系統校正之可行性，而其所稱之校正，是以點雲精度評估待校件空載光達系統所得最終成果品質，並不對儀器做任何參數改正，但其校正成果可能因不同人員操作而有差異，因此本研究嘗試建立一套空載光達點雲半自動化精度評估程序，此外探討以山形屋脊線執行點雲精度評估之可行性。 由於光達點雲為離散的三維資訊，不論是以山形屋脊線或矩形建物之平屋頂面作為標物執行點雲精度評估，均須先萃取屋頂面上之點，為避免萃取成果受雜訊影響，本研究引入粗差偵測理論，發展最小一乘法結合李德仁以後驗變方估計原理導出的選擇權迭代法(李德仁法)將非屋頂點視為粗差排除。研究中分別對矩形建物之平屋頂面及山形屋脊線進行模擬及真實資料實驗，其中山形屋脊線作為點雲精度評估之可行性實驗中發現不適合用於評估點雲精度，因此後續實驗僅以萃取矩形建物之平屋頂面點雲過程探討粗差比率對半自動化點雲精度評估程序之影響。模擬實驗成果顯示最小一乘法有助於提升李德仁法偵測粗差數量5%至10%；真實資料實驗，以含有牆面點雲的狀況為例，則有助提升5%的偵測粗差數量。本研究由逐步測試結果提出能夠適用於真實狀況的半自動化之點雲精度評估程序，即使由不同人員操作，仍能獲得一致的成果，顯示本研究半自動化精度評估程序之可信度。 / The airborne LiDAR system plays a crucial role in building land surveying data. Based on the Land Surveying and Mapping Act, to ensure the quality of surveying, instrument calibration is required. The approach proposed by National Land Surveying and Mapping Center (NLSC) in 2013 was confirmed the feasibility for airborne LiDAR system calibration using rectangular horizontal roof plane. The calibration mean to assess the final quality of airborne LiDAR system based on the assessment of the accuracy of the point cloud, and do not adjust the instrument. But the results may vary according to different operators. This study attempts to establish a semi-automatic procedure for the accuracy assessment of point clouds from airborne LiDAR system. In addition, the gable roof ridge lines is discussed for its feasibility for the accuracy assessment of point cloud. No matter that calibration is performed using rectangular horizontal roof plane or gable roof ridge line, point clouds located on roof planes need to be extracted at first. Therefore, Least Absolute Deviation (LAD) combined with the Iteration using Selected Weights (Deren Li method) is developed to exclude the non-roof points which regarded as gross errors and eliminate their influences. The simulated test and actual data test found that gable roof ridge lines are not suitable for accuracy assessment. As for the simulated test using horizontal roof planes, LAD combined with Deren Li method prompts the rate of gross error detection about 5% to 10% than that only by Deren Li method. In actual test, data contains wall points, LAD combined with Deren Li method can prompt about 5%. Meanwhile, a semi-automatic procedure for real operations is proposed by the step-by-step test. Even different operators employ this semi-automatic procedure, consistent results will be obtained and the reliability can achieve.

No description available.