自動化三維建模需要準確的三維點座標，而三維點的位置則依賴高精度的對應點，因此對應點的尋找一直是此領域的研究議題，而使用稀疏光束調整法(SBA：Sparse Bundle Adjustment)來優化相機參數也是常用的作法，然而若三維點當中有少數幾個誤差較大的點，則稀疏光束調整法會受到很大的影響。我們採用多視角影像做依據，找出對應點座標及幾何關係，在改善對應點位置的步驟中，我們藉由位移三維點法向量來取得各種不同位置的三維補綴面(3D patch)，並根據投影到影像上之補綴面的正規化相關匹配法(NCC：Normalized Cross Correlation)來改善對應點位置。利用這些改善過的點資訊，我們使用稀疏光束調整法來針對相機校正做進一步的優化，為了避免誤差較大的三維點影響到稀疏光束調整法的結果，我們使用穩健的計算方法來過濾這些三維點，藉由此方法來減少再投影誤差(reprojection error)，最後產生較精準的相機參數，使用此參數我們可以自動化建出外型架構較接近真實物體的模型。 / Automated 3D modeling of the need for accurate 3D points, and location of the 3D points depends on the accuracy of corresponding points, so the search for corresponding points in this area has been a research topic, and the use of SBA(Sparse Bundle Adjustment) to optimize the camera parameters is also a common practice, however, if there are a few more error 3D points, the SBA will be greatly affected. In this paper, we establish the corresponding points and their geometry relationship from multi-view images. And the 3D patches are used to refine point positions. We translate the normal to get many patches, and project them into visible images. The NCC(Normalized Cross Correlation) values between patches in reference image and patches in visible image are used to estimate the best correspondence points. And they are used to get better camera parameters by SBA(sparse bundle adjustment). Furthermore, it is because that it usually exist outliers in the data observed, and they will influence the results by using SBA. So, we use our robust estimation method to resist the outliers. In our experiment, SBA is used to filter some outliers to reduce the reprojection error. After getting more precise camera parameters, we use them to reconstruct the 3D model more realistic.

近年來諸多學者專家致力於從多視角影像獲取精確的點雲資訊，並藉由點雲資訊進行三維模型重建等研究，然而透過多視角影像求取三維資訊的精確度仍然有待提升，其中萃取影像對應與重建三維資訊方法，是多視角影像重建三維資訊的關鍵核心，決定點雲資訊的形成方式與成效。 本論文中，我們提出了一套新的方法，由多視角影像之間的幾何關係出發，萃取多視角影像對應與重建三維點，可以有效地改善對應點與三維點的精確度。首先，在萃取多視角影像對應的部份，我們以相互支持轉換、動態高斯濾波法與綜合性相似度評估函數，改善補綴面為基礎的比對方法，提高相似度測量值的辨識力與可信度，可從多視角影像中獲得精確的對應點。其次，在重建三維點的部份，我們使用K均值分群演算法與線性內插法發掘潛在的三維點，讓求出的三維點更貼近三維空間真實物體表面，能在多視角影像中獲得更精確的三維點。 實驗結果顯示，採用本研究所提出的方法進行改善後，在對應點精確度的提升上有很好的成效，所獲得的點雲資訊存在數萬個精確的三維點，而且僅有少數的離群點。 / Recently, many researchers pay attentions in obtaining accurate point cloud data from multi-view images and use these data in 3D model reconstruction. However, this accuracy still needs to be improved. Among these researches, the methods in extracting the corresponding points as well as computing the 3D point information are the most critical ones. These methods practically affect the final results of the point cloud data and the 3D models so constructed. In this thesis, we propose new approaches, based on multi-view geometry, to improve the accuracy of corresponding points and 3D points. Mutual support transformation, dynamic Gaussian filtering, and similarity evaluation function were used to improve the patch-based matching methods in multi-view image correspondence. Using these mechanisms, the discrimination ability and reliability of the similarity function and, hence, the accuracy of the extracted corresponding points can be greatly improved. We also used K-mean algorithms and linear interpolations to find the better 3D point candidates. The 3D point so computed will be much closer to the surface of the actual 3D object. Thus, this mechanism will produce highly accurate 3D points. Experimental results show that our mechanism can improve the accuracy of corresponding points as well as the 3D point cloud data. We successfully generated accurate point cloud data that contains tens of thousands 3D points, and, moreover, only has a few outliers.