Recent advances in Light Detection and Ranging (LIDAR) technology and integration have resulted in vehicle-borne platforms for urban LIDAR scanning, such as Terrapoint Inc.'s TITAN system. Such technology has lead to an explosion in ground LIDAR data. The large size of such mobile urban LIDAR data sets, and the ease at which they may now be collected, has shifted the bottleneck of creating abstract urban models for Geographical Information Systems (GIS) from data collection to data processing. While turning such data into useful models has traditionally relied on human analysis, this is no longer practical. This thesis outlines a methodology for automatically recovering the necessary information to create abstract urban models from mobile urban LIDAR data using computer vision methods. As an integral part of the methodology, a novel scale-based interest operator is introduced (Di erence of Normals) that is e cient enough to process large datasets, while accurately isolating objects of interest in the scene according to real-world parameters. Finally a novel localized object recognition algorithm is introduced (Local Potential Well Space Embedding), derived from a proven global method for object recognition (Potential Well Space Embedding). The object recognition phase of our methodology is discussed with these two algorithms as a focus. / Thesis (Master, Computing) -- Queen's University, 2010-03-01 12:26:34.698

Face recognition can be used in various biometric applications ranging from identifying criminals entering an airport to identifying an unconscious patient in the hospital With the introduction of 3-dimensional scanners in the last decade, researchers have begun to develop new methods for 3-D face recognition. This thesis focuses on 3-D face recognition using the one- and two-dimensional Discrete Cosine Transform (DCT) . A feature ranking based dimensionality reduction strategy is introduced to select the DCT coefficients that yield the best classification accuracies. Two forms of 3-D representation are used: point cloud and depth map images. These representations are extracted from the original VRML files in a face database and are normalized during the extraction process. Classification accuracies exceeding 97% are obtained using the point cloud images in conjunction with the 2-D DCT.

Syfte – Syftet för den här studien är att utveckla en metod för att mäta diametern på travat timmers ändträytor i en bild med förvridet perspektiv där ytorna befinner sig på olika djup i förhållande till varandra, för att effektivisera mätning inom skogsindustrin. Metod – Denna studie genomfördes i samarbete med Cind AB, och arbetet var uppdelat i två faser med Design Science Research som forskningsmetod. I Fas 1 rektifierades bilder på ändträytorna manuellt och i Fas 2 utnyttjades ett punktmoln för att uppskatta rektifieringsplanet. Detta gjordes i en stereokamerarigg i skala 1:25 på 139 stockar. Samtliga stockar mättes digitalt i de rektifierade bilderna och manuellt med ett digitalt skjutmått. Ett konfidensintervall för differensen beräknades fram för att bedöma mätnoggrannheten. Resultat – Konfidensintervallet för Fas 1 tyder på att metoden har potential då rektifieringsplanet placeras korrekt, vilket Fas 2 visar är en svår och komplex uppgift. Slutsatser – Den utvecklade metodens mätnoggrannhet uppnådde inte studiens mål på 5% felmarginal. Det skulle dock vara möjligt att mäta ändträytor med god noggrannhet om punktmolnet har tillräckligt hög kvalitet. Begränsningar – Mjukvaran som använder punktmolnet för att rektifiera bilderna är en modifierad version av Cinds proprietära produkt. Datamängden som används i studien samlas endast in via Cinds testrigg. / Purpose – The purpose of this study is to develop a method for measuring the diameter of piled logs on a truck in a picture that has skewed perspective and where the end surfaces are at different depths in relation to each other. The intent of this method is to further streamline log measurement in the logging industry. Method – This study was conducted in collaboration with Cind AB, and the work was split in two phases with Design Science Research as research method. In Phase 1, images with log end surfaces were rectified manually, and in Phase 2 a point cloud was used to estimate the rectification plane. This was done with a stereo camera rig in scale 1:25 on a total of 139 logs. All logs were digitally measured in the rectified images and manually measured with a digital caliper. A confidence interval for the difference was calculated to assess the measurement accuracy. Findings – The confidence interval from Phase 1 indicates that the developed method has potential when the rectification plane is placed correctly, which Phase 2 shows is a difficult and complex task. Conclusions – The developed method did not reach the desired measurement accuracy of 5% margin of error, which means that the goal of the study was not achieved. It would be possible to measure the end surfaces of logs with high precision if the point cloud is of a sufficiently high quality. Limitations – The software that utilizes point cloud information to rectify the images is a modified version of Cind’s proprietary product. The dataset that is used in this study is collected solely through Cind’s test rig.

Room layout generation is the problem of generating a drawing or a digital model of an existing room from a set of measurements such as laser data or images. The generation of floor plans can find application in the building industry to assess the quality and the correctness of an ongoing construction w.r.t. the initial model, or to quickly sketch the renovation of an apartment. Real estate industry can rely on automatic generation of floor plans to ease the process of checking the livable surface and to propose virtual visits to prospective customers. As for the general public, the room layout can be integrated into mixed reality games to provide a better immersiveness experience, or used in other related augmented reality applications such room redecoration. The goal of this industrial thesis (CIFRE) is to investigate and take advantage of the state-of-the art mobile devices in order to automate the process of generating room layouts. Nowadays, modern mobile devices usually come a wide range of sensors, such as inertial motion unit (IMU), RGB cameras and, more recently, depth cameras. Moreover, tactile touchscreens offer a natural and simple way to interact with the user, thus favoring the development of interactive applications, in which the user can be part of the processing loop. This work aims at exploiting the richness of such devices to address the room layout generation problem. The thesis has three major contributions. We first show how the classic problem of detecting vanishing points in an image can benefit from an a-priori given by the IMU sensor. We propose a simple and effective algorithm for detecting vanishing points relying on the gravity vector estimated by the IMU. A new public dataset containing images and the relevant IMU data is introduced to help assessing vanishing point algorithms and foster further studies in the field. As a second contribution, we explored the state of-the-art of real-time localization and map optimization algorithms for RGB-D sensors. Real-time localization is a fundamental task to enable augmented reality applications, and thus it is a critical component when designing interactive applications. We propose an evaluation of existing algorithms for the common desktop set-up in order to be employed on a mobile device. For each considered method, we assess the accuracy of the localization as well as the computational performances when ported on a mobile device. Finally, we present a proof of concept of application able to generate the room layout relying on a Project Tango tablet equipped with an RGB-D sensor. In particular, we propose an algorithm that incrementally processes and fuses the 3D data provided by the sensor in order to obtain the layout of the room. We show how our algorithm can rely on the user interactions in order to correct the generated 3D model during the acquisition process.

Certaines opérations de maintenance sur sites industriels nécessitent une planification à partir de modèles numériques 3D des scènes où se déroulent les interventions. Pour permettre la simulation de ces opérations, les modèles 3D utilisés doivent représenter fidèlement la réalité du terrain. Ces représentations virtuelles sont habituellement construites à partir de nuages de points relevés sur le site, constituant une description métrologique exacte de l’environnement sans toutefois fournir une description géométrique de haut niveau.Il existe une grande quantité de travaux abordant le problème de la reconstruction de modèles 3D à partir de nuages de points, mais peu sont en mesure de fournir des résultats suffisamment fiables dans un contexte industriel et cette tâche nécessite en pratique l’intervention d’opérateurs humains.Les travaux réalisés dans le cadre de cette thèse visent l’automatisation de la reconstruction,avec comme principal objectif la fiabilité des résultats obtenus à l’issu du processus. Au vu de la complexité de ce problème, nous proposons d’exploiter des connaissances et données a priori pour guider la reconstruction. Le premier a priori concerne la compositiondes modèles 3D : en Conception Assistée par Ordinateur (CAO), les scènes industrielles sont couramment décrites comme des assemblages de primitives géométriques simples telles que les plans, sphères, cylindres, cônes, tores, etc. Nous hiérarchisons l’analyse en traitant dans un premier temps les plans et les cylindres, comme un préalable à la détection de stores. On obtient ainsi une description fiable des principaux composants d’intérêt dans les environnements industriels. Nous proposons en outre d’exploiter un certain nombre de règles régissant la manière dont ces primitives s’assemblent en un modèle CAO, basées surdes connaissances ”métier” caractérisant les scènes industrielles que nous traitons. De plus,nous tirons parti d’un modèle CAO existant d´ecrivant une scène similaire à celle que nous souhaitons reconstruire, provenant typiquement de la reconstruction antérieure d’un site semblable au site d’intérêt. Bien que semblables en théorie, ces scènes peuvent présenterdes différences significatives qui s’accentuent au cours de leur exploitation.La méthode que nous développons se fonde sur une formulation Bayésienne du problème de reconstruction : il s’agit de retrouver le modèle CAO le plus probable vis à visdes différentes attentes portées par les données et les a priori sur le modèle à reconstruire. Les diverses sources d’a priori s’expriment naturellement dans cette formulation. Pour permettre la recherche du modèle CAO optimal, nous proposons une approche basée surdes tentatives d’insertion d’objets générés aléatoirement. L’acceptation ou le rejet de ces objets repose ensuite sur l’am´elioration systématique de la solution en cours de construction. Le modèle CAO se construit ainsi progressivement, par ajout et suppression d’objets, jusqu’à obtention d’une solution localement optimale. / 3D models are often used in order to plan the maintenance of industrial environments.When it comes to the simulation of maintenance interventions, these 3D models have todescribe accurately the actual state of the scenes they stand for. These representationsare usually built from 3D point clouds that are huge set of 3D measurements acquiredin industrial sites, which guarantees the accuracy of the resulting 3D model. Althoughthere exists many works addressing the reconstruction problem, there is no solution toour knowledge which can provide results that are reliable enough to be further used inindustrial applications. Therefore this task is in fact handled by human experts nowadays.This thesis aims at providing a solution automating the reconstruction of industrialsites from 3D point clouds and providing highly reliable results. For that purpose, ourapproach relies on some available a priori knowledge and data about the scene to beprocessed. First, we consider that the 3D models of industrial sites are made of simpleprimitive shapes. Indeed, in the Computer Aided Design (CAD) field, this kind of scenesare described as assemblies of shapes such as planes, spheres, cylinders, cones, tori, . . . Ourown work focuses on planes, cylinders and tori since these three kind of shapes allow thedescription of most of the main components in industrial environment. Furthermore, weset some a priori rules about the way shapes should be assembled in a CAD model standingfor an industrial facility, which are based on expert knowledge about these environments.Eventually, we suppose that a CAD model standing for a scene which is similar to theone to be processed is available. This a priori CAO model typically comes from the priorreconstruction of a scene which looks like the one we are interested in. Despite the factthat they are similar theoretically, there may be significant differences between the sitessince each one has its own life cycle.Our work first states the reconstruction task as a Bayesian problem in which we haveto find the most probable CAD Model with respect to both the point cloud and the a prioriexpectations. In order to reach the CAD model maximizing the target probability, wepropose an iterative approach which improves the solution under construction each time anew randomly generated shape is tried to be inserted in it. Thus, the CAD model is builtstep by step by adding and removing shapes, until the algorithm gets to a local maximumof the target probability.

The thesis deals with the possible use of optical data for modeling forest area compared with utilization of airborne laser scanning data. At first these two datasets are compared and causes of differences are explained. Then canopy height models are made and object-oriented classification is applied for separation of vegetation stands. Methodical procedure is suggested for delineation and detection individual trees in forest. Then their height is detected. There are summarized and other possibilities for improvement in detection and delineation of trees. The results show that optical data with resolution about 25 cm are suitable for dermining the characteristics of the forest stands up to individual tree level. The outputs of this research can be used for forest inventory. Key words: aerial imagery, image matching, laser scanning, point cloud, forest inventory

Nos últimos anos, acompanhar o desenvolvimento de uma cultura tem se tornado cada vez mais imprescindível para a tomada de decisões. Sistemas aéreos remotamente pilotados são muito promissores em aplicações de monitoramento. Sua flexibilidade, facilidade de operação e construção relativamente barata os tornam os melhores candidatos para monitorar atividades na agricultura de precisão, onde as reações imediatas de manejo às doenças das plantas, à falta de nutrientes das plantas e às mudanças ambientais são o ponto focal para eficiência e produtividade das plantações. No entanto, no Brasil a utilização desta tecnologia ainda é limitada e o número de publicações científicas sobre o assunto é escasso. No caso específico da cana-de-açúcar, a utilização de aeronave remotamente pilotada (RPA) é bastante promissora e publicações científicas internacionais são limitadas. O objetivo deste trabalho foi avaliar a potencialidade de imagens obtidas a partir de câmeras com diferentes bandas espectrais embarcadas em RPA para obtenção de modelos tridimensionais para estimativa de altura, produtividade e variabilidade espacial. As coletas foram realizadas ao longo da safra 2014/2015, durante o período de um ano. Foi utilizada uma aeronave remotamente pilotada equipada com uma câmera digital com sensibilidade na região espectral do visível (RGB) e outra na região espectral do infravermelho próximo (IVP) sincronizadas com um sistema de navegação global por satélite (GNSS). Este sistema possibilitou a aquisição de imagens com altíssima resolução (3 cm pixel-1) e permitiu a geração de orto-mosaicos e modelos digitais de superfícies (MDS) através de métodos de reconstrução automática em 3D, ajustados por pontos de controle em solo. O RPA seguiu um plano de voo pré-determinado sobre o local do estudo para garantir a aquisição de imagens com cruzamento e sobreposição superior a 90%. O método de validação foi conduzido a partir das medidas de altura obtidas a campo com o auxílio de régua topográfica. Após o processamento das imagens aéreas foi possível a identificação das áreas com ausência de fechamento de dossel, observando também a relação desses locais com o baixo desenvolvimento da altura das plantas ao longo de seu ciclo. A regressão entre os valores da estimativa de altura obtidas com as simulações apresentou erro relativo inferior a 13%, já a estimativa da produtividade apresentou erro na faixa de 6%. A estimativa de altura e produtividade demonstram o alto potencial para o monitoramento e avaliação de talhões de cana-de-açúcar, podendo ser uma ferramenta utilizada no apoio a gestão destas áreas. / In the last few years, monitoring the development of a culture has become increasingly imperative for decision-making. Remotely piloted aircraft systems (RPA) are very promising in monitoring applications. Their flexibility, ease of operation, and relatively inexpensive construction make them the best candidates to monitor precision farming activities where immediate management responses to plant diseases, lack of plant nutrients, and environmental changes are the focal point for efficiency And productivity of plantations. However in Brazil the use of this technology is still limited and the number of scientific publications on the subject is scarce. In the specific case of sugarcane the use of RPA is very promising and international scientific publications are limited. The objective of this work was to evaluate the potentiality of images obtained from cameras with different spectral bands embedded in RPA to obtain three - dimensional models for estimation of height, productivity and spatial variability. The collections were carried out during the 2014/2015 harvest, during a period of one year, using a remotely piloted aircraft equipped with a digital camera with sensitivity in the visible spectral region (RGB) and another in the near infrared spectral region (NIR) Synchronized with a GNSS. This system allowed the acquisition of images with very high resolution (3 cm pixel-1) allowing the generation of ortho-mosaics and digital surface models (DSM), through automatic 3D reconstruction methods adjusted by control points in soil. The RPA followed a pre-determined flight plan on the study site to ensure cross-over and overlapping acquisition of over 90%. The validation method was carried out from the height measurements obtained in the field with the aid of topography. After the aerial images processing, it was possible to identify the areas of crop failure, also observing the relation of these locations with the low development of plant height throughout its cycle. The regression between the values of the height estimation obtained with the simulations resulted in a relative error of less than 13%. The results obtained demonstrate the high potential of this technique for monitoring and evaluation of sugarcane fields, and can be a tool used to support the management of these areas.

Au cours de ces dernières décennies, le développement de Systèmes Mobiles de Cartographie, soutenu par un progrès technologique important, est devenu plus apparent. Il a été stimulé par le besoin grandissant de collecte d'informations géographiques précises sur l'environnement. Nous considérons, au sein de cette thèse, des solutions pour l'acquisition des nuages de points mobiles de qualité topographique (précision centimétrique). Il s'agit, dans cette tâche, de mettre au point des méthodes de qualification des données, et d'en améliorer sur les erreurs systématiques par des techniques d'étalonnage et de recalage adéquates.Nous décrivons une démarche innovante d'évaluation de l'exactitude et/ou de la précision des relevés laser mobiles. Celle-ci repose sur l'extraction et la comparaison des entités linéaires de la scène urbaine. La distance moyenne calculée entre les segments appariés, étant la distance modifiée de Hausdorff, sert à noter les nuages par rapport à des références existantes. Pour l'extraction des arêtes, nous proposons une méthode de détection d'intersections entre segments plans retrouvés via un algorithme de RANSAC enrichi d'une analyse de composantes connexes. Nous envisageons également une démarche de correction de relevés laser mobiles à travers un recalage rigide fondé, lui aussi, sur les éléments linéaires. Enfin, nous étudions la pertinence des segments pour en déduire les paramètres de l'étalonnage extrinsèque du système mobile. Nous testons nos méthodes sur des données simulées et des données réelles acquises dans le cadre du projet TerraMobilita. / Over the past few decades, the development of land-based Mobile Mapping Systems (MMS), supported by significant technological progress, has become more prominent. It has been motivated by the growing need for precise geographic information about the environment. In this thesis, we consider approaches for the acquisition of mobile point clouds with topographic quality (centimeter-level accuracy). The aim is to develop techniques for data quality assessment and improvement. In particular, we eliminate the systematic errors inherent to an MMS data using appropriate calibration and registration methods.We describe a novel approach to assess the accuracy and/or the precision of mobile laser point clouds. It is based on the extraction and comparison of line features detected within the urban scene. The computed average distance between corresponding pairs of line segments, taking advantage of a modified Hausdorff distance, is used to evaluate the MMS data with respect to a reference data set. For edge extraction, we propose a method which relies on the intersections between planes modelled via the RANSAC algorithm refined by an analysis of connected components. We also consider an approach to correct point clouds using a line-based rigid registration method. Finally, we study the use of line segments for estimating the boresight angles of a land-based mobile mapping system. We apply our methods to synthetic data and to real data acquired as part of the TerraMobilita project.

The forecast of the next upcoming years estimates a growth of demand in transport. As the railway sector in Europe has developed over many years, the infrastructure presents performance issues because of, among other factors, asset maintenance activities being difficult and time consuming. There are currently 4000 railway bridges in Sweden managed by Trafikverket which are submitted to inspections at least every six years. The most common survey is done visually to determine the physical and functional condition of the bridges as well as finding damages that may exist on them. Because visual inspection is a subjective evaluation technique, the results of these bridge inspections may vary from inspector to inspector. The data collection is time consuming and written in standard inspection reports which may not provide sufficient visualization of damages. The inspector also needs to move around the bridge at close distance which could lead to unsafe working conditions. 3D modelling technology is becoming more and more common. Methods such as Close Ranged Photogrammetry (CRP) and Terrestrial Laser Scanning (TLS) are starting to be used for architecture and heritage preservation as well as engineering applications. Infrared (IR) scanning is also showing potential in creating 3D models but has yet not been used for structural analysis and inspections. A result from these methods is a point cloud, a 3D representation of a model in points that can be used for creating as-built Building Information Modeling (BIM)-models. In this study, the authors put these three methods to test to see if IR scanning and CRP are suitable ways, such as TLS is, to gather data for 3D-reconstruction of concrete railway bridges in fast, safe and non-disturbing ways. For this, the three technologies are performed on six bridges chosen by Trafikverket. The further aim is to determine if the 3D-reconstructions can be used for acquiring BIM-information to, among other things, create as-built drawings and to perform structural evaluations. As a result from the study, IR scanning and CRP show great potential as well as TLS in 3D-reconstruction of concrete railway bridges in fast, safe and non-disturbing ways. Still, there is a need of development regarding the technologies before we can start to rely on them completely.

[pt] Esta dissertação faz um estudo sobre a geração de efeitos visuais (VFX) a partir da captura de objetos em movimento como nuvens muito densas de pontos utilizando múltiplas câmeras RGB-D de baixo custo. Para este estudo, são utilizados um software comercial para renderização de partículas e alguns módulos já desenvolvidos pelo Departamento de P&D em VFX da TV Globo em parceria com o laboratório ICAD/VisionLab para a captura simultânea de múltiplas câmeras MS Kinect. No pipeline de produção proposto, um servidor sincroniza os disparos das várias câmeras, unifica as nuvens e gera um arquivo em formato padrão (PRP ou PLY). Este arquivo é, então, utilizado para a renderização de partículas volumétricas com adição de efeitos visuais utilizando o software Krakatoa MX para o 3DS Max. O objetivo é filmar cenas de maneira que o diretor possa posteriormente definir as cenas finais com qualquer trajetória de câmera e adicionar efeitos visuais. / [en] This dissertation is an investigation on the generation of visual effects (VFX) from the capture of moving objects as very dense point clouds using multiple low-cost RGB-D cameras. For this investigation, we use a commercial software for particle rendering and some modules already developed by the Department of VFX R&D of TV Globo in partnership with ICAD/VisionLab laboratory for the simultaneous capture of multiple MS Kinect cameras. In the proposed production pipeline, a server synchronizes the shooting of multiple cameras, unifies the clouds and generates a file in standard format (PRP or PLY). This file is then used for volumetric particle rendering with added visual effects using the Krakatoa MX software for 3DS Max. The goal is to shoot scenes in such a way that the film director can later define the final scenes with any camera path and adding visual effects.