Submitted by Renata Lopes (renatasil82@gmail.com) on 2017-03-02T14:44:36Z No. of bitstreams: 1 rogercorreiapinheirosilva.pdf: 22838442 bytes, checksum: 0bd115f462fc7572058a542e9ed91fcc (MD5) / Approved for entry into archive by Adriana Oliveira (adriana.oliveira@ufjf.edu.br) on 2017-03-06T19:52:42Z (GMT) No. of bitstreams: 1 rogercorreiapinheirosilva.pdf: 22838442 bytes, checksum: 0bd115f462fc7572058a542e9ed91fcc (MD5) / Made available in DSpace on 2017-03-06T19:52:42Z (GMT). No. of bitstreams: 1 rogercorreiapinheirosilva.pdf: 22838442 bytes, checksum: 0bd115f462fc7572058a542e9ed91fcc (MD5) Previous issue date: 2011-08-26 / CAPES - Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Um sistema câmera-projetor é capaz de capturar informação geométrica tridimensional de objetos e ambientes do mundo real. A captura de geometria em tal sistema baseia-se na projeção de luz estruturada sobre um objeto através do projetor, e na captura da cena modulada através da câmera. Com o sistema previamente calibrado, a deformação da luz projetada causada pelo objeto fornece a informação necessária para reconstruir a geometria do mesmo por meio de triangulação. Este trabalho descreve o desenvolvimento de um digitalizador câmera-projetor de alta definição (com resoluções de até 1920x1080 e 1280x720); são detalhadas as etapas e processos que conduzem à reconstrução de geometria, como calibração câmera-projetor, calibração de cores, processamento da imagem capturada e triangulação. O digitalizador desenvolvido utiliza a codificação de luz estruturada (b; s)-BCSL, que emprega a projeção de uma sequência de faixas verticais coloridas sobre a cena. Este esquema de codificação flexível oferece um número variado de faixas para projeção: quanto maior o número de faixas, mais detalhada a geometria capturada. Um dos objetivos deste trabalho é estimar o número limite de faixas (b,s)-BCSL possível dentro das resoluções atuais de vídeo de alta definição. Este número limite é aquele que provê reconstrução densa da geometria alvo, e ao mesmo tempo possui baixo nível de erro. Para avaliar a geometria reconstruída pelo digitalizador para os diversos números de faixas, é proposto um protocolo para avaliação de erro. O protocolo desenvolvido utiliza planos como objetos para mensurar a qualidade de reconstrução geométrica. A partir da nuvem de pontos gerada pelo digitalizador, a equação do plano para a mesma é estimada por meio de mínimos quadrados. Para um número fixo de faixas, são feitas cinco digitalizações independentes do plano: cada digitalização leva a uma equação; também é computado o plano médio, estimado a partir da união das cinco nuvens de pontos. Uma métrica de distância no espaço projetivo é usada para avaliar a precisão e a acurácia de cada número de faixas projetados. Além da avaliação quantitativa, a geometria de vários objetos é apresentada para uma avaliação qualitativa. Os resultados demonstram que a quantidade de faixas limite para vídeos de alta resolução permite uma grande densidade de pontos mesmo em superfícies com alta variação de cores. / A camera-projector system is capable of capturing three-dimensional geometric information of objects and real-world environments. The capture of geometry in such system is based on the projection of structured light over an object by the projector, and the capture of the modulated scene through the camera. With a calibrated system, the deformation of the projected light caused by the object provides the information needed to reconstruct its geometry through triangulation. The present work describes the development of a high definition camera-projector system (with resolutions up to 1920x1080 and 1280x720). The steps and processes that lead to the reconstruction of geometry, such as camera-projector calibration, color calibration, image processing and triangulation, are detailed. The developed scanner uses the (b; s)-BCSL structured light coding, which employs the projection of a sequence of colored vertical stripes on the scene. This coding scheme offers a flexible number of stripes for projection: the higher the number of stripes, more detailed is the captured geometry. One of the objectives of this work is to estimate the limit number of (b; s)-BCSL stripes possible within the current resolutions of high definition video. This limit number is the one that provides dense geometry reconstruction, and at the same has low error. To evaluate the geometry reconstructed by the scanner for a different number of stripes, we propose a protocol for error measurement. The developed protocol uses planes as objects to measure the quality of geometric reconstruction. From the point cloud generated by the scanner, the equation for the same plane is estimated by least squares. For a fixed number of stripes, five independent scans are made for the plane: each scan leads to one equation; the median plane, estimated from the union of the five clouds of points, is also computed. A distance metric in the projective space is used to evaluate the precision and the accuracy of each number of projected stripes. In addition to the quantitative evaluation, the geometry of many objects are presented for qualitative evaluation. The results show that the limit number of stripes for high resolution video allows high density of points even on surfaces with high color variation.

Measuring 3D surface geometry with precision and accuracy is an important part of many engineering and scientific tasks. 3D Scanning techniques measure surface geometry by estimating the locations of sampled surface points. In recent years, Structured-Light 3D scanners have gained significant popularity owing to their ability to produce highly accurate scans in real-time at a low cost. In this thesis we describe an approach for Structured-Light 3D scanning using a digital camera and a digital projector. We utilise the projective geometric relationships between the projector and the camera to carry out both an implicit calibration of the system and to solve for 3D structure. Our approach to geometric calibration is flexible, reliable and amenable to robust estimation. In addition, we model and account for the radiometric non-linearities in the projector such as gamma distortion. Finally, we apply a post-processing step to efficiently smooth out high-frequency surface noise while retaining the structural details. Consequently, the proposed work reduces the computational load and set-up time of a Structured-Light 3D scanner; thereby speeding up the whole scanning process while retaining the ability to generate highly accurate results. We demonstrate the accuracy of our scanning results on real-world objects of varying degrees of surface complexity. Introduction The projective geometry for a pair of pin-hole viewing devices is completely defined by their intrinsic calibration and their relative motion or extrinsic calibration in the form of matrices. For a Euclidean reconstruction, the geometry elements represented by the calibration matrices must be parameterised and estimated in some form. The use of a projector as the ‘second viewing’ device has led to numerous approaches to model and estimate its intrinsic parameters and relative motion with respect to the camera's 3D co-ordinate system. Proposed thesis work assimilates the benefits of projective geometry constructs such as Homography and the invariance of the cross-ratios to simplify the system calibration and the 3D estimation processes by an implicit modeling of the projector's intrinsic parameters and its relative motion. Though linear modeling of the projective geometry between a camera-projector view-pair captures the most essential aspects of the underlying geometry, it does not accommodate system non-linearities due to radiometric distortions of a projector device. We propose an approach that uses parametric splines to model the systematic errors introduced by radiometric non-linearities and thus correct for them. For 3D surfaces reconstructed as point-clouds, noise manifests itself as some high-frequency variations for the resulting mesh. Various pre and/or post processing techniques are proposed in the literature to model and minimize the effects of noise. We use simple bilateral filtering of the depth-map for the reconstructed surface to smoothen the surface while retaining its structural details. Modeling Projective Relations In our approach for calibrating the projective-geometric structure of a projector-camera view-pair, the frame of reference for measurements is attached to the camera. The camera is calibrated using a commonly used method. To calibrate the scanner system, one common approach is to project sinusoidal patterns onto the reference planes to generate reference phase maps. By relating the phase-information between the projector and image pixels, a dense mapping is obtained. However, this is an over-parameterisation of the calibration information. Since the reference object is a plane, we can use the projective relationships induced by a plane to implicitly calibrate the projector geometry. For the estimation of the three-dimensional structure of the imaged object, we utilise the invariance of cross-ratios along with the calibration information of two reference planes. Our formulation is also extensible to utilise more than two reference plane to compute more than one estimate of the location of an unknown surface point. Such estimates are amenable to statistical analysis which allows us to derive both the shape of an object and associate reliability scores to each estimated point location. Radiometric Correction Structured-light based 3D scanners commonly employ phase-shifted sinusoidal patterns to solve for the correspondence problem. For scanners using projective geometry between a camera and a projector, the projector's radiometric non-linearities introduce systematic errors in establishing correspondences. Such errors manifest as visual artifacts which become pronounced when fewer phase-shifted sinusoidal patterns are used. While these artifacts can be avoided by using a large number of phase-shifts, doing so also increases the acquisition time. We propose to model and rectify such systematic errors using parametric representations. Consequently, while some existing methods retain the complete reference phase maps to account for such distortions, our approach describes the deviations using a few model parameters. The proposed approach can be used to reduce the number of phase-shifted sinusoidal patterns required for codification while suppressing systematic artifacts. Additionally, our method avoids the 1D search steps that are needed when a complete reference phase map is used, thus reducing the computational load for 3D estimation. The effectiveness of our method is demonstrated with reconstruction of some geometric surfaces and a cultural figurine. Filtering Noise For a structured-light 3D scanner, various sources of noise in the environment and the devices lead to inaccuracies in estimating the codewords (phase map) for an unknown surface, during reconstruction. We examine the effects of such noise factors on our proposed methods for geometric and radiometric estimation. We present a quantitative evaluation for our proposed method by scanning the objects of known geometric properties or measures and then computing the deviations from the expected results. In addition, we evaluate the errors introduced due to inaccuracies in system calibration by computing the variance statistics from multiple estimates for the reconstructed 3D points, where each estimate is computed using a different pair of reference planes. Finally, we discuss the efficacy of certain filtering techniques in reducing the high-frequency surface noise when applied to: (a) the images of the unknown surface at a pre-processing stage, or (b) the respective phase (or depth) map at a post-processing stage. Conclusion In this thesis, we motivate the need for a procedurally simple and computationally less demanding approach for projector calibration. We present a method that uses homographies induced by a pair of reference planes to calibrate a structured-light scanner. By using the projective invariance of the cross-ratio, we solved for the 3D geometry of a scanned surface. We demonstrate the fact that 3D geometric information can be derived using our approach with accuracy on the order of 0.1 mm. Proposed method reduces the image acquisition time for calibration and the computational needs for 3D estimation. We demonstrate an approach to effectively model radiometric distortions for the projector using cubic splines. Our approach is shown to give significant improvement over the use of complete reference phase maps and its performance is comparable to that of a sate-of-the-art method, both quantitatively as well as qualitatively. In contrast with that method, proposed method is computationally less expensive, procedurally simpler and exhibits consistent performance even at relatively higher levels of noise in phase estimation. Finally, we use a simple bilateral filtering on the depth-map for the region-of-interest. Bilateral filtering provides the best trade-off between surface smoothing and the preservation of its structural details. Our filtering approach avoids computationally expensive surface normal estimation algorithms completely while improving surface fidelity.

The aim of this master’s thesis is to give information about the thermo camera measurement with error minimization. The basic concepts of thermography are explained with an implementation of postprocesing technique which uses graphically modified thermogram back projected to the scene. This is closely related to the scene design, calibration of thermal camera with projector, image rectification, thermogram processing with highlighting of interesting information and implementation of control elements as the user interface. The results obtained are analyzed and re-evaluated.

In this work I have been briefed by physiology of binocular vision for acquisition of three-dimensional perception from two-dimensional images using special glasses. At first I described optical organ, after it I described physiology of binocular vision. In the next part of my work I described stereoscopic imaging technology and their advantages and disadvantages. In the next part of this work I have designed method for measuring ideal distance between cameras for scanning and projection of stereoscopic image using program Inition StereoBrain Calculator. After scenes design I have collected visual data for creating 3D videos. This videos were been projected to the group of the viewers. Data from the viewers were been analyzed afterwards.

This thesis falls into a field of user interface design. It focuses on tangible user interfaces which utilize a camera and projector to augment physical objects with a digital information. It also includes description of calibration of those devices. The primary object of this thesis is the implementation of an augmented user interface for application windows management. The system consists of a stationary camera, overhead projector and movable tangible objects - boards. The boards are equipped with fiducial markers, in order to be tracked in a camera image. The projector displays the conventional desktop onto the table and the tangible objects. For example, application windows can be projected onto some boards, while the windows move and rotate simultaneously with the boards.

The focus of this thesis is the cooperation of cameras and projectors in projection of data into a scene. It describes the means and theory necessary to achieve such cooperation, and suggests tasks for demonstration. A part of this project is also a program capable of using a camera and a projector to obtain necessary parameters of these devices. The program can demonstrate the quality of this calibration by projecting a pattern onto an object according to its current pose, as well as reconstruct the shape of an object with structured light. The thesis also describes some challenges and observations from development and testing of the program.

La Réalité Augmentée Spatiale (SAR) vise à superposer spatialement l'information virtuelle sur des objets physiques. Au cours des dernières décennies ce domaine a connu une grande expansion et est utilisé dans divers domaines, tels que la médecine, le prototypage, le divertissement etc. Cependant, pour obtenir des projections de bonne qualité, on doit résoudre plusieurs problèmes, dont les plus importants sont la gamme de couleurs réduite du projecteur, la lumière ambiante, la couleur du fond, et la configuration arbitraire de la surface de projection dans la scène. Ces facteurs entraînent des distorsions dans les images qui requièrent des processus de compensation complémentaires.Les projections intelligentes (smart projections) sont au cœur des applications de SAR. Composées d'un dispositif de projection et d'un dispositif d'acquisition, elles contrôlent l'aspect de la projection et effectuent des corrections à la volée pour compenser les distorsions. Bien que les méthodes actives de Lumière Structurée aient été utilisées classiquement pour résoudre ces problèmes de compensation géométrique, cette thèse propose une nouvelle approche non intrusive pour la compensation géométrique de plusieurs surfaces planes et pour la reconnaissance des objets en SAR s'appuyant uniquement sur la capture du contenu projeté.Premièrement, cette thèse étude l'usage de l'invariance couleur pour améliorer la qualité de la mise en correspondance entre primitives dans une configuration d'acquisition des images vidéoprojetées. Nous comparons la performance de la plupart des méthodes de l'état de l'art avec celle du descripteur proposé basé sur l'égalisation d'histogramme. Deuxièmement, pour mieux traiter les conditions standard des systèmes projecteur-caméra, deux ensembles de données de captures de projections réelles, ont été spécialement préparés à des fins expérimentales. La performance de tous les algorithmes considérés est analysée de façon approfondie et des propositions de recommandations sont faites sur le choix des algorithmes les mieux adaptés en fonction des conditions expérimentales (paramètres image, disposition spatiale, couleur du fond...). Troisièmement, nous considérons le problème d'ajustement multi-surface pour compenser des distorsions d'homographie dans les images acquises. Une combinaison de mise en correspondance entre les primitives et de Flux Optique est proposée afin d'obtenir une compensation géométrique plus rapide. Quatrièmement, une nouvelle application en reconnaissance d'objet à partir de captures d'images vidéo-projetées est mise en œuvre. Finalement, une implémentation GPU temps réel des algorithmes considérés ouvre des pistes pour la compensation géométrique non intrusive en SAR basée sur la mise en correspondances entre primitives. / Spatial Augmented Reality (SAR) aims at spatially superposing virtual information on real-world objects. Over the last decades, it has gained a lot of success and been used in manifold applications in various domains, such as medicine, prototyping, entertainment etc. However, to obtain projections of a good quality one has to deal with multiple problems, among them the most important are the limited projector output gamut, ambient illumination, color background, and arbitrary geometric surface configurations of the projection scene. These factors result in image distortions which require additional compensation steps.Smart-projections are at the core of PAR applications. Equipped with a projection and acquisitions devices, they control the projection appearance and introduce corrections on the fly to compensate distortions. Although active structured-light techniques have been so far the de-facto method to address such problems, this PhD thesis addresses a relatively new unintrusive content-based approach for geometric compensation of multiple planar surfaces and for object recognition in SAR.Firstly, this thesis investigates the use of color-invariance for feature matching quality enhancement in projection-acquisition scenarios. The performance of most state-of-the art methods are studied along with the proposed local histogram equalization-based descriptor. Secondly, to better address the typical conditions encountered when using a projector-camera system, two datasets of real-world projections were specially prepared for experimental purposes. Through a series of evaluation frameworks, the performance of all considered algorithms is thoroughly analyzed, providing several inferences on that which algorithms are more appropriate in each condition. Thirdly, this PhD work addresses the problem of multiple-surface fitting used to compensate different homography distortions in acquired images. A combination of feature matching and Optical Flow tracking is proposed in order to achieve a more low-weight geometric compensation. Fourthly, an example of new application to object recognition from acquired projections is showed. Finally, a real-time implementation of considered methods on GPU shows prospects for the unintrusive feature matching-based geometric compensation in SAR applications.

Cette thèse développe de nouvelles approches pour l'effacement et la révélation de la présence humaine en utilisant des techniques de réalité augmentée. Elle se concentre sur les systèmes projecteur-caméra (ProCams) et leur application dans les «projections intelligentes», où le contenu virtuel projeté est adapté en fonction de l'environnement. Nous nous appuyons sur les travaux antérieurs sur la compensation photométrique pour projeter sur une surface colorée fixe qui permet au spectateur d'observer la même image telle qu'elle apparaîtrait sur une surface blanche. Malgré les différentes méthodes de compensation des couleurs qui ont été proposées au cours de décennie, la compensation appliquée à monde réel avec des couleurs saturées et vives est encore une question ouverte. L'objectif principal de ce travail est la compensation photométrique sur un objet 3D en mouvement en utilisant un ProCam, ce qui est un scénario considérablement plus difficile. Une nouvelle méthode pour la compensation de couleur à l'aide d'une image d'entrée unique est proposée. Elle consiste à estimer la réflectance spectrale de la surface afin de compenser celle-ci en supposant que les réponses du projecteur sont connues ou mesurées précédemment. Cette méthode a été entièrement développée sur GPU pour permettre une compensation en temps réel. Les méthodes antérieures sur la compensation couleur sont discutées et comparées afin d'évaluer la performance de notre technique. L'étalonnage photométrique et géométrique précis d'un ProCam est essentiel pour une compensation précise. Une nouvelle technique de calibration géométrique entre un capteur de profondeur et un ProCam est présentée dans le but de réaliser la projection sur un objet en mouvement. Une calibration photométrique est décrite pour la transformation des valeurs RGB de la caméra et du projecteur (dépendantes du périphérique) vers l'espace couleur CIE XYZ 1931 (indépendantes du périphérique). Le potentiel artistique des techniques de réalité augmentée proposées est en outre exploré à travers l'installation interactive artistique “Gardien du Temple”. La révélation et l'effacement ont toujours été un terrain d'expérimentation commun aux artistes et aux scientifiques. Cette installation audiovisuelle utilise la réalité augmentée pour effacer la présence d'un poème écrit sur un tapis invitant le spectateur à le révéler. Dans de telles applications, la précision et la robustesse des méthodes utilisées sont cruciales. Cette installation artistique a donc permis de tester et d'évaluer les travaux de cette thèse dans un contexte collaboratif et exigeant. / This thesis develops new approaches for human presence concealment and revelation using augmented reality techniques. It focuses on projector-camera systems (ProCams) and their application in “smart projections”, where the projected virtual content is adapted according to the environment. One previously-studied problem is the photometric compensation for projecting on a colored fixed surface that allows the viewer to observe the same image as it would appear on a white surface. Despite the various methods for color compensation that have been proposed the last decade, compensation on a real-world surface with saturated colors and sharp color boundaries is still an open issue. The main objective of this work is the color compensation on a moving 3D object using a ProCam, which is a dramatically more challenging scenario. A novel method for color compensation using a single input frame is proposed. It consists in estimating the spectral reflectance of the surface in order to compensate for it under the assumption that the projector responses are known or previously measured. This method was fully developed on GPU to enable real-time compensation. Previous methods on color compensation are discussed and compared in order to evaluate the performance of our technique. The accurate photometric and geometric calibration of a ProCam is essential for precise compensation. A new geometric calibration technique between a depth sensor and a ProCam is presented in order to make the projection on a moving object feasible. A photometric calibration is described for the transformation of the device-dependent camera and projector values to the device-independent CIE XYZ 1931 color space. The artistic potential of the proposed augmented reality techniques is further explored through the interactive art installation “Gardien du Temple”. Revelation and concealment has always been a common experimentation ground for both artists and scientists. This audio visual installation uses augmented reality to hide the presence of a written poem on a carpet inviting the spectator to reveal it. In such applications, the accuracy and robust performance of the methods employed is crucial and, thus, it offered a challenging ground for testing and evaluation.

No description available.

Syftet med denna studie är att få mer kunskap om användandet av digitala verktyg vid undervisning av problemlösning i inom matematik i årskurs 1–3. Studien är av kvalitativ karaktär med en induktiv ansats som tar utgångspunkt i det sociokulturella perspektivet. Semistrukturerade intervjuer har genomförts med fyra verksamma lärare som använder digitala verktyg vid undervisning av problemlösning. Resultatet påvisar att lärarna använder iPad, dator, smartboard samt projektor genom att utnyttja dessa i samspel med olika appar och plattformar. Vidare används digitala verktyg vid genomgångar av uppgifter i problemlösning. Lärarna framför en positiv inställning till digitala verktyg där samtliga uttrycker den vardagsanknytning digitala verktyg besitter, vilket motiverar eleverna. Samtidigt framgår vissa hinder med att använda digitala verktyg i undervisning av problemlösning. / The purpose of this study is to get a deeper understanding of the implementation of digital technology in mathematical problem-solving, targeting teachers in grades 1-3. The study is qualitative with an inductive approach. Four semi-structured interviews were conducted with teachers using digital technology during problem-solving. A qualitative content analysis was conducted on data collected, with the sociocultural perspective as a point of departure. The result showed that teachers use iPad, computers, smartboards, and projectors interplaying with different mathematical applications and platforms. The teachers frequently use digital technology during presentations of mathematical problem-solving in the classroom. The results also showed that the teachers are positive towards digital technology and the connection to everyday situations, which can motivate the pupils. However, the teachers also describe some obstacles when teaching problem-solving in regard to digital technology in the classroom.