The goal of this work is to examine the possibility of surface reconstruction from the images produced by the Tobii H5 eye tracker. It starts of by examining classic photometric stereo and its limitations under the illuminator configuration of the eye tracker. It then proceeds to investigate two alternative solutions: photometric stereo under the assumption that the albedo is known and a method that uses the images from the eye tracker as a guide to mold a reference model into the users face. In the second method the pose of the reference model is estimated by minimizing a photometric error under the assumption that the face is Lambertian, using particle swarm optimization. The position of the generic 3D model is then used in an attempt to mold its shape into the face of the user using shape-from-shading.

There are several methods avaliable to find areas of interest, but most fail at detecting such areas in cluttered scenes. In this paper two methods will be presented and tested in a qualitative perspective. The first is the darg operator, which is used to detect three dimensional convex or concave objects by calculating the derivative of the argument of the gradient in one direction of four rotated versions. The four versions are thereafter added together in their original orientation. A multi scale version is recommended to avoid the problem that the standard deviation of the Gaussians, combined with the derivatives, controls the scale of the object, which is detected. Another feature detected in this paper is rotational symmetries with the help of approximative polynomial expansion. This approach is used in order to minimalize the number and sizes of the filters used for a correlation of a representation of the orientation and filters matching the rotational symmetries of order 0, 1 and 2. With this method a particular type of rotational symmetry can be extracted by using both the order and the orientation of the result. To improve the method’s selectivity a normalized inhibition is applied on the result, which causes a much weaker result in the two other resulting pixel values when one is high. Both methods are not enough by themselves to give a definite answer to if the image consists of an area of interest or not, since several other things have these types of features. They can on the other hand give an indication where in the image the feature is found.

No description available.

No description available.

The thesis deals with incorporating the shape-from-shading technique into the multi-view stereo (MVS) reconstruction framework using the Oren-Nayar reflectance model for rough natural materials. Two methods for enhancing the MVS algorithm with new photo-consistency measure are proposed. Experiments with the laboratory images as well as with images of Mars's surface were conducted, proving that the proposed plane-sweeping method using shading information suitable for combining with MVS can nd the correct position of surface in 3D scene. The experiments also showed, that the Oren-Nayar reflectance model is very accurate for some real-world materials and it can be succesfuly used in the plane-sweeping method to accomplish better results than the Lambert's reflectance model. With precisely estimated material parameters and the light source and camera directions, it is possible to achieve the accuracy of few centimeters in estimating the position of real surface in the scene. / <p>Validerat; 20110825 (anonymous)</p>

Comprendre, analyser et modéliser l'environment 3D à partir d'images provenant de caméras et d'appareils photos est l'un des défis majeurs actuel de recherche en vision par ordinateur. Cette thèse s'interesse à plusieurs aspects géométriques et photometriques liés à la reconstruction de surface à partir de plusieurs caméras calibrées. La reconstruction 3D est vue comme un problème de rendu inverse, et vise à minimiser une fonctionnelle d'énergie afin d'optimiser un maillage triangulaire représentant la surface à reconstruire. L'énergie est définie via un modèle génératif faisant naturellement apparaître des attributs tels que la visibilité ou la photométrie. Ainsi, l'approche présentée peut indifférement s'adapter à divers cas d'application tels que la stéréovision multi-vues, la stéréo photométrique multi-vues ou encore le “shape from shading” multi-vues. Plusieurs approches sont proposées afin de résoudre les problèmes de correspondances de l'apparence pour des scènes non Lambertiennes, dont l'apparence varie en fonction du point de vue. La segmentation, la stéréo photométrique ou encore la réciprocité d'Helmholtz sont des éléments étudiés afin de contraindre la reconstruction. L'exploitation de ces contraintes dans le cadre de reconstruction multi-vues permet de reconstruire des modèles complets 3D avec une meilleure qualité. / Understanding, analyzing and modeling the 3D world from 2D pictures and videos is probably one of the most exciting and challenging problem of computer vision. In this thesis, we address several geometric and photometric aspects to 3D surface reconstruction from multi-view calibrated images. We first formulate multi-view shape reconstruction as an inverse rendering problem. Using generative models, we formulate the problem as an energy minimization method that leads to the non-linear surface optimization of a deformable mesh. A particular attention is addressed to the computation of the discrete gradient flow, which leads to coherent vertices displacements. We particularly focus on models and energy functionals that depend on visibility and photometry. The same framework can then be equally used to perform multi-view stereo, multi-view shape from shading or multi-view photometric stereo. Then, we propose to exploit different additional information to constraint the problem in the non-Lambertian case, where the appearance of the scene depends on the view-point direction. Segmentation for instance can be used to segment surface regions sharing similar appearance or reflectance. Helmholtz reciprocity can also be applied to reconstruct 3D shapes of objects of any arbitrary reflectance properties. By taking multiple image-light pairs around an object, multi-view Helmholtz stereo can be performed. Using this constrained acquisition scenario and our deformable mesh framework, it is possible to reconstruct high quality 3D models.

<p>Human viewers are extremely sensitive to the appearanceof peoples faces, which makes the rendering of realistic human faces a challenging problem. Techniques for doing this have continuously been invented and evolved since more than thirty years. </p><p>This thesis makes use of recent methods within the area of image based rendering, namely the acquisition of reflectance fields from human faces. The reflectance fields are used to synthesize and realistically render models of human faces. </p><p>A shape from shading technique, assuming that human skin adheres to the Phong model, has been used to estimate surface normals. Belief propagation in graphs has then been used to enforce integrability before reconstructing the surfaces. Finally, the additivity of light has been used to realistically render the models. </p><p>The resulting models closely resemble the subjects from which they were created, and can realistically be rendered from novel directions in any illumination environment.</p>

Comprendre, analyser et modéliser l'environment 3D à partir d'images provenant de caméras et d'appareils photos est l'un des défis majeurs actuel de recherche en vision par ordinateur. Cette thèse s'interesse à plusieurs aspects géométriques et photometriques liés à la reconstruction de surface à partir de plusieurs caméras calibrées. La reconstruction 3D est vue comme un problème de rendu inverse, et vise à minimiser une fonctionnelle d'énergie afin d'optimiser un maillage triangulaire représentant la surface à reconstruire. L'énergie est définie via un modèle génératif faisant naturellement apparaître des attributs tels que la visibilité ou la photométrie. Ainsi, l'approche présentée peut indifférement s'adapter à divers cas d'application tels que la stéréovision multi-vues, la stéréo photométrique multi-vues ou encore le "shape from shading" multi-vues. Plusieurs approches sont proposées afin de résoudre les problèmes de correspondances de l'apparence pour des scènes non Lambertiennes, dont l'apparence varie en fonction du point de vue. La segmentation, la stéréo photométrique ou encore la réciprocité d'Helmholtz sont des éléments étudiés afin de contraindre la reconstruction. L'exploitation de ces contraintes dans le cadre de reconstruction multi-vues permet de reconstruire des modèles complets 3D avec une meilleure qualité.

Human viewers are extremely sensitive to the appearanceof peoples faces, which makes the rendering of realistic human faces a challenging problem. Techniques for doing this have continuously been invented and evolved since more than thirty years. This thesis makes use of recent methods within the area of image based rendering, namely the acquisition of reflectance fields from human faces. The reflectance fields are used to synthesize and realistically render models of human faces. A shape from shading technique, assuming that human skin adheres to the Phong model, has been used to estimate surface normals. Belief propagation in graphs has then been used to enforce integrability before reconstructing the surfaces. Finally, the additivity of light has been used to realistically render the models. The resulting models closely resemble the subjects from which they were created, and can realistically be rendered from novel directions in any illumination environment.

Four studies including ten experiments adresses interrelations between some major and classical issues in visual perception: 3-D perception, colour constancy, colour perception and colour vision deficiencies. The main experimental paradigm to investigate the issues is within that of simulated shape from shading. 3-D impressions are induced by projecting space-modulated illuminations onto flat surfaces (displays), varying the colours and layout of the displays and the colour and modulation of the illumination. Study I includes four experiments investigating three types of space- modulated illumination. All experiments confirmed earlier findings that chromatic colour and complex display layout with reflectance edges crossed by illumination edges enhances shape from shading. In Study II the impressions of shape from shading and real 3-D objects were compared between persons with deutan colour vision deficiencies and normals. As predicted, the deutans show fewer and less distinct 3-D impressions in situations with their specific "problem colours" red and green. They also show a generally lower tendency for 3-D impressions, interpreted as a generally weaker colour constancy. Study III presents the AMBEGUJAS phenomenon; a novel twofold ambiguous shape from shading situation, continuously alternating between two different 3-D impressions coupled with different colour attributions. One solution is of an object with two clear surface colours, the other one of an object with greyish (desaturated) colours in coloured illumination which means classical colour constancy. The phenomenon illustrates the visual processes of separating reflectance and illumination characteristics and may provide a useful experimental setting to study colour constancy. In Study IV the AMBEGUJAS phenomenon is found to be robust as to chromaticness and different luminance contrasts for both normals and deutans. However, the deutans show slower shifts between percepts and a less pronounced desaturation of colour, which indicates a weaker colour constancy. The studies add evidence to the contribution of colour to 3-D shape perception, validated in a novel way by the results on "colour-blinds". The AMBEGUJAS phenomenon provides further support that the factors affecting shape from shading and the deutans different impressions are to be understood with reference to colour constancy. The deutans different impressions compared to normals are remarkable per se, but probably with very limited implications to everyday life. / <p>Diss. (sammanfattning) Umeå : Umeå university, 1996, härtill 4 uppsatser</p> / digitalisering@umu