La qualité d’une prise de vue est un point incontournable dans la résolution des problèmes d’imagerie. Un capteur non adapté, un éclairage non contrôlé, ou des conditions variables de la scène observée peuvent être à l’origine de problèmes très difficiles à surmonter. Nous présentons différentes méthodes de traitement d’image permettant de prendre en compte au mieux ces conditions de prise de vue instables. Les approches que nous proposons sont définies dans le cadre du modèle LIP (Logarithmic Image Processing). Dans une première partie, nous nous intéressons à des notions de contraste : le contraste LIP additif et un nouveau contraste LIP multiplicatif, ainsi qu’à leurs métriques associées. De nouveaux outils de traitement basés sur ces notions sont ensuite définis : seuillage, détecteur de contours, reconnaissance de modèle. L’utilisation de ces notions de contraste confère à ces algorithmes la capacité des contrastes LIP à s’adapter à différents types d’images mal conditionnées. Nous proposons ensuite de nouvelles techniques de correction de dynamique d’images en exploitant les opérations LIP. Différentes corrections globales et locales sont présentées ainsi que leurs applications directes : correction de dérive d’éclairement pour du contrôle industriel ou amélioration d’image pour de la visualisation. Nous obtenons notamment une méthode de correction locale dont les résultats se rapprochent de ceux de certaines techniques de tone mapping. En comparaison, notre technique s’avère simple, rapide (temps réel à 30 images par seconde) et réaliste car basée sur une interprétation physique de la problématique / The quality of image acquisitions is crucial in the resolution of imaging problems. Troubles during acquisiton can lead to unstability for image processing algorithms. We propose different methods (thresholding techniques, contour detection, pattern matching) based on new metrics and contrasts in the LIP context. The LIP (Logarithmic Image Processing) model is recognized as an efficient framework to process images acquired in transmitted light and to take into account the human visual system. LIP operations are also useful to simulate varitations of image parameters in situation of reflected light. Finally, we propose new methods of global and local dynamic enhancement in the LIP framework like a real time and realistic local dynamic correction that brings results close to those obtained by certain tone mapping methods

Enhancing low light videos has been quite a challenge over the years. A video taken in low light always has the issues of low dynamic range and high noise. This master thesis presents contribution within the field of low light video enhancement. Three models are proposed with different tone mapping algorithms for extremely low light low quality video enhancement. For temporal noise removal, a motion compensated kalman structure is presented. Dynamic range of the low light video is stretched using three different methods. In Model 1, dynamic range is increased by adjustment of RGB histograms using gamma correction with a modified version of adaptive clipping thresholds. In Model 2, a shape preserving dynamic range stretch of the RGB histogram is applied using SMQT. In Model 3, contrast enhancement is done using CLAHE. In the final stage, the residual noise is removed using an efficient NLM. The performance of the models are compared on various Objective VQA metrics like NIQE, GCF and SSIM. To evaluate the actual performance of the models subjective tests are conducted, due to the large number of applications that target humans as the end user of the video.The performance of the three models are compared for a total of ten real time input videos taken in extremely low light environment. A total of 25 human observers subjectively evaluated the performance of the three models based on the parameters: contrast, visibility, visually pleasing, amount of noise and overall quality. A detailed statistical evaluation of the relative performance of the three models is also provided.

Operadores de tone mapping reverso (RTMOs) realçam imagens e vídeos de baixa faixa dinâmica para visualização em monitores de alta faixa dinâmica. Um problema comum encontrado por operadores anteriores é a maneira com que tratam conteúdo sub ou superexposto. Sob tais condições, eles podem não ser eficientes, e até mesmo causar perda e reversão de contraste visível. Apresentamos uma classe de operadores de tone mapping reverso, baseados no filtro bilateral cruzado (cross bilateral filter), capazes de gerar imagens HDR de alta qualidade. Experimentos utilizando uma métrica objetiva de avaliação de imagens demostram que nosso método é a única técnica capaz de realçar detalhes perceptíveis ao longo de uma grande gama de exposições de imagem, a qual inclui desde imagens subexpostas até imagens superexpostas. / Reverse tone mapping operators (rTMOs) enhance low-dynamic-range images and videos for display on high dynamic range monitors. A common problem faced by previous rTMOs is the handling of under or overexposed content. Under such conditions, they may not be effective, and even cause loss and reversal of visible contrast. We present a class of local rTMOs based on cross bilateral filtering that is capable of generating highquality HDR images and videos for a wide range of exposure conditions. Experiments performed using an objective image quality metric show that our approach is the only single technique available that can gracefully enhance perceived details across a large range of image exposures.

<p>As real time visualizations become more realistic it also becomes more important to simulate the perceptual effects of the human visual system. Such effects include the response to varying illumination, glare and differences between photopic and scotopic vision. This thesis evaluates several different tone mapping methods to allow a greater dynamic range to be used in real time visualisations. Several tone mapping methods have been implemented in the Avalanche Game Engine and evaluated using a small test group. To increase immersion in the visualization several filters aimed to simulate perceptual effects has also been implemented. The primary goal of these filters is to simulate scotopic vision. The tests showed that two tone mapping methods would be suitable for the environment used in the tests. The S-curve tone mapping method gave the best result while the Mean Value method gave good results while being the simplest to implement and the cheapest. The test subjects agreed that the simulation of scotopic vision enhanced the immersion in a visualization. The primary difficulties in this work has been lack of dynamic range in the input images and the challenges in coding real time graphics using a graphics processing unit.</p>

We enhance photographs shot in dark environments by combining a picture taken with the available light and one taken with the flash. We preserve the ambiance of the original lighting and insert the sharpness from the flash image. We use the bilateral filter to decompose the images into detail and large scale. We reconstruct the image using the large scale of the available lighting and the detail of the flash. We detect and correct flash shadows. This combines the advantages of available illumination and flash photography. / Singapore-MIT Alliance (SMA)

With the growing demand of embedded graphics applications, how to provide an efficient graphics hardware acceleration solution has drawn much attention. It is well known that computer graphics contains two major domains: two-dimensional (2D) and three-dimensional (3D) graphics. Each domain owns large amounts of applications, such that general embedded platforms will require both graphics acceleration supports. This thesis proposes an advanced texture unit architecture which can provide various 3D texture filtering functions including trilinear, anistrophics filtering etc , and 2D coloring, painting, and texturing functions. Our proposed design consists of a core computation unit, and a set of data registers. The equations for those supported functions are decomposed into a series of basic arithmetic operations such as multiply-add-accumulation, multiply, etc executed by the core computation unit. To evaluate those equations for each pixel may require some pre-computed parameters which will be computed outside our unit in advance by the system¡¦s micro-controller. The equations can be computed by our texture unit based on the selected finite-state machine sequences which is stored in the on-chip control table. By updating those sequences can change the functionality provided by our chip. The overall cost of the proposed unit is about 28.36k gates. In addition to various texturing functions, this thesis also proposes an implementation of texture function for high-dynamic range (HDR) textures. HDR textures can provide various color details according to the frame¡¦s global illumination environment. Therefore, the 3D rendering system has to incorporate a tone-mapping mechanism to map the HDR image into normal color range of output display system. To reduce the overall tone-mapping implementation cost, this thesis uses an extra accumulator between the standard per-fragment rendering pipeline stages to accumulate the global illumination intensity based on the depth comparison result of the incoming pixel. After all of the pixels have passed through the pipeline stages, every pixel of the stored rendering result will be fetched into a mapping unit which will generate its mapping color in the normal dynamic range. The overall cost of the additional hardware for the realization of HDR textures is about 6.98k gates.

Operadores de tone mapping reverso (RTMOs) realçam imagens e vídeos de baixa faixa dinâmica para visualização em monitores de alta faixa dinâmica. Um problema comum encontrado por operadores anteriores é a maneira com que tratam conteúdo sub ou superexposto. Sob tais condições, eles podem não ser eficientes, e até mesmo causar perda e reversão de contraste visível. Apresentamos uma classe de operadores de tone mapping reverso, baseados no filtro bilateral cruzado (cross bilateral filter), capazes de gerar imagens HDR de alta qualidade. Experimentos utilizando uma métrica objetiva de avaliação de imagens demostram que nosso método é a única técnica capaz de realçar detalhes perceptíveis ao longo de uma grande gama de exposições de imagem, a qual inclui desde imagens subexpostas até imagens superexpostas. / Reverse tone mapping operators (rTMOs) enhance low-dynamic-range images and videos for display on high dynamic range monitors. A common problem faced by previous rTMOs is the handling of under or overexposed content. Under such conditions, they may not be effective, and even cause loss and reversal of visible contrast. We present a class of local rTMOs based on cross bilateral filtering that is capable of generating highquality HDR images and videos for a wide range of exposure conditions. Experiments performed using an objective image quality metric show that our approach is the only single technique available that can gracefully enhance perceived details across a large range of image exposures.

Operadores de tone mapping reverso (RTMOs) realçam imagens e vídeos de baixa faixa dinâmica para visualização em monitores de alta faixa dinâmica. Um problema comum encontrado por operadores anteriores é a maneira com que tratam conteúdo sub ou superexposto. Sob tais condições, eles podem não ser eficientes, e até mesmo causar perda e reversão de contraste visível. Apresentamos uma classe de operadores de tone mapping reverso, baseados no filtro bilateral cruzado (cross bilateral filter), capazes de gerar imagens HDR de alta qualidade. Experimentos utilizando uma métrica objetiva de avaliação de imagens demostram que nosso método é a única técnica capaz de realçar detalhes perceptíveis ao longo de uma grande gama de exposições de imagem, a qual inclui desde imagens subexpostas até imagens superexpostas. / Reverse tone mapping operators (rTMOs) enhance low-dynamic-range images and videos for display on high dynamic range monitors. A common problem faced by previous rTMOs is the handling of under or overexposed content. Under such conditions, they may not be effective, and even cause loss and reversal of visible contrast. We present a class of local rTMOs based on cross bilateral filtering that is capable of generating highquality HDR images and videos for a wide range of exposure conditions. Experiments performed using an objective image quality metric show that our approach is the only single technique available that can gracefully enhance perceived details across a large range of image exposures.

Context. Tone mapping operators (TMO) are designed to reduce the dynamicrange of high dynamic range images so that they can be presented onstandard dynamic range display devices. Many operators focus on creatingperceptually similar images. Objectives. This thesis aims to investigate how dierent TMOs reproducephotographed text. The underlying reason being to test the contrast reproductionof each TMO. Methods. An experiment has been performed in order to investigate thelegibility of photographed and tone mapped text. A user study was conducted,in which 18 respondents partook, where respondents were to ratehow much of the text in each photograph that they found to be legible. Results. Due to low participation, the results of the experiment are mostlyinconclusive. However, some tendencies have been observed and analyzedand they fall in line with previous work within the area. Conclusions. The main conclusion that can be drawn from the results isthat the TMO presented by Kuang [11] is rated as better than the TMOsby Fattal [7] and Kim and Kautz [10].

Les technologies d'écran ont connu récemment une évolution rapide. De la télévision 3D à l'Ultra Haute Définition, la tendance est maintenant aux écrans HDR (pour ''High Dynamic Range'') permettant de reproduire une gamme de luminance bien plus élevée que les écrans classiques. L'émergence de cette technologie implique de nouveaux travaux de standardisation dans le domaine de la compression vidéo. Une question essentielle pour la distribution à grande échelle de contenu HDR est celle de la rétro-compatibilité. Tandis que la future génération d'écrans de télévision sera adaptée à ce nouveau format, il est nécessaire de permettre aux équipements plus anciens de décoder et afficher une version du même contenu dont la dynamique a été préalablement réduite par un procédé appelé ''tone mapping''. Cette thèse vise à explorer les schémas de compression HDR rétro-compatibles. Dans une première approche, un algorithme de tone mapping spécifié par l'encodeur est appliqué à l'image HDR. L'image générée, alors appelée LDR (pour ''Low Dynamic Range''), peut être encodée et décodée dans un format classique. L'encodeur transmet par ailleurs une quantité réduite d'information permettant à un décodeur HDR d'inverser l'opération de tone mapping et de reconstruire une version HDR. L'étude de ces schémas est axée sur la définition de méthodes de tone mapping optimisées pour les performances de compression. La suite de la thèse se concentre sur l'approche scalable dans laquelle les deux versions sont fournies à l'encodeur sans connaissance à priori sur l'opérateur de tone mapping utilisé. Le producteur garde donc le contrôle sur la création du contenu LDR. Cette version LDR est d'abord compressée comme une première couche. L'image reconstruite est utilisée par le codeur scalable pour compresser plus efficacement la couche HDR grâce à un mécanisme de prédiction inter-couches. Notre approche locale et non linéaire nous permet d'améliorer les performances de codage par rapport aux méthodes scalables existantes, en particulier dans le cas où un tone mapping complexe est utilisé pour générer la version LDR. / In recent years, the display technologies have been rapidly evolving. From 3D television to Ultra High Definition, the trend is now towards High Dynamic Range (HDR) displays that can reproduce a luminance range far beyond the capabilities of conventional displays. The emergence of this technology involves new standardization effort in the field of video compression. In terms of large scale content distribution, the question of backward compatibility is critical. While the future generation of television displays will be adapted to this new format, it is necessary to enable the older equipment to decode and display a version of the same content whose dynamic range has been previously reduced by a process called “tone mapping”. This thesis aims at exploring the backward compatible HDR compression schemes. In a first approach, a tone mapping operator specified by the encoder is applied to the HDR image. The resulting image, called Low Dynamic Range (LDR), can then be encoded and decoded in a conventional format. The encoder additionally transmits a small amount of information enabling a HDR capable decoder to inverse the tone mapping operator and retrieve the HDR version. The study of these schemes is directed towards the definition of tone mapping operators optimized for the compression performance. We then focus on scalable approaches, where both versions are given to the encoder without prior knowledge on the tone mapping operator used. The producer thus keeps full control on the LDR content creation process. This LDR version is compressed as a first layer. The reconstructed image is used by the scalable encoder to compress the HDR layer efficiently by performing inter-layer predictions. Thanks to a local and non-linear approach, the proposed schemes improve the coding performance compared to the existing scalable methods, especially in the case where a complex tone mapping is used for generating the LDR version.