Cette thèse est issue d’un accord CIFRE entre le groupe de recherche EnCoV de l’Université Clermont Auvergne et la société Quantel Medical (www.quantel-medical.fr). Quantel Medical est une entreprise spécialisée dans le développement innovant des ultrasons et des produits laser en ophtalmologie. Cette thèse présente un travail de recherche visant à l’application du diagnostic assisté par ordinateur et du traitement des maladies de la rétine avec une utilisation du prototype industriel TrackScan développé par Quantel Medical. Plus précisément, elle contribue au problème du mosaicing précis de l’image de la lampe à fente (SLIM) et du recalage automatique et multimodal en utilisant les images SLIM avec l’angiographie par fluorescence (FA) pour aider à la photo coagulation pan-rétienne naviguée. Nous abordons trois problèmes différents.Le premier problème est lié à l’accumulation des erreurs du recalage en SLIM., il dérive de la mosaïque. Une approche commune pour obtenir la mosaïque consiste à calculer des transformations uniquement entre les images temporellement consécutives dans une séquence, puis à les combiner pour obtenir la transformation entre les vues non consécutives temporellement. Les nombreux algorithmes existants suivent cette approche. Malgré le faible coût de calcul et la simplicité de cette méthode, en raison de sa nature de ‘chaînage’, les erreurs d’alignement s’accumulent, ce qui entraîne une dérive des images dans la mosaïque. Nous proposons donc d’utilise les récents progrès réalisés dans les méthodes d’ajustement de faisceau et de présenter un cadre de réduction de la dérive spécialement conçu pour SLIM. Nous présentons aussi une nouvelle procédure de raffinement local.Deuxièmement, nous abordons le problème induit par divers types d’artefacts communs á l’imagerie SLIM. Ceus-sont liés à la lumière utilisée, qui dégrade considérablement la qualité géométrique et photométrique de la mosaïque. Les solutions existantes permettent de faire face aux blouissements forts qui corrompent entièrement le rendu de la rétine dans l’image tout en laissant de côté la correction des reflets spéculaires semi-transparents et reflets des lentilles. Cela introduit des images fantômes et des pertes d’information. En outre, les méthodes génériques ne produisent pas de résultats satisfaisants dans SLIM. Par conséquent, nous proposons une meilleure alternative en concevant une méthode basée sur une technique rapide en utilisant une seule image pour éliminer les éblouissements et la notion de feux spéculaires semi-transparents en utilisant les indications de mouvement pour la correction intelligente de reflet de lentille.Finalement, nous résolvons le problème du recalage multimodal automatique avec SLIM. Il existe une quantité importante de travaux sur le recalage multimodal de diverses modalités d’image rétinienne. Cependant, la majorité des méthodes existantes nécessitent une détection de points clés dans les deux modalités d’image, ce qui est une tâche très difficile. Dans le cas de SLIM et FA ils ne tiennent pas compte du recalage précis dans la zone maculaire - le repère prioritaire. En outre, personne n’a développé une solution entièrement automatique pour SLIM et FA. Dans cette thèse, nous proposons la première méthode capable de recolu ces deux modalités sans une saisie manuelle, en détectant les repères anatomiques uniquement sur une seule image pour assurer un recalage précis dans la zone maculaire. (...) / This thesis arises from an agreement Convention Industrielle de Formation par la REcherche (CIFRE) between the Endoscopy and Computer Vision (EnCoV) research group at Université Clermont Auvergne and the company Quantel Medical (www.quantel-medical.fr), which specializes in the development of innovative ultrasound and laser products in ophthalmology. It presents a research work directed at the application of computer-aided diagnosis and treatment of retinal diseases with a use of the TrackScan industrial prototype developed at Quantel Medical. More specifically, it contributes to the problem of precise Slit-Lamp Image Mosaicing (SLIM) and automatic multi-modal registration of SLIM with Fluorescein Angiography (FA) to assist navigated pan-retinal photocoagulation. We address three different problems.The first is a problem of accumulated registration errors in SLIM, namely the mosaicing drift.A common approach to image mosaicking is to compute transformations only between temporally consecutive images in a sequence and then to combine them to obtain the transformation between non-temporally consecutive views. Many existing algorithms follow this approach. Despite the low computational cost and the simplicity of such methods, due to its ‘chaining’ nature, alignment errors tend to accumulate, causing images to drift in the mosaic. We propose to use recent advances in key-frame Bundle Adjustment methods and present a drift reduction framework that is specifically designed for SLIM. We also introduce a new local refinement procedure.Secondly, we tackle the problem of various types of light-related imaging artifacts common in SLIM, which significantly degrade the geometric and photometric quality of the mosaic. Existing solutions manage to deal with strong glares which corrupt the retinal content entirely while leaving aside the correction of semi-transparent specular highlights and lens flare. This introduces ghosting and information loss. Moreover, related generic methods do not produce satisfactory results in SLIM. Therefore, we propose a better alternative by designing a method based on a fast single-image technique to remove glares and the notion of the type of semi-transparent specular highlights and motion cues for intelligent correction of lens flare.Finally, we solve the problem of automatic multi-modal registration of FA and SLIM. There exist a number of related works on multi-modal registration of various retinal image modalities. However, the majority of existing methods require a detection of feature points in both image modalities. This is a very difficult task for SLIM and FA. These methods do not account for the accurate registration in macula area - the priority landmark. Moreover, none has developed a fully automatic solution for SLIM and FA. In this thesis, we propose the first method that is able to register these two modalities without manual input by detecting retinal features only on one image and ensures an accurate registration in the macula area.The description of the extensive experiments that were used to demonstrate the effectiveness of each of the proposed methods is also provided. Our results show that (i) using our new local refinement procedure for drift reduction significantly ameliorates the to drift reduction allowing us to achieve an improvement in precision over the current solution employed in the TrackScan; (ii) the proposed methodology for correction of light-related artifacts exhibits a good efficiency, significantly outperforming related works in SLIM; and (iii) despite our solution for multi-modal registration builds on existing methods, with the various specific modifications made, it is fully automatic, effective and improves the baseline registration method currently used on the TrackScan.

This thesis focuses on 3D computer graphics and the continuous maximisation of rendering quality and performance. Its main focus is the critical analysis of numerous real-time rendering algorithms and the construction of an empirically derived system for the high-speed rendering of shader-based special effects, lighting effects, shadows, reflection and refraction, post-processing effects and the processing of physics. This critical analysis allows us to assess the relationship between rendering quality and performance. It also allows for the isolation of key algorithmic weaknesses and possible bottleneck areas. Using this performance data, gathered during the analysis of various rendering algorithms, we are able to define a selection engine to control the real-time cycling of rendering algorithms and special effects groupings based on environmental conditions. Furthermore, as a proof of concept, to balance Central Processing Unit (CPU) and Graphic Processing Unit (GPU) load for and increased speed of execution, our selection system unifies the GPU and CPU as a single computational unit for physics processing and environmental mapping. This parallel computing system enables the CPU to process cube mapping computations while the GPU can be tasked with calculations traditionally handled solely by the CPU. All analysed and benchmarked algorithms were implemented as part of a modular rendering engine. This engine offers conventional first-person perspective input control, mesh loading and support for shader model 4.0 shaders (via Microsoft’s High Level Shader Language) for effects such as high dynamic range rendering (HDR), dynamic ambient lighting, volumetric fog, specular reflections, reflective and refractive water, realistic physics, particle effects, etc. The test engine also supports the dynamic placement, movement and elimination of light sources, meshes and spatial geometry. Critical analysis was performed via scripted camera movement and object and light source additions – done not only to ensure consistent testing, but also to ease future validation and replication of results. This provided us with a scalable interactive testing environment as well as a complete solution for the rendering of computationally intensive 3D environments. As a full-fledged game engine, our rendering engine is amenable to first- and third-person shooter games, role playing games and 3D immersive environments. Evaluation criteria (identified to access the relationship between rendering quality and performance), as mentioned, allows us to effectively cycle algorithms based on empirical results and to distribute specific processing (cube mapping and physics processing) between the CPU and GPU, a unification that ensures the following: nearby effects are always of high-quality (where computational resources are available), distant effects are, under certain conditions, rendered at a lower quality and the frames per second rendering performance is always maximised. The implication of our work is clear: unifying the CPU and GPU and dynamically cycling through the most appropriate algorithms based on ever-changing environmental conditions allow for maximised rendering quality and performance and shows that it is possible to render high-quality visual effects with realism, without overburdening scarce computational resources. Immersive rendering approaches used in conjunction with AI subsystems, game networking and logic, physics processing and other special effects (such as post-processing shader effects) are immensely processor intensive and can only be successfully implemented on high-end hardware. Only by cycling and distributing algorithms based on environmental conditions and through the exploitation of algorithmic strengths can high-quality real-time special effects and highly accurate calculations become as common as texture mapping. Furthermore, in a gaming context, players often spend an inordinate amount of time fine-tuning their graphics settings to achieve the perfect balance between rendering quality and frames-per-second performance. Using this system, however, ensures that performance vs. quality is always optimised, not only for the game as a whole but also for the current scene being rendered – some scenes might, for example, require more computational power than others, resulting in noticeable slowdowns, slowdowns not experienced thanks to our system’s dynamic cycling of rendering algorithms and its proof of concept unification of the CPU and GPU. / Thesis (PhD)--University of Pretoria, 2012. / Computer Science / unrestricted

Optical scattering measurement devices are used to measure light reflection and light scattering from materials, to obtain data of the surface and bulk properties of materials. The measurement data are often used in research and development projects where material requirements are important, also for quality control in manufacturing processes, in different optical simulations and can be used for photorealistic rendering. In this master thesis project conducted at AFRY, a multifunctional team will develop an optical scattering measurement device that aims to collect data more accurately than current devices on the market. This thesis will focus on the mechanical design of the device which consists of the stability and movement of the components, the environment of the measurements and material selection with a focus on performance and sustainability. The optical model that will act as a basis for the development will be a gonioreflectometer consisting of a material sample, sample holder, light source, detector and an environment in which the measurements are conducted. Some of the physical, cognitive and emotional needs of the intended user are efficient use, low risk of misuse, reliable and high precision. A thorough requirement specification was made as a framework for the concept generation. The selected concept provides the movement of the optical components with an angular step enabling the desired optical scattering measurement. The selected stepper motor and gear ratio provides the flexibility of the movement, making it easy for the user to change angular steps of the optical components, enabling both fine and rough measurements. A separating screen was chosen for both concepts in order to avoid light contamination between measurements and the material sample holder resembles a frame that allows for mounting the material sample outside of the device. The mechanical system has a high stability and the material black anodized aluminum further contributes to the sturdiness of the construction. A physical prototype was created to validate the movement, since the movement of the detector and light source will be similar, only the detector movement was prototyped. The prototype showed that the movement of the detector worked in the desired way, hence the construction of the movement is approved. The scope was delimited in consensus with the project members and supervisors due to the time frame, hence there is future work on the device that should be accounted for. In conclusion, the purpose of the project was fulfilled after delimiting the goals and a conceptual solution was created that fulfilled the requirements of the project. / Optiska mätinstrument används för att mäta ljusreflektion och ljusspridning från material, för att erhålla data om materialets yt- och bulkegenskaper. Mätdata används ofta i forsknings- och utvecklingsprojekt där materialkrav är viktiga, även för kvalitetskontroll i tillverkningsprocesser, i olika optiska simuleringar och kan användas för fotorealistisk rendering. I detta examensarbete, genomfört på AFRY, kommer ett multifunktionellt team att utveckla en optisk spridningsmätningsenhet som syftar till att samla in data mer noggrant. Denna avhandling kommer att fokusera på den mekaniska designen av enheten som består av stabiliteten och rörelsen av komponenterna, mätmiljön och materialval med fokus på prestanda och hållbarhet. Den optiska modellen som kommer att ligga till grund för utvecklingen kommer att vara en gonioreflektometer bestående av ett materialprov, provhållare, ljuskälla, detektor och en miljö där mätningarna genomförs. Några av de fysiska, kognitiva och emotionella behoven hos den avsedda användaren är effektiv användning, låg risk för felanvändning, pålitlighet och hög precision. En noggrann kravspecifikation gjordes som en ram för konceptgenereringen. Det valda konceptet möjliggör rörelse av de optiska komponenterna med ett vinkelsteg som tillåter den önskade optiska spridningsmätningen. Den valda stegmotorn och utväxlingen ger flexibilitet i rörelsen, detta bidrar till att det är enkelt för användaren att ändra vinkelstegen för de optiska komponenterna, vilket tillåter både fina och grova mätningar. En avskiljningsskärm valdes för att undvika ljuskontaminering mellan mätningarna och materialprovhållaren liknar en ram där materialprovet monteras utanför enheten. Det mekaniska systemet har en hög stabilitet och materialet svart anodiserad aluminium bidrar till konstruktionens robusthet. En fysisk prototyp skapades för att validera rörelsen, eftersom rörelsen av detektorn och ljuskällan kommer att vara liknande, återskapades endast detektorns rörelse. Prototypen visade att detektorns rörelse fungerade på önskat sätt, därmed godkänns konstruktionen av rörelsen. Projektets mål avgränsades i samförstånd med projektmedlemmarna och handledarna på grund av tidsramen, därmed finns det framtida arbete för mätinstrumentet som bör beaktas. Sammanfattningsvis uppfylldes projektets syfte efter att målen avgränsats och en konceptuell lösning skapades som uppfyllde projektets krav.