Made available in DSpace on 2016-03-22T17:26:22Z (GMT). No. of bitstreams: 1 DMII_AndreMarcel.pdf: 2907967 bytes, checksum: 5f3911468dd5affdd2020316f31ee238 (MD5) Previous issue date: 2009-12-11 / The increasing use of digital video on the Internet, devices and also in mobile digital TV has lead to an increasing interest for research in this area, from both industry and academia. This work follows this trend by proposing the investigation of the main aspects of digital video, video compression and also of the H.264/AVC video compression for the implementation of performance efficient dedicated architectures for some modules of the H.264/AVC encoder. In particular, this work presents some architectural alternatives for the increase of performance of two modules of the H.264/AVC, which are: T Module (composed by the Forward Hadamard and Discrete Cosine Transforms) and Motion Estimation (ME). For the implementation of these modules the use of techniques to the increase of performance has been considered, such as the use of efficient adders and pipeline. This efficient adders presents high use of hardware features. Thus, the implemented architectures in this work presented these characteristics too. The main aspect presented by the implemented modules is a large number of arithmetic operations of addition and subtraction for their processing. Thus, the motivation of this work is the increase of performance of these modules, from the use of efficient adder/subtractor circuits that are present in literature. In particular, 4:2, 8:2 and 16:2 adder compressors that perform the simultaneous addition of 4, 8 and 16 operands, respectively, with no penalties in area and the critical path are used. The architectures were described in VHDL and targeted to ASIC technology. The validation of the circuits and the obtained results were performed by using Leonardo Spectrum tool from Mentor Graphics. Comparisons against the solutions of the literature were done and the main results show that the architectures proposed in this work are more efficient. Significant gains in performance are achievable using our solutions for both Forward Transforms and Motion Estimation architectures / A crescente utilização de vídeos digitais na Internet, em dispositivos móveis e também na TV digital faz com que haja um interesse crescente em pesquisas nesta área, tanto na indústria quanto no meio acadêmico. Este trabalho segue esta tendência e tem como proposta estudar aspectos de vídeo digital, compressão de vídeo e também do padrão H.264/AVC de compressão de vídeo para a implementação de arquiteturas dedicadas eficientes em desempenho, isto é, com elevada frequência de operação, dos módulos do codificador do padrão H.264/AVC. Em particular, este trabalho apresenta algumas alternativas arquiteturais para aumento de desempenho de dois módulos do padrão H.264/AVC, que são: Módulo T (composto pelas Transformadas Diretas Transformadas Hadamard e Transformada Discreta do Coseno) e Estimação de Movimento (ME). A implementação destes módulos foi realizada utilizando técnicas para o aumento de desempenho, tais como o uso de somadores eficientes e pipeline. Uma característica dos somadores eficientes utilizados neste trabalho é o uso elevado de recursos de hardware. Assim, as arquiteturas implementadas neste trabalho também apresentaram esta característica. Os módulos implementados apresentam como principal característica um elevado número de operações aritméticas de soma e subtração para o seu processamento. Desta forma, a motivação deste trabalho consiste em aumentar o desempenho destes módulos, a partir da utilização de circuitos somadores/subtratores eficientes presentes na literatura. Em particular, são utilizados circuitos somadores compressores 4:2, 8:2 e 16:2, pois estes realizam a soma simultânea de 4, 8 e 16 operandos, respectivamente, sem penalidades em área e no caminho crítico. As arquiteturas foram descritas em VHDL e direcionadas para tecnologia ASIC, a validação e resultados foram obtidos através da ferramenta Leonardo Spectrum da Mentor Graphics. Para os estudos de caso utilizados neste trabalho (Transformadas Diretas e Estimação de Movimento), foram feitas comparações com soluções apresentadas na literatura e os resultados mostram que as arquiteturas implementadas neste trabalho obtiveram significativos ganhos em desempenho, quando comparadas com soluções apresentadas na literatura

<p>This thesis describes the implementation of a real-time, full search, 16x16 bidirectional motion estimation at 24 frames per second with the record performance of 155 Gop/s (1538 ops/pixel) at a high clock rate of 125 MHz. The core of bidirectional motion estimation uses close to 100% FPGA resources with 7 Gbit/s bandwidth to external memory. The architecture allows extremely controlled, macro level floor-planning with parameterized block size, image size, placement coordinates and data words length. The FPGA chip is part of the board that was developed at the Institute of Computer & Communication Networking Engineering, Technical University Braunschweig Germany, in collaboration with Grass Valley Germany in the FlexFilm research project. The goal of the project was to develop hardware and programming methodologies for real-time digital film image processing. Motion estimation core uses FlexWAFE reconfigurable architecture where FPGAs are configured using macro components that consist of weakly programmable address generation units and data stream processing units. Bidirectional motion estimation uses two cores of motion estimation engine (MeEngine) forming main data processing unit for backward and forward motion vectors. The building block of the core of motion estimation is an RPM-macro which represents one processing element and performs 10-bit difference, a comparison, and 19-bit accumulation on the input pixel streams. In order to maximize the throughput between elements, the processing element is replicated and precisely placed side-by-side by using four hierarchal levels, where each level is a very compact entity with its own local control and placement methodology. The achieved speed was further improved by regularly inserting pipeline stages in the processing chain.</p>

This thesis describes the implementation of a real-time, full search, 16x16 bidirectional motion estimation at 24 frames per second with the record performance of 155 Gop/s (1538 ops/pixel) at a high clock rate of 125 MHz. The core of bidirectional motion estimation uses close to 100% FPGA resources with 7 Gbit/s bandwidth to external memory. The architecture allows extremely controlled, macro level floor-planning with parameterized block size, image size, placement coordinates and data words length. The FPGA chip is part of the board that was developed at the Institute of Computer &amp; Communication Networking Engineering, Technical University Braunschweig Germany, in collaboration with Grass Valley Germany in the FlexFilm research project. The goal of the project was to develop hardware and programming methodologies for real-time digital film image processing. Motion estimation core uses FlexWAFE reconfigurable architecture where FPGAs are configured using macro components that consist of weakly programmable address generation units and data stream processing units. Bidirectional motion estimation uses two cores of motion estimation engine (MeEngine) forming main data processing unit for backward and forward motion vectors. The building block of the core of motion estimation is an RPM-macro which represents one processing element and performs 10-bit difference, a comparison, and 19-bit accumulation on the input pixel streams. In order to maximize the throughput between elements, the processing element is replicated and precisely placed side-by-side by using four hierarchal levels, where each level is a very compact entity with its own local control and placement methodology. The achieved speed was further improved by regularly inserting pipeline stages in the processing chain.

[Truncated abstract] Measuring the kinematics of joints and implants following orthopaedic surgery is important since joint motion directly influences the functional outcome of the patient and the longevity of the implant. Radiostereometric Analysis (RSA) has been used to assess the motion over time of various joints and implant designs following corrective orthopaedic and joint replacement surgery for more than 20 years in more than 10,000 patients around the world. While the use of RSA reduces the risk of implanting potentially inferior prostheses on a large scale, conventional methodological procedures are based on the acquisition of static, stereographic x-ray images that are not suitable for measuring skeletal kinematics in a dynamic manner. The purpose of this thesis was to design, validate and test a novel technique for dynamically assessing the skeletal motion of human subjects using RSA and single-plane digital x-ray video fluoroscopy. The validation procedure utilised two in-vitro phantom models of human joints capable of simulating normal kinematic motion. These phantom models were supplied with realistic spatial displacement protocols derived from cadaveric specimens. The spatial positions of a series of tantalum markers that were implanted in each skeletal segment were measured using RSA. Skeletal motion was determined in x-ray fluoroscopy images by minimising the difference between the markers measured and projected in the single image plane. Accuracy was determined in terms of bias and precision by analysing the deviation between the applied displacement protocol and measured pose estimates. ... The RSA and low dose single-plane fluoroscopy technique developed, validated and tested in this thesis is capable of dynamically measuring the kinematics of any joint in the human body, following the implantation of small metallic markers in the surrounding bone during corrective orthopaedic surgery. The kinematics of joints with replacement prostheses, such as the total knee replacement (TKR), can be analysed in addition to the kinematics of joints without replacement prostheses, such as the sacroiliac joint. The technique may be used in the future on groups of human subjects enrolled in controlled trials that are designed to analyse the kinematics of the shoulder, spine, hip, knee, patella or ankle joints for the purposes of quantitatively comparing the kinematics of different prosthesis designs and various corrective orthopaedic procedures.

L’alignement d’images paramétrique a de nombreuses applications pour la réalité augmentée, la compression vidéo ou encore le suivi d’objets. Dans cette thèse, nous nous intéressons notamment aux techniques de recalage d’images (template matching) reposant sur l’optimisation locale d’une fonctionnelle d’erreur. Ces approches ont conduit ces dernières années à de nombreux algorithmes efficaces pour le suivi d’objets. Cependant, les performances de ces algorithmes ont été peu étudiées lorsque les images sont dégradées par un bruit important comme c’est le cas, par exemple, pour des captures réalisées dans des conditions de faible luminosité. Dans cette thèse, nous proposons un nouveau formalisme, appelé formalisme bidirectionnel, qui unifie plusieurs approches de l’état de l’art. Ce formalisme est utilisé dans un premier temps pour porter un éclairage nouveau sur un grand nombre d’approches de la littérature et en particulier sur l’algorithme ESM (Efficient Second-order Minimization). Nous proposons ensuite une étude théorique approfondie de l’influence du bruit sur le processus d’alignement. Cette étude conduit à la définition de deux nouvelles familles d’algorithmes, les approches ACL (Asymmetric Composition on Lie Groups) et BCL (Bidirectional Composition on Lie Groups) qui permettent d’améliorer les performances en présence de niveaux de bruit asymétriques (Rapport Signal sur Bruit différent dans les images). L’ensemble des approches introduites sont validées sur des données synthétiques et sur des données réelles capturées dans des conditions de faible luminosité. / Parametric image alignment is a fundamental task of many vision applications such as object tracking, image mosaicking, video compression and augmented reality. To recover the motion parameters, direct image alignment works by optimizing a pixel-based difference measure between a moving image and a fixed-image called template. In the last decade, many efficient algorithms have been proposed for parametric object tracking. However, those approaches have not been evaluated for aligning images of low SNR (Signal to Noise ratio) such as images captured in low-light conditions. In this thesis, we propose a new formulation of image alignment called Bidirectional Framework for unifying existing state of the art algorithms. First, this framework allows us to produce new insights on existing approaches and in particular on the ESM (Efficient Second-order Minimization) algorithm. Subsequently, we provide a theoretical analysis of image noise on the alignment process. This yields the definition of two new approaches : the ACL (Asymmetric Composition on Lie Groups) algorithm and the BCL (Bidirectional Composition on Lie Groups) algorithm, which outperform existing approaches in presence of images of different SNR. Finally, experiments on synthetic and real images captured under low-light conditions allow to evaluate the new and existing approaches under various noise conditions.

L'échographie est aujourd'hui l'une des modalités les plus populaires de diagnostic médical. Il permet d'observer, en temps réel, le mouvement des organes qui facilite le diagnostic des pathologies pour des médecins. L'échocardiographie [1, 2], l'imagerie du flux sanguin [3, 4] et l’élastographie [5-7] sont les domaines préférés de l'estimation de mouvement en utilisant l'échographie (en raison de son haut frame-rate).En conséquence, les images avec meilleurs qualités sont nécessaires. . En imagerie cardiaque, le système classique d'imagerie est limité dans la direction transversale (la direction perpendiculaire à celle de propagation). Travaillant sur la formation des images, ce problème peut être résolu en modifiant la façon de formateur de voie afin d'introduire des oscillations transversales (OTs) dans la fonction d’étalement du point (PSF). La technique d’oscillation transversale a montré son potentiel d'améliorer la précision de l'estimation de mouvement local dans la direction transversale (la direction perpendiculaire à celle de propagation). La classique OT en géométrie linéaire, basée sur l'approximation de Fraunhofer, relie la PSF et la fonction de pondération par la transformée de Fourier. Motivé par l'adaptation des OTs en échocardiographie, nous proposons une technique spécifique basée sur la rétro-propagation afin de construire des OTs en géométrie sectorielle. La performance de la méthode de rétro-propagation proposée a été étudiée progressivement, comparée avec la méthode de la transformée de Fourier, par exemple, l'évaluation de la qualité de la PSF quantifié, dans l'estimation de mouvement cardiaque en simulation, et en étude la qualité des PSF visuellement expérimentale. Les résultats quantifiés montrent les OT-images sont mieux contrôlés par la méthode proposée que par le formateur de voie conventionnelle. Une autre méthode, basée sur la décomposition d'onde plane et un principe différent de rétro-propagation, a été présentée. Cette méthode mieux prend en compte la propriété 2D de PSF, en décomposant la PSF dans un ensemble d'ondes planes directionnelle, les rétro-propage à la sonde, en utilisant les résultats de superposition comme excitations, un PSF simulée et conforme fortement au PSF théorique est acquis. En adaptant cette méthode à la géométrie sectorielle, la qualité de la PSF obtenue en face et sur la côté de la sonde est meilleure en utilisant la décomposition en ondes planes à celle de la transformée de Fourier, le travail supplémentaire sera adressé à adapter la décomposition en ondes planes à imagerie sectorielle et l’estimation du mouvement. / Echography is nowadays one of the most popular medical diagnosis modalities. It enables real-time observation the motion of moving organs which facilitates the diagnosis of pathologies for physician. Echocardiography [1, 2], blood flow imaging [3, 4] and elastography [5-7] are the favorite domains of motion estimation in using of echography (e.g., due to its high frame-rate capacity). Thus the requirements for imaging with high quality are on the primary place. In cardiac imaging, the conventional imaging system is somehow limited in the transverse direction (the direction perpendicular to the beam axis). Working on the image formation, this problem can be addressed by modifying the beamforming scheme in order to introduce transverse oscillations (TOs) in the system point spread function (PSF). Transverse oscillation techniques have shown their potential for improving the accuracy of local motion estimation in the transverse direction (i.e., the direction perpendicular to the beam axis). The conventional design of TOs in linear geometry, which is based on the Fraunhofer approximation, relates PSF and apodization function through a Fourier transform. Motivated by the adaptation of TOs in echocardiography, we propose a specific beamforming approach based on back-propagation in order to build TOs in sectorial geometry. The performance of the proposed back-propagation method has been studied gradually, in comparison with the Fourier transform, such as in evaluation of the quality of PSF, in estimation of simulated cardiac motion and in experiments study, etc. The quantified results demonstrate the proposed method leads to better controlled TOs images than the conventional beamforming. Another method based on plane wave decomposition and a different back-propagation principle has been presented. This method is better taking into account the 2D property of PSF, by decomposing the PSF into a set of plane waves directionally, back-propagating them to the probe, by using the superposition results as excitations, a simulated PSF with high accordance to the theoretical one is acquired. By adapting this method to sectorial geometry, the quality of PSF obtained in front of probe is better using the plane wave decomposition method than that of Fourier relation, but it is limited for the scanning on the side of probe, so the further work will be addressed to adapting the plane wave decomposition method to the complete sectorial imaging.

L'objectif de cette thèse est d'étudier la désynchronisation pariétale en ciné-IRM conventionnelle. La première partie de notre travail a consisté à quantifier les mouvements de la paroi du ventricule gauche du coeur directement à partir de séquences de ciné-IRM standards, de type SSFP avec une synchronisation rétrospective, utilisées pour l'étude de la fonction cardiaque. Les méthodes développées pour mesurer les déplacements dans les images sont basées sur des techniques fréquentielles de flux optique. Ces techniques semblent particulièrement adaptées aux particularités des IRM. Nous montrons en effet leur robustesse en présence de bruit ricien et de variations d'intensité des pixels au cours du temps, variations généralement provoquées par les mouvements du coeur à travers le plan, notamment en coupe petit axe. La seconde partie de notre travail a porté sur l'évaluation de la désynchronisation en ciné-IRM en coupe petit axe. Des courbes d'évolution des déplacements et des vitesses de la paroi au cours du temps ont été obtenues par un suivi de points d'intérêt localisés sur les différents segments du ventricule gauche proches de l'endocarde. Pour calculer les délais entre ces courbes, nous nous sommes appuyés sur les études effectuées en échocardiographie et avons proposé différents paramètres de mesure de la désynchronisation pour l'IRM. Ce travail a fait l'objet d'une étude clinique préliminaire comprenant des coeurs considérés comme normaux suite à l'examen clinique et de coeurs de patients à QRS larges et fins ne présentant pas de cardiopathie ischémique. Les mesures de désynchronisation en IRM cardiaque ont été comparées aux mesures pratiquées en échocardiographie. Les premiers résultats indiquent une corrélation entre les mesures d'échographie et d'IRM. La troisième partie de notre travail a consisté à étudier les mouvements du coeur directement à partir des images brutes des antennes en IRM multicanaux. Les algorithmes de flux optique développés et testés pour ce type d'images ont montré qu'il était possible d'estimer les mouvements myocardiques. Les premiers résultats semblent encourageants. Les résultats de l'étude préliminaire de l'asynchronisme intraventriculaire gauche en IRM sont prometteurs. La ciné-IRM cardiaque pourrait être une alternative à l'échocardiographie notamment pour les patients faiblement échogènes. La validation de cette technique de quantification de l'asynchronisme en IRM est un enjeu important. Une étude plus approfondie est en cours, notamment pour prédire la réponse à la CRT de patients sans cardiopathie ischémique présentant une désynchronisation mécanique à partir des facteurs de mesures en IRM et en échographie. / The aim of this thesis is to study parietal desynchronisation of the left ventricle from conventional cine-MRI. The first part of our work consisted in the quantification of the left ventricle wall motion of the heart directly from conventional retrospective SSFP type cine-MRI sequences used in the study of cardiac function. The developed methods for measuring displacements within the images are frequency-based optical flow methods. These techniques seem to be particularly adapted to MRI specificities. We have demonstrated their robustness in the event of Rician noise and pixel intensity variations as a function of time. These variations are often associated with the through-plane motion of the heart, in particular in the short-axis orientation. The second part of our work concerned the assessment of desynchronisation from short axis cine-MRI. Time-displacement and time-velocity curves of the heart wall were obtained from tracking points of interest localised on the left ventricle segments close to the endocardium. With respect to the quantification of the delay between curves, our work relied on research carried out in the field of echocardiography desynchronisation. Various parameters for the measurement of desynchronisation from cine-MRI were proposed. This work was the subject of a preliminary clinical study including patients considered as normal further based on clinical examination and patients having normal or prolonged QRS duration without ischemic heart disorder. The dyssynchrony measurements from cardiac MRI were compared to measurements obtained with echocardiography. The first results indicate a good correlation between echography and MRI measurements. The third part of our work consisted in studying heart wall motion directly from raw images from multicoil MRI. The developed optical flow algorithms were tested and they showed that it was possible to estimate myocardial movement. Preliminary results are encouraging. The results of the preliminary study of left intraventricular asynchronism from MRI are also promising. Cardiac cine-MRI could be an alternative to echocardiography in the case of weakly echogenic patients. The validation of this quantitative technique for asynchronism from MRI is of major interest. A more detailed study is in progress, in particular to predict the response of CRT (cardiac resynchronisation therapy) of patients without ischemic disorder presenting a mechanical desynchronisation from MRI and echographic parameters.

This dissertation presents algorithms for restoring some of the major corruptions observed in archived film or video material. The two principal problems of impulsive distortion (Dirt and Sparkle or Blotches) and noise degradation are considered. There is also an algorithm for suppressing the inter-line jitter common in images decoded from noisy video signals. In the case of noise reduction and Blotch removal the thesis considers image sequences to be three dimensional signals involving evolution of features in time and space. This is necessary if any process presented is to show an improvement over standard two-dimensional techniques. It is important to recognize that consideration of image sequences must involve an appreciation of the problems incurred by the motion of objects in the scene. The most obvious implication is that due to motion, useful three dimensional processing does not necessarily proceed in a direction 'orthogonal' to the image frames. Therefore, attention is given to discussing motion estimation as it is used for image sequence processing. Some discussion is given to image sequence models and the 3D Autoregressive model is investigated. A multiresolution BM scheme is used for motion estimation throughout the major part of the thesis. Impulsive noise removal in image processing has been traditionally achieved by the use of median filter structures. A new three dimensional multilevel median structure is presented in this work with the additional use of a detector which limits the distortion caused by the filters . This technique is found to be extremely effective in practice and is an alternative to the traditional global median operation. The new median filter is shown to be superior to those previously presented with respect to the ability to reject the kind of distortion found in practice. A model based technique using the 3D AR model is also developed for detecting and removing Blotches. This technique achieves better fidelity at the expense of heavier computational load. Motion compensated 3D IIR and FIR Wiener filters are investigated with respect to their ability to reject noise in an image sequence. They are compared to several algorithms previously presented which are purely temporal in nature. The filters presented are found to be effective and compare favourably to the other algorithms. The 3D filtering process is superior to the purely temporal process as expected. The algorithm that is presented for suppressing inter-line jitter uses a 2D AR model to estimate and correct the relative displacements between the lines. The output image is much more satisfactory to the observer although in a severe case some drift of image features is to be expected. A suggestion for removing this drift is presented in the conclusions. There are several remaining problems in moving video. In particular, line scratches and picture shake/roll. Line scratches cannot be detected successfully by the detectors presented and so cannot be removed efficiently. Suppressing shake and roll involves compensating the entire frame for motion and there is a need to separate global from local motion. These difficulties provide ample opportunity for further research.

Cette thèse (i) décrit une procédure automatique pour estimer la condition d'arrêt des méthodes de déconvolution itératives basées sur un critère d'orthogonalité du signal estimé et de son gradient à une itération donnée; (ii) présente une méthode qui décompose l'image en une partie géométrique (ou "cartoon") et une partie "texture" en utilisation une estimation de paramètre et une condition d'arrêt basées sur la diffusion anisotropique avec orthogonalité, en utilisant le fait que ces deux composantes. "cartoon" et "texture", doivent être indépendantes; (iii) décrit une méthode pour extraire d'une séquence vidéo obtenue à partir de caméra portable les objets de premier plan en mouvement. Cette méthode augmente la compensation de mouvement de la caméra par une nouvelle estimation basée noyau de la fonction de probabilité de densité des pixels d'arrière-plan. Les méthodes présentées ont été testées et comparées aux algorithmes de l'état de l'art. / This dissertation (i) describes an automatic procedure for estimating the stopping condition of non-regularized iterative deconvolution methods based on an orthogonality criterion of the estimated signal and its gradient at a given iteration; (ii) presents a decomposition method that splits the image into geometric (or cartoon) and texture parts using anisotropic diffusion with orthogonality based parameter estimation and stopping condition, utilizing the theory that the cartoon and the texture components of an image should be independent of each other; (iii) describes a method for moving foreground object extraction in sequences taken by wearable camera, with strong motion, where the camera motion compensated frame differencing is enhanced with a novel kernel-based estimation of the probability density function of the background pixels. The presented methods have been thoroughly tested and compared to other similar algorithms from the state-of-the-art.

This thesis deals with digital image stabilization. It contains a brief overview of the problem and available methods for digital image stabilization. The aim was to design and implement image stabilization system in JAVA, which is designed for RapidMiner. Two new stabilization methods have been proposed. The first is based on the motion estimation and motion compensation using Full-search and Three-step search algorithms. The basis of the second method is the detection of object boundaries. The functionality of the proposed method was tested on video sequences with contain visible shake of the scene, which has beed created for this purpose. Testing results show that with the proper set of input parameters for the object border detection method, successful stabilization of the scene is achieved. The rate of error reduction between images is approximately about 65 to 85%. The output of the method is stabilized image sequence and a set of metadata collected during stabilization, which can be further processed in an environment of RapidMiner.