No description available.

One of the amazing properties of human vision is its ability to feel the depth of the scenes being viewed. This is made possible by a process named stereopsis, which is the ability of our brain to fuse together the stereo image pair seen by two eyes. As a stereo image pair is a direct result of the same scene being viewed by a slightly different perspective they open up a new paradigm where spatial redundancy could be exploited for efficient transmission and storage of stereo image data. This thesis introduces three novel algorithms for stereo image compression. The first algorithm improves compression by exploiting the redundancies present in the so-called disparity field of a stereo image pair. The second algorithm uses a pioneering block coding strategy to simultaneously exploit the inter-frame and intra-frame redundancy of a stereo image pair, eliminating the need of coding the disparity field. The basic idea behind the development of the third algorithm is the efficient exploitation of redundancy in smoothly textured areas that are present in both frames, but are relatively displaced from each other due to binocular parallax. Extra compression gains of up to 20% have been achieved by the use of these techniques. The thesis also includes research work related to the improvement of the MPEG-4 video coding standard, which is the first audiovisual representation standard that understands a scene as a composition of audio-visual objects. A linear extrapolation based padding technique that makes use of the trend of pixel value variation often present near object boundaries, in padding the exterior pixels of the reference video object has been proposed. Coding gains of up to 7% have been achieved for coding boundary blocks of video objects. Finally a contour analysis based approach has been proposed for MPEG-4 video object extraction.

O trabalho apresentado nesta tese trata do desenvolvimento de técnicas com suporte à ciência de contexto, baseadas nos padrões MPEG-4 e MPEG-7, para personalizar e adaptar conteúdo em TV Interativa. Um dos desafios dessa área é desenvolvimento de programas personalizados com rico conteúdo multimídia, com alta interatividade e que, além disso, sejam acessíveis a partir de uma variedade de dispositivos (fixos ou móveis), atendendo às expectativas de interação e de acesso dos usuários. Grande parte do problema está no fato de que os modos encontrados na literatura para representar, descrever e compor programas de TV Interativa não oferecem suporte a contexto, não permitem a separação entre descrições de programas e descrições de objetos e possuem baixa granulosidade de segmentação. Essas características dificultam e, em alguns casos, impedem o desenvolvimento de aplicações avançadas em TV Interativa. As técnicas desenvolvidas neste trabalho são baseadas em esquemas de descrição, compatíveis com o padrão MPEG-7, e na segmentação de programas em objetos MPEG-4. Os esquemas são utilizados para descrever a estrutura, a composição e a semântica de programas e de seus objetos componentes. Também foi definida e implantada uma infra-estrutura para produção, distribuição e consumo de programas. A utilização conjunta da infra-estrutura e das técnicas permite o desenvolvimento de aplicações avançadas em TV Interativa. Como um exemplo dessas aplicações, foi desenvolvido um serviço automático para personalizar e adaptar programas de TV Interativa, permitindo que um usuário possa acessar, sob demanda, programas especialmente produzidos para ele, contendo apenas assuntos de seu interesse e permitindo que o acesso possa ser realizado por dispositivos fixos ou móveis. / The work presented in this thesis developed techniques with context-awareness support, based on the MPEG-4 and MPEG-7 standards, in order to personalize and to adapt Interactive TV content. One of the challenges in this area is the development of personalized programs with rich multimedia content, high interactivity and accessibility through a variety of devices (mobile and non-mobile). Most part of the problem is that the approaches found in literature do not provide context support, do not allow separation between programs and objects descriptions and have low level of segmentation granularity. These features make difficult or impossible, in some cases, the development of Interactive TV applications. The techniques developed in this work are based on MPEG-7 compliant schemes and on programs segmentation into MPEG-4 objects. The schemes are used to describe structure, composition and semantics of programs and component objects. An infra-structure to creation, delivery and consumption of Interactive TV programs was also defined. The joint utilization of infra-structure and techniques allows for the development of Interactive TV advanced applications. As an example of these applications, this work developed an automatic Interactive TV personalization and adaptation service. This service allows a user to access, on-demand, a program specially designed to match his interests and allowing content access through devices with mobile and non-mobile features.

The primary objective of this thesis is to provide a low-complexity rate-distortion optimal coding mode selection method in digital video encoding. To achieve optimal compression efficiency in the rate-distortion framework with low computational complexity, we first propose a rate-distortion model and then apply it to the coding mode selection problem. The computational complexity of the proposed method is very low compared to overall encoder complexity because the proposed method uses simple image properties such as variance that can be obtained easily. Also, the proposed method gives significant PSNR gains over the mode selection scheme used in TM5 for MPEG-2 because the rate-distortion model considers rate constraints of each mode as well as distortion. We extend the model-based mode selection approach to motion vector selection for further improvement of the coding efficiency. In addition to our theoretical work, we present practical solutions to real-time implementation of encoder modules including our proposed mode selection method on digital signal processors. First, we investigate the features provided by most of the recent digital signal processors, for example, hierarchical memory structure and efficient data transfer between on-chip and off-chip memory, and then present practical approaches for real-time implementation of a video encoder system with efficient use of the features.

In this paper, we propose a Kalman filtering method to restore signal when both the digital and analog signal are available. The digital video signal is coded by method of MPEG. The error can be introduced in the quantization process of the block DCT transformation. So the quality of the image from the digital video signal needs to be improved. Considering the analog video signal is corrupted by the Gauss White Noise. We can apply the Kalman filter to these two signals at the same time to restore the image for a better quality. The image structure is defined to be the linear relationship between pixels with their upper and left neighbors. So we can determinate the image structure property by the linear equations of the pixel gray level. Generally, the image segmentation takes the gray values as the property. In our case we take the linear equations as our property function. This property implies an abstract concept and can¡¦t measure directly. We determine the unity of the image structure by measuring the error from merging the pixel into one region. We achieve a recursive formula for computing the error by the sequential least square error method. In the signal processing, Kalman filter is used for optimal estimation of the signal corrupted by additive noise. We segment the image by its local property. By our segmentation technique every region has its specific image structure. The structures are system parameters of Kalman filter. We first utilize the method of segmentation on the image recovered from the MPEG signal to find the local parameters. The results of experiments show that we can improve the images quality when the MPEG signal is not very good.

MPEG1-Player in Java / Workshop Mensch-Computer-Vernetzung MPEG1-Player in Java

Thèse de doctorat--Signal et images--Paris--ENST, 2006. / En appendice, un article en anglais. Bibliogr. p. 209-218. Glossaire. Index. Résumé.

One of the key aspects of digital broadcast television is the need to compress the digital video to reduce the transmission bandwidth requirement. Numerous video coding standards have been defined with properties that depend upon the targeted application. For example, H.263 is primarily designed for low bit-rate applications, and MPEG-II is used for applications where quality is the most important aspect. These coding standards are primarily models for how to efficiently code video. They, in general, do not consider how the coded video is broadcast, and how the compressed video bitstream responds to transmission errors. In this thesis, the properties of the MPEG-II coding standard are investigated (although many of the results are extensible to the other frequency transform based video codecs).

O trabalho apresentado nesta tese trata do desenvolvimento de técnicas com suporte à ciência de contexto, baseadas nos padrões MPEG-4 e MPEG-7, para personalizar e adaptar conteúdo em TV Interativa. Um dos desafios dessa área é desenvolvimento de programas personalizados com rico conteúdo multimídia, com alta interatividade e que, além disso, sejam acessíveis a partir de uma variedade de dispositivos (fixos ou móveis), atendendo às expectativas de interação e de acesso dos usuários. Grande parte do problema está no fato de que os modos encontrados na literatura para representar, descrever e compor programas de TV Interativa não oferecem suporte a contexto, não permitem a separação entre descrições de programas e descrições de objetos e possuem baixa granulosidade de segmentação. Essas características dificultam e, em alguns casos, impedem o desenvolvimento de aplicações avançadas em TV Interativa. As técnicas desenvolvidas neste trabalho são baseadas em esquemas de descrição, compatíveis com o padrão MPEG-7, e na segmentação de programas em objetos MPEG-4. Os esquemas são utilizados para descrever a estrutura, a composição e a semântica de programas e de seus objetos componentes. Também foi definida e implantada uma infra-estrutura para produção, distribuição e consumo de programas. A utilização conjunta da infra-estrutura e das técnicas permite o desenvolvimento de aplicações avançadas em TV Interativa. Como um exemplo dessas aplicações, foi desenvolvido um serviço automático para personalizar e adaptar programas de TV Interativa, permitindo que um usuário possa acessar, sob demanda, programas especialmente produzidos para ele, contendo apenas assuntos de seu interesse e permitindo que o acesso possa ser realizado por dispositivos fixos ou móveis. / The work presented in this thesis developed techniques with context-awareness support, based on the MPEG-4 and MPEG-7 standards, in order to personalize and to adapt Interactive TV content. One of the challenges in this area is the development of personalized programs with rich multimedia content, high interactivity and accessibility through a variety of devices (mobile and non-mobile). Most part of the problem is that the approaches found in literature do not provide context support, do not allow separation between programs and objects descriptions and have low level of segmentation granularity. These features make difficult or impossible, in some cases, the development of Interactive TV applications. The techniques developed in this work are based on MPEG-7 compliant schemes and on programs segmentation into MPEG-4 objects. The schemes are used to describe structure, composition and semantics of programs and component objects. An infra-structure to creation, delivery and consumption of Interactive TV programs was also defined. The joint utilization of infra-structure and techniques allows for the development of Interactive TV advanced applications. As an example of these applications, this work developed an automatic Interactive TV personalization and adaptation service. This service allows a user to access, on-demand, a program specially designed to match his interests and allowing content access through devices with mobile and non-mobile features.

Ce mémoire constitue l'aboutissement du projet de recherche de Patrick Keroulas et aborde la notion de compression vidéo, domaine en pleine ébullition avec la démocratisation de l'équipement vidéo et des réseaux de télécommunication. La question initiale est de savoir s'il est possible de modifier le contenu de l'image directement dans un flux binaire provenant d'une séquence vidéo compressée. Un tel dispositif permettrait d'ajouter des modifications en n'importe quel point d'un réseau en évitant le décodage et recodage du flux de données, ces deux processus étant très coûteux en termes de calcul. Brièvement présentés dans la première partie, plusieurs travaux ont déjà proposé une gamme assez large de méthodes de filtrage, de débruitage, de redimensionnement de l'image, etc. Toutes les publications rencontrées à ce sujet se concentrent sur la transposition des traitements de l'image du domaine spatial vers le domaine fréquentiel. Il a été convenu de centrer la problématique sur une application potentiellement exploitable dans le domaine de la télédiffusion. Il s'agit d'incruster un logo ajustable en position et en opacité dans un fichier vidéo codé avec la norme MPEG-2, encore couramment utilisée. La transformée appliquée par cet algorithme de compression est la DCT (Discrete Cosine Transform). Un article publié en 1995 traitant de la composition vidéo en général est plus détaillé car il sert de base à cette étude. Certains outils proposés qui reposent sur la linéarité et l'orthogonalité de la transformée seront repris dans le cadre de ce projet, mais la démarche proposée pour résoudre les problèmes temporels est différente. Ensuite, les éléments essentiels de la norme MPEG-2 sont présentés pour en comprendre les mécanismes et également pour exposer la structure d'un fichier codé car, en pratique, ce serait la seule donnée accessible. Le quatrième chapitre de l'étude présente la solution technique mise en oeuvre via un article soumis à IEEE Transactions on Broadcasting. C'est dans cette partie que toutes les subtilités liées au codage sont traitées : la structure en blocs de pixel, la prédiction spatiale, la compensation de mouvement au demi-pixel près, la nécessité ou non de la quantification inverse. À la vue des résultats satisfaisants, la discussion finale porte sur la limite du système : le compromis entre son efficacité, ses degrés de liberté et le degré de décodage du flux.