Made available in DSpace on 2015-05-14T12:36:36Z (GMT). No. of bitstreams: 1 ArquivototalWolgrand.pdf: 4230827 bytes, checksum: 441ef5a8a5b7d797a80650ca78d388ee (MD5) Previous issue date: 2013-05-07 / Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Applications with multimedia content are becoming more popular, especially interactive and real-time applications. Among these applications stands multimedia systems for telemedicine that allows users to share information as surgical medical videos and patient data. This paper presents an approach to capture, represent and retrieve multimedia experiences in telemedicine. Therefore, a strategy that describes ways to store data, a notation for describing the multimedia experience and features that allow the retrieval and display of the experiences recorded was drafted. Furthermore, a service based on this strategy was implemented in the context of the Environment Video Collaboration in Health project (GTAVCS) and the Arthron tool. The Arthron tool allows management and distribution of media streams in real time and its main application is telemedicine allowing the transmission of live surgeries. The user experience when streaming live surgery involves multiple streams, their alternations, additional flows (such as exams or medical imaging), featuring a complex multimedia experience. The strategy presented in this paper is applied to precisely reproduce that experience, enabling their retrieval and viewing on demand. To validate the strategy, tests were conducted using the recording and retrieval service implementation for Arthron constructed to compare the users' perception about the experience in real time and experience reproduced by the tool. / Aplicações baseadas em vídeo estão cada vez mais populares. Elas estão disseminadas nos mais diversos campos: Telemedicina, espetáculos artístico-tecnológicos, eventos tecno-científicos, entretenimento, publicidade, dentre outros. Para algumas dessas aplicações a incorporação de ferramentas que permitam a gravação de fluxos de dados audiovisuais transmitidos em tempo real é de grande valia. O presente trabalho aborda o que chamamos de experiência multimídia que designa a recuperação da experiência de uso de um sistema voltado para Telemedicina que permite o controle de vários fluxos de dados simultâneos. Neste trabalho foi criada uma estratégia para gravação e recuperação dessa experiência.

Submitted by Viviane Lima da Cunha (viviane@biblioteca.ufpb.br) on 2016-02-15T12:04:15Z No. of bitstreams: 1 arquivototal.pdf: 2179152 bytes, checksum: f6a80c3412db9a464131b2373d2490d0 (MD5) / Made available in DSpace on 2016-02-15T12:04:15Z (GMT). No. of bitstreams: 1 arquivototal.pdf: 2179152 bytes, checksum: f6a80c3412db9a464131b2373d2490d0 (MD5) Previous issue date: 2014-10-03 / Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES / Conselho Nacional de Pesquisa e Desenvolvimento Científico e Tecnológico - CNPq / The use of Computer Graphics techniques in Telemedicine systems can enrich the streaming videos of surgeries, facilitating the understanding of patients' problems, improving communication between surgeons and the medical team and providing improvements in teaching and learning. The purpose of this work is to prepare and develop a strategy for recording 3D experience that simulates the anatomical structures of the human body, performed during a surgical transmission in real time. This multimedia experience generated by multiple streams of video, audio and 3D models is relevant to medical students that watch the transmission, both live and non-simultaneous form. In this scenario, emerges the need of a strategy to enable the recording of the 3D experience in the context of the Arthron tool, which already has modules that allows recording audio and video streams transmitted in real time surgeries, but not the 3D experience. Thus, a multimedia system can use the proposed strategy to record some extra content transmitted in real time that subsequently needs to be played again. With this strategy, we intend to make a larger amount of members of medical teams to have access to materials generated by multimedia streams in real time, providing an extensive training program, independent of geographical distances. / A utilização de técnicas de Computação Gráfica em conjunto com sistemas de Telemedicina pode enriquecer as transmissões de vídeos de cirurgias, facilitar o entendimento dos problemas dos pacientes, melhorar a comunicação entre os cirurgiões e toda a equipe médica e prover melhorias em relação ao ensino e à aprendizagem. O objetivo deste trabalho é elaborar e desenvolver uma estratégia para gravação e reprodução de conteúdo tridimensional que simula as estruturas anatômicas do corpo humano, utilizados durante uma transmissão cirúrgica em tempo real. A experiência multimídia gerada pelos múltiplos fluxos de áudio, vídeo e modelos 3D é de grande relevância para os estudantes de Medicina que acompanham a transmissão, tanto ao vivo quanto de forma não simultânea e subsequente ao procedimento cirúrgico. Diante desse cenário, surge a necessidade de uma estratégia para viabilizar a gravação da experiência 3D no contexto da ferramenta Arthron, que já possui módulos para gravação de áudio e vídeo de cirurgias transmitidas em tempo real, mas não abrangem a gravação da experiência tridimensional. Assim, um sistema multimídia poderá utilizar a estratégia proposta para gravar algum conteúdo extra transmitido ao vivo e que posteriormente necessite ser reproduzido. Com a estratégia proposta, pretende-se fazer com que uma maior quantidade de membros de equipes médicas possa ter acesso a materiais gerados através de fluxos multimídia em tempo real, promovendo uma ampla capacitação independente de distâncias geográficas.

Dans cette thèse, nous proposons un framework d’adaptation appelé "Personalized vIdeo Adaptation Framework" (PIAF) conçu à partir des standards MPEG. PIAF intègre les contraintes sémantiques et vise à maximiser la qualité perçue par l’utilisateur lors de la visualisation de la vidéo tout en respectant les droits de propriété intellectuelle. Les contributions de cette thèse peuvent être résumées comme suit. Dans un premier temps, nous avons utilisé et étendu les standards MPEG-7 et MPEG-21 afin de représenter les préférences des utilisateurs. Nous avons ensuite proposé un modèle formel du processus d’adaptation sémantique d’une vidéo et défini une fonction d’utilité régissant le mécanisme de prise de décision du MPDA. Cette fonction tient compte de différentes dimensions de qualité (qualité perceptuelle, sémantique, temps d’exécution nécessaire) afin d’évaluer quantitativement la qualité d’un plan d’adaptation. Le processus d’adaptation que nous proposons intègre les droits de propriété intellectuelle dans le processus de décision. Dans certains cas, le plan d’adaptation qui produirait la vidéo de meilleure qualité adaptée aux préférences de l’utilisateur peut être inapplicable car il ne respecte pas les contraintes du propriétaire. Trouver le meilleur plan d’adaptation devient alors un problème NP-complet. Nous avons proposé une solution pratique à ce problème sous la forme d’une heuristique capable de sélectionner un plan très proche de l’optimum en un temps de calcul raisonnable. Afin d’implémenter ce framework, nous avons également développé un outil d’annotation sémantique de contenu vidéo (SVCAT) qui produit des annotations sémantiques structurelles et de haut niveau selon un modèle objet basé sur du contenu vidéo. Nous avons validé nos travaux avec des évaluations qualitatives et quantitatives qui nous ont permis d’étudier la performance et l'efficacité du MPDA. Nous avons validé nos travaux avec des évaluations qualitatives et quantitatives qui nous ont permis d’étudier la performance et l'efficacité du MPDA. Les résultats obtenus démontrent que la fonction d’utilité proposée présente une forte corrélation avec les évaluations subjectives fournies par des utilisateurs concernant la qualité d’une vidéo adaptée, et constitue donc une base tout à fait pertinente pour le MPDA. / Universal Multimedia Experience (UME) is the notion that a user should receive informative adapted content anytime and anywhere. Personalization of videos, which adapts their content according to user preferences, is a vital aspect of achieving the UME vision. User preferences can be translated into several types of constraints that must be considered by the adaptation process, including semantic constraints directly related to the content of the video. The overall goal of this adaptation process is to provide users with adapted content that maximizes their Quality of Experience (QoE). This QoE depends at the same time on the level of the user's satisfaction in perceiving the adapted content, the amount of knowledge assimilated by them, and the adaptation execution time. In video adaptation frameworks, the Adaptation Decision Taking Engine (ADTE), is responsible for achieving this goal. The task of the ADTE is challenging as many adaptation operations can satisfy the same semantic constraint, and thus arising in several feasible adaptation plans. Indeed, for each entity to be adapted, the ADTE must decide on the adequate adaptation operator that satisfies the user's preferences while maximizing his/her quality of experience. The first challenge to achieve in this is to objectively measure the quality of the adapted video, while considering the multiple aspects of the QoE. The second challenge is to assess beforehand this quality in order to choose the most appropriate adaptation plan among all possible ones. The third challenge is to resolve conflicting or overlapping semantic constraints, in particular conflicts arising from constraints expressed by owner's intellectual property rights (IPR) about the modification of the content. In this thesis, we tackled the aforementioned challenges by proposing a Utility Function (UF), which integrates semantic concerns with user's perceptual considerations. This UF models the relationships among adaptation operations, user preferences, and the quality of the video content. We integrated this UF into an ADTE. This ADTE performs a multi-level piecewise reasoning to choose the adaptation plan that maximizes the user-perceived quality. Furthermore, we included IPR in the adaptation process. Thereby, we modeled content owner constraints, and proposed a heuristic to resolve conflicting user and owner constraints. More, we developed SVCAT, which produces structural and high-level semantic annotation according to an original object-based video content model. We modeled as well the user's preferences proposing extensions to MPEG-7 and MPEG-21. All the developed contributions were carried out as part of a coherent framework called PIAF. We validated this research with qualitative and quantitative evaluations, which assess the performance and the efficiency of the proposed adaptation decision-taking engine within PIAF.