Advancements in three dimensional (3D) technologies are rapidly increasing. Three Dimensional Television (3DTV) aims at creating 3D experience for the home user. Moreover, multiview autostereoscopic displays provide a depth impression without the requirement for any special glasses and can be viewed from multiple locations. One of the key issues in the 3DTV processing chain is the content generation from the available input data format video plus depth and multiview video plus depth. This data allows for the possibility of producing virtual views using depth-image-based rendering. Although depth-image-based rendering is an efficient method, it is known for appearance of artifacts such as cracks, corona and empty regions in rendered images. While several approaches have tackled the problem, reducing the artifacts in rendered images is still an active field of research.   Two problems are addressed in this thesis in order to achieve a better 3D video quality in the context of view rendering: firstly, how to improve the quality of rendered views using a direct approach (i.e. without applying specific processing steps for each artifact), and secondly, how to fill the large missing areas in a visually plausible manner using neighbouring details from around the missing regions. This thesis introduces a new depth-image-based rendering and depth-based texture inpainting in order to address these two problems. The first problem is solved by an edge-aided rendering method that relies on the principles of forward warping and one dimensional interpolation. The other problem is addressed by using the depth-included curvature inpainting method that uses appropriate depth level texture details around disocclusions.   The proposed edge-aided rendering method and depth-included curvature inpainting methods are evaluated and compared with the state-of-the-art methods. The results show an increase in the objective quality and the visual gain over reference methods. The quality gain is encouraging as the edge-aided rendering method omits the specific processing steps to remove the rendering artifacts. Moreover, the results show that large disocclusions can be effectively filled using the depth-included curvature inpainting approach. Overall, the proposed approaches improve the content generation for 3DTV and additionally, for free view point television.

O objetivo deste estudo foi avaliar o efeito de placas oclusais com guias anteriores de desoclusão e placas oclusais com contatos bilaterais e anteriores simultâneos durante os movimentos excursivos da mandíbula em pacientes com disfunção temporomandibular (DTM) e zumbido subjetivo. Foram avaliados 264 pacientes encaminhados para tratamento da DTM na FORP/USP e selecionados 32 mulheres com DTM muscular, associada ou não a DTM articular, e zumbido subjetivo que preencheram os critérios de inclusão. O diagnóstico da DTM foi realizado com o Research Diagnostic Criteria for Temporomadibular Disorders (RDC/TMD). As pacientes foram divididas randomicamente em dois grupos para utilizarem um dos dois tipos de placas. As avaliações incluíram dor à palpação, limiar de dor a pressão com algômetro, medidas da amplitude dos movimentos mandibulares, eletromiografia de superfície, relato da intensidade da dor e da loudness do zumbido em escala visual analógica (EVA) e das características do zumbido. Os pacientes também responderam a um questionário para quantificação da frequência e severidade dos sinais e sintomas de DTM (ProDTMMulti) e para a avaliação do impacto do zumbido no dia-a-dia (Tinnitus Handicap Inventory - THI). A avaliação eletromiográfica foi realizada em várias atividades com e sem placa oclusal (apertamento máximo voluntário, movimentos excursivos mandibulares, repouso e mastigação habitual) e comparada com um grupo de 13 mulheres assintomáticas. As avaliações foram realizadas inicialmente (A1), no dia de instalação das placas oclusais, após 60 dias da avaliação inicial (A2) e após 90 dias de uso da placa oclusal (A3). O período entre as avaliações A1 e A2 foi considerado um período controle. Os resultados mostraram uma significante melhora da dor relatada pelo pacientes e aumento da amplitude da abertura bucal sem dor nos dois grupos, sem diferença entre eles. A atividade eletromiográfica foi significativamente reduzida durante apertamento máximo voluntário com a placa oclusal em comparação com o apertamento em máxima intercuspidação habitual, para as demais atividades realizadas durante o exame não houve diferença significante. A avaliação do zumbido mostrou que em muitos pacientes houve remissão do sintoma após o tratamento com placa oclusal. Não houve diferença entre os grupos para todas as avaliações realizadas. Baseados nesses achados, pode-se concluir que o tratamento com ambas as placas promoveu melhora na sintomatologia dos pacientes, sem diferenças entre elas, e houve em muitos pacientes uma remissão do zumbido relatado durante o tratamento. / The aim of this study was to assess the effect of anterior guidance and bilateral balanced splints in patients with temporomandibular disorders (TMD) and subjective tinnitus. A total of 264 subjects referred for treatment of TMD in FORP/USP were evaluated and 32 women with muscular TMD with or without the diagnosis of articular TMD, who met the inclusion criteria, were selected. TMD diagnosis was performed according to Research Diagnostic Criteria for Temporomadibular Disorders (RDC/TMD). The patients were randomly divided into two groups: anterior guidance splint group and bilateral balanced splints group. The assessments included pain to palpation, pressure pain threshold with algometer, measurement of amplitude of mandibular movements, surface electromyography, pain intensity and loudness of tinnitus reports in visual analogue scale (VAS) and characteristics of tinnitus. The patients also answered a questionnaire to quantify the frequency and severity of signs and symptoms of TMD (ProDTMMulti) and to assess the impact of tinnitus on a day-to-day (Tinnitus Handicap Inventory - THI). The electromyography evaluation was performed in different activities with and without occlusal splint (maximum voluntary clenching, excursive jaw movements, resting and habitual chewing) and compared to a group of 13 asymptomatic women. The assessments were performed initially (A1), at the day of installation of the occlusal splints, after 60 days of the initial assessment (A2) and after 90 days of occlusal splint therapy (A3). The period between A1 and A2 assessments was considered a control period. The results showed a significant improvement in pain reported by patients and an increase in the amplitude of mouth opening without pain in both groups, without difference between them. The electromyographic activity was significantly reduced during maximum voluntary clenching with occlusal splint compared to clenching in maximal habitual intercuspation, to the other activities performed during the examination there was no significant difference. The tinnitus evaluation showed that in many patients there was remission of symptom after treatment with occlusal splint. There was no difference among groups for all assessments. Based on these findings it is possible to conclude that treatment with both splints promoted improvement in symptoms of patients, without differences among them, and many patients had a remission of reported tinnitus during the treatment.

O objetivo deste estudo foi avaliar o efeito de placas oclusais com guias anteriores de desoclusão e placas oclusais com contatos bilaterais e anteriores simultâneos durante os movimentos excursivos da mandíbula em pacientes com disfunção temporomandibular (DTM) e zumbido subjetivo. Foram avaliados 264 pacientes encaminhados para tratamento da DTM na FORP/USP e selecionados 32 mulheres com DTM muscular, associada ou não a DTM articular, e zumbido subjetivo que preencheram os critérios de inclusão. O diagnóstico da DTM foi realizado com o Research Diagnostic Criteria for Temporomadibular Disorders (RDC/TMD). As pacientes foram divididas randomicamente em dois grupos para utilizarem um dos dois tipos de placas. As avaliações incluíram dor à palpação, limiar de dor a pressão com algômetro, medidas da amplitude dos movimentos mandibulares, eletromiografia de superfície, relato da intensidade da dor e da loudness do zumbido em escala visual analógica (EVA) e das características do zumbido. Os pacientes também responderam a um questionário para quantificação da frequência e severidade dos sinais e sintomas de DTM (ProDTMMulti) e para a avaliação do impacto do zumbido no dia-a-dia (Tinnitus Handicap Inventory - THI). A avaliação eletromiográfica foi realizada em várias atividades com e sem placa oclusal (apertamento máximo voluntário, movimentos excursivos mandibulares, repouso e mastigação habitual) e comparada com um grupo de 13 mulheres assintomáticas. As avaliações foram realizadas inicialmente (A1), no dia de instalação das placas oclusais, após 60 dias da avaliação inicial (A2) e após 90 dias de uso da placa oclusal (A3). O período entre as avaliações A1 e A2 foi considerado um período controle. Os resultados mostraram uma significante melhora da dor relatada pelo pacientes e aumento da amplitude da abertura bucal sem dor nos dois grupos, sem diferença entre eles. A atividade eletromiográfica foi significativamente reduzida durante apertamento máximo voluntário com a placa oclusal em comparação com o apertamento em máxima intercuspidação habitual, para as demais atividades realizadas durante o exame não houve diferença significante. A avaliação do zumbido mostrou que em muitos pacientes houve remissão do sintoma após o tratamento com placa oclusal. Não houve diferença entre os grupos para todas as avaliações realizadas. Baseados nesses achados, pode-se concluir que o tratamento com ambas as placas promoveu melhora na sintomatologia dos pacientes, sem diferenças entre elas, e houve em muitos pacientes uma remissão do zumbido relatado durante o tratamento. / The aim of this study was to assess the effect of anterior guidance and bilateral balanced splints in patients with temporomandibular disorders (TMD) and subjective tinnitus. A total of 264 subjects referred for treatment of TMD in FORP/USP were evaluated and 32 women with muscular TMD with or without the diagnosis of articular TMD, who met the inclusion criteria, were selected. TMD diagnosis was performed according to Research Diagnostic Criteria for Temporomadibular Disorders (RDC/TMD). The patients were randomly divided into two groups: anterior guidance splint group and bilateral balanced splints group. The assessments included pain to palpation, pressure pain threshold with algometer, measurement of amplitude of mandibular movements, surface electromyography, pain intensity and loudness of tinnitus reports in visual analogue scale (VAS) and characteristics of tinnitus. The patients also answered a questionnaire to quantify the frequency and severity of signs and symptoms of TMD (ProDTMMulti) and to assess the impact of tinnitus on a day-to-day (Tinnitus Handicap Inventory - THI). The electromyography evaluation was performed in different activities with and without occlusal splint (maximum voluntary clenching, excursive jaw movements, resting and habitual chewing) and compared to a group of 13 asymptomatic women. The assessments were performed initially (A1), at the day of installation of the occlusal splints, after 60 days of the initial assessment (A2) and after 90 days of occlusal splint therapy (A3). The period between A1 and A2 assessments was considered a control period. The results showed a significant improvement in pain reported by patients and an increase in the amplitude of mouth opening without pain in both groups, without difference between them. The electromyographic activity was significantly reduced during maximum voluntary clenching with occlusal splint compared to clenching in maximal habitual intercuspation, to the other activities performed during the examination there was no significant difference. The tinnitus evaluation showed that in many patients there was remission of symptom after treatment with occlusal splint. There was no difference among groups for all assessments. Based on these findings it is possible to conclude that treatment with both splints promoted improvement in symptoms of patients, without differences among them, and many patients had a remission of reported tinnitus during the treatment.

The old methods used for images inpainting of the Depth Image Based Rendering (DIBR) process are inefficient in producing high-quality virtual views from captured data. From the viewpoint of the original image, the generated data’s structure seems less distorted in the virtual view obtained by translation but when then the virtual view involves rotation, gaps and missing spaces become visible in the DIBR generated data. The typical approaches for filling the disocclusion tend to be slow, inefficient, and inaccurate. In this project, a modern technique Generative Adversarial Network (GAN) is used to fill the disocclusion. GAN consists of two or more neural networks that compete against each other and get trained. This study result shows that GAN can inpaint the disocclusion with a consistency of the structure. Additionally, another method (Filling) is used to enhance the quality of GAN and DIBR images. The statistical evaluation of results shows that GAN and filling method enhance the quality of DIBR images.

Three Dimensional Video (3DV) has become increasingly popular with the success of 3D cinema. Moreover, emerging display technology offers an immersive experience to the viewer without the necessity of any visual aids such as 3D glasses. 3DV applications, Three Dimensional Television (3DTV) and Free Viewpoint Television (FTV) are auspicious technologies for living room environments by providing immersive experience and look around facilities. In order to provide such an experience, these technologies require a number of camera views captured from different viewpoints. However, the capture and transmission of the required number of views is not a feasible solution, and thus view rendering is employed as an efficient solution to produce the necessary number of views. Depth-image-based rendering (DIBR) is a commonly used rendering method. Although DIBR is a simple approach that can produce the desired number of views, inherent artifacts are major issues in the view rendering. Despite much effort to tackle the rendering artifacts over the years, rendered views still contain visible artifacts. This dissertation addresses three problems in order to improve 3DV quality: 1) How to improve the rendered view quality using a direct approach without dealing each artifact specifically. 2) How to handle disocclusions (a.k.a. holes) in the rendered views in a visually plausible manner using inpainting. 3) How to reduce spatial inconsistencies in the rendered view. The first problem is tackled by an edge-aided rendering method that uses a direct approach with one-dimensional interpolation, which is applicable when the virtual camera distance is small. The second problem is addressed by using a depth-based inpainting method in the virtual view, which reconstructs the missing texture with background data at the disocclusions. The third problem is undertaken by a rendering method that firstly inpaint occlusions as a layered depth image (LDI) in the original view, and then renders a spatially consistent virtual view. Objective assessments of proposed methods show improvements over the state-of-the-art rendering methods. Visual inspection shows slight improvements for intermediate views rendered from multiview videos-plus-depth, and the proposed methods outperforms other view rendering methods in the case of rendering from single view video-plus-depth. Results confirm that the proposed methods are capable of reducing rendering artifacts and producing spatially consistent virtual views. In conclusion, the view rendering methods proposed in this dissertation can support the production of high quality virtual views based on a limited number of input views. When used to create a multi-scopic presentation, the outcome of this dissertation can benefit 3DV technologies to improve the immersive experience.

L'intérêt toujours grandissant pour les données cartographiques fiables, notamment en milieu urbain, a motivé le développement de systèmes de cartographie mobiles terrestres. Ces systèmes sont conçus pour l'acquisition de données de très haute précision, telles que des nuages de points LiDAR 3D et des images optiques. La multitude de données, ainsi que leur diversité, rendent complexe le traitement des données issues de ce type de systèmes. Cette thèse se place dans le contexte du traitement de l'image appliqué au nuages de points LiDAR 3D issus de ce type de système.Premièrement, nous nous intéressons à des images issues de la projection de nuages de points LiDAR dans des grilles de pixels 2D régulières. Ces projections créent généralement des images éparses, dans lesquelles l'information de certains pixels n'est pas connue. Nous proposons alors différentes méthodes pour des applications telles que la génération d'orthoimages haute résolution, l'imagerie RGB-D et l'estimation de la visibilité des points d'un nuage.De plus, nous proposons d'exploiter la topologie d'acquisition des capteurs LiDAR pour produire des images de faible résolution: les range-images. Ces images offrent une représentation efficace et canonique du nuage de points, tout en étant directement accessibles à partir du nuage de points. Nous montrons comment ces images peuvent être utilisées pour simplifier, voire améliorer, des méthodes pour le recalage multi-modal, la segmentation, la désoccultation et la détection 3D. / The ever growing demand for reliable mapping data, especially in urban environments, has motivated the development of "close-range" Mobile Mapping Systems (MMS). These systems acquire high precision data, and in particular 3D LiDAR point clouds and optical images. The large amount of data, along with their diversity, make MMS data processing a very complex task. This thesis lies in the context of 2D image processing applied to 3D LiDAR point clouds acquired with MMS.First, we focus on the projection of the LiDAR point clouds onto 2D pixel grids to create images. Such projections are often sparse because some pixels do not carry any information. We use these projections for different applications such as high resolution orthoimage generation, RGB-D imaging and visibility estimation in point clouds.Moreover, we exploit the topology of LiDAR sensors in order to create low resolution images, named range-images. These images offer an efficient and canonical representation of the point cloud, while being directly accessible from the point cloud. We show how range-images can be used to simplify, and sometimes outperform, methods for multi-modal registration, segmentation, desocclusion and 3D detection.