Remote visualization has emerged as a necessary tool in the analysis of big data. High-performance computing clusters can provide several benefits in scaling to larger data sizes, from parallel file systems to larger RAM profiles to parallel computation among many CPUs and GPUs. For scalable data visualization, remote visualization tools and infrastructure is critical where only pixels and interaction events are sent over the network instead of the data. In this paper, we present our pipeline using VirtualGL, TurboVNC, and ParaView to render over 40 million points using remote HPC clusters and project over 26 million pixels in a CAVE-style system. We benchmark the system by varying the video stream compression parameters supported by TurboVNC and establish some best practices for typical usage scenarios. This work will help research scientists and academicians in scaling their big data visualizations for real time interaction. / Master of Science

In the past three decades, using Augmented Reality (AR) in repair tasks has received a growing amount of attention from researchers, because AR provides the users with a more immersive experience than traditional methods, e.g., instructional booklets, and audio, and video content. However, traditional methods are mostly used today, because there are several key challenges to using AR in repair tasks. These challenges include device limita- tions, object pose tracking, human-computer interaction, and authoring. Fortunately, the research community is investigating these challenges actively. The vision of this thesis is to move the AR technology towards being widely used in this field. Under this vision, I propose an AR platform for repair tasks and address the challenges of device limitations and authoring. The platform contains a new authoring ap- proach that tracks the real components on the expert’s side to monitor her or his operations. The proposed approach gives experts a novel authoring tool to specify 6DoF movements of a component and apply the geometrical and physical constraints in real-time. To ad- dress the challenge of device limitations, I present a hybrid remote rendering framework for applications on mobile devices. In my remote rendering approach, I adopt a client-server model, where the server is responsible for rendering high-fidelity models, encoding the ren- dering results and sending them to the client, while the client renders low-fidelity models and overlays the high-fidelity frames received from the server on its rendering results. With this configuration, we are able to minimize the bandwidth requirements and interaction latency, since only key models are rendered in high-fidelity mode. I perform a quantitive analysis on the effectiveness of my proposed remote rendering method. Moreover, I conduct a user study on the subjective and objective effects of the remote rendering method on the user experience. The results show that key model fidelity has a significant influence on the objective task difficulty, while interaction latency plays an important role in the subjective task difficulty. The results of the user study show how my method can benefit the users while minimizing resource requirements. By conducting a user study for the AR remote assistance platform, I show that the proposed AR plat- form outperforms traditional instructional videos and sketching. Through questionnaires provided at the end of the experiment, I found that the proposed AR platform receives higher recommendation than sketching, and, compared to traditional instructional videos, it stands out in terms of instruction clarity, preference, recommendation and confidence of task completion. Moreover, as to the overall user experience, the proposed method has an advantage over the video method.

The aim of this thesis is to study and advance technology relating to remote rendering of Virtual Reality (VR). In remote rendering, rendered content is commonly streamed as video images in network packets from a server to a client. Experiments are conducted with varying networks and configurations throughout this work as well as with different technologies that enable or improve remote VR experiences. As an introduction to the field, the thesis begins with related studies on 360-video. Here, a statistic based on throughput alone is proposed for use in light-weight performance monitoring of encrypted HTTPS 360-video streams. The statistic gives an indication of the potential of stalls in the video stream which may be of use for network providers wanting to allocate bandwidth optimally. Moving on from 360-video into real-time remote rendering, a wireless VR adapter, TPCAST, is studied and a method for monitoring the inputand video-throughput of this device is proposed and implemented. With the monitoring tool, it is for example possible to identify video stalls that occur in TPCAST and thus determine a baseline of its robustness in terms of video delivery. Having determined the baseline, we move on to developing a prototype remote rendering system for VR. The prototype has so far been used to study the bitrate requirements of remote VR and to develop a novel method that can be used to reduce the image size from a codec-perspective by utilizing the Hidden Area Mesh (HAM) that is unique to VR. By reducing the image size, codecs can run faster and time will therefore be saved each frame, potentially reducing the latency of the system.

Submitted by Luciana Sebin (lusebin@ufscar.br) on 2016-10-05T18:53:36Z No. of bitstreams: 1 DissGPR.pdf: 4260232 bytes, checksum: 502932c8b3d277cbd1c02a8b1b48b913 (MD5) / Approved for entry into archive by Marina Freitas (marinapf@ufscar.br) on 2016-10-13T20:18:54Z (GMT) No. of bitstreams: 1 DissGPR.pdf: 4260232 bytes, checksum: 502932c8b3d277cbd1c02a8b1b48b913 (MD5) / Approved for entry into archive by Marina Freitas (marinapf@ufscar.br) on 2016-10-13T20:19:05Z (GMT) No. of bitstreams: 1 DissGPR.pdf: 4260232 bytes, checksum: 502932c8b3d277cbd1c02a8b1b48b913 (MD5) / Made available in DSpace on 2016-10-13T20:19:14Z (GMT). No. of bitstreams: 1 DissGPR.pdf: 4260232 bytes, checksum: 502932c8b3d277cbd1c02a8b1b48b913 (MD5) Previous issue date: 2016-03-07 / Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES) / The evolution of Computer Graphics, supported by the computational development, enables increasingly advanced visual creations and promotes benefits to various areas such as: Art, architecture, Product Design, Visual Design, Games, Movies, Engineering, GIS and Medicine. However, the processing power needed for applications that require a high degree of realism, restricts the use of these applications to a small portion of the entire range of the computing devices in use by the population. Recently, the evolution of mobile network technologies brought a possible solution to the inability of most mobile devices in dealing with interactive applications and a high degree of realism. The solution is based on the remote processing of applications on servers with high processing capacity, and delivery of the images produced for mobile devices made by its conversion into video and streaming broadcasts. This master dissertation explores a remote processing solution for interacting with architectural environments through tablets. Emphasis was placed in: keeping high degree of realism, difficult to achieve due to the processing requirements in real-time interactive applications; the adaptation and combination of tools available in the market; and in mitigating latency through different ways of user interaction. The evaluation of the results was carried out in training sessions, interaction and interviews with volunteers. / A evolução da Computação Gráfica apoiada no desenvolvimento computacional possibilita criações visuais cada vez mais avançadas promovendo benefícios a diversas áreas como: Artes, Arquitetura, Design de produto, Design visual, Jogos, Cinema, Engenharia, Geoprocessamento e Medicina. Porém, a capacidade de processamento exigida por aplicações que requerem elevado grau de realismo restringe o uso dessas aplicações a uma parcela pequena de toda a gama de dispositivos computacionais instalados e de uso da população. Recentemente, a evolução das tecnologias de rede móvel trouxe uma possível solução à incapacidade da maioria dos dispositivos móveis em lidar com aplicações interativas e de elevado grau de realismo. A solução baseia-se no processamento remoto das aplicações, em servidores com elevada capacidade de processamento, e na entrega das imagens produzidas para os dispositivos móveis feita através de sua conversão em vídeo e transmissão por streaming. Este trabalho explora uma solução de processamento remoto para interação com ambientes arquitetônicos através de tablets. Deu-se ênfase às questões de manutenção de elevado grau de realismo, dificultada pelas exigências de processamento em tempo real de aplicações interativas, à adaptação e combinação de ferramental disponível no mercado e à mitigação da latência através de recursos de interface com usuário. A avaliação dos resultados foi realizada em sessões de treinamento, interação e entrevistas com usuários voluntários.

Made available in DSpace on 2014-12-17T15:48:05Z (GMT). No. of bitstreams: 1 FabianoP_DISSERT.pdf: 3905877 bytes, checksum: 0721827c114aec9f61c1c690dc27dd1d (MD5) Previous issue date: 2013-04-05 / The visualization of three-dimensional(3D)images is increasigly being sed in the area of medicine, helping physicians diagnose desease. the advances achived in scaners esed for acquisition of these 3d exames, such as computerized tumography(CT) and Magnetic Resonance imaging (MRI), enable the generation of images with higher resolutions, thus, generating files with much larger sizes. Currently, the images of computationally expensive one, and demanding the use of a righ and computer for such task. The direct remote acess of these images thruogh the internet is not efficient also, since all images have to be trasferred to the user?s equipment before the 3D visualization process ca start. with these problems in mind, this work proposes and analyses a solution for the remote redering of 3D medical images, called Remote Rendering (RR3D). In RR3D, the whole hedering process is pefomed a server or a cluster of servers, with high computational power, and only the resulting image is tranferred to the client, still allowing the client to peform operations such as rotations, zoom, etc. the solution was developed using web services written in java and an architecture that uses the scientific visualization packcage paraview, the framework paraviewWeb and the PACS server DCM4CHEE.The solution was tested with two scenarios where the rendering process was performed by a sever with graphics hadwere (GPU) and by a server without GPUs. In the scenarios without GPUs, the soluction was executed in parallel with several number of cores (processing units)dedicated to it. In order to compare our solution to order medical visualization application, a third scenario was esed in the rendering process, was done locally. In all tree scenarios, the solution was tested for different network speeds. The solution solved satisfactorily the problem with the delay in the transfer of the DICOM files, while alowing the use of low and computers as client for visualizing the exams even, tablets and smart phones / A visualiza??o de imagens tridimensionais (3D) est? cada vez mais presente na ?rea da medicina, auxiliando os m?dicos no diagn?stico de doen?as e na emiss?o de laudos. Com o avan?o dos equipamentos que geram imagens tomogr?ficas dos pacientes, como os de Tomografia Computadorizada (TC), est?o sendo geradas imagens cada vez mais n?tidas e, portanto, com resolu??es e tamanhos maiores. Atualmente, as imagens contidas em um exame de TC geralmente ocupam o tamanho de dezenas e centenas de megabytes, tornando o processo de visualiza??o 3D cada vez mais pesado - exigindo do usu?rio um equipamento com bom poder computacional. O acesso remoto ? estas imagens, via internet por exemplo, tamb?m n?o ? muito eficiente, pois todas as imagens precisam ser transferidas para o equipamento do usu?rio antes que o processo de visualiza??o 3D seja iniciado. Diante destes problemas (tamanho das imagens e acesso remoto), este trabalho envolve a cria??o e an?lise de um servi?o web para renderiza??o remota de imagens m?dicas 3D, denominado RR3D. Nele, todo o processo de renderiza??o volum?trica ser? realizado por um servidor, ou cluster de servidores, com alto poder computacional e somente a imagem 3D resultante ser? enviada ao cliente, permitindo que este ainda possa fazer opera??es como rota??o, zoom etc. O servi?o web ser? desenvolvido utilizando a linguagem Java e na arquitetura do projeto ser?o utilizados o programa de visualiza??o cient?fica Paraview, o framework ParaviewWeb e o servidor DCM4CHEE

Made available in DSpace on 2016-06-02T19:06:14Z (GMT). No. of bitstreams: 1 6118.pdf: 3001954 bytes, checksum: 5643531722be67da01c9dfa9c79f4ecb (MD5) Previous issue date: 2014-05-22 / Financiadora de Estudos e Projetos / Computer graphics and virtual reality technologies allow audiovisual experiences with high level of realism, as the ones achieved in video games and movies. The synthetization of media with high degree of audiovisual realism demands specialized systems with high performance computing capacity. The profusion in the last decade of personal computing consumer electronics such as mobile and portable devices, encourages the interest in making possible, also in these devices, applications with high level of visual realism. However, due to the intrinsic limitations of the computing capability of mobile and portable devices, regarding to the physical characteristics of these devices, such as dimensions, electrical consume and heat dissipation, it s not possible directly process media with the same level of visual realism that is found in specialized systems. This research suggests the exploration of a traditional solution: the remote interaction with these applications. Challenges resulting from this approach are identified and studied. Solutions are proposed, analyzed and formalized in a architecture for reference. As a proof of concept the architecture is used in the development of applications on two scenarios: one in a local network with a media characterized by its low tolerance in delay of interaction response and another with a high tolerance media through the Internet. Also is showed the flexibility of the proposed architecture by integrating one of the applications developed with a multimedia context. / As tecnologias de computação gráfica e realidade virtual permitem experiências visuais e auditivas com alto nível de realismo sensorial, como alcançado em jogos eletrônicos e no cinema. A sintetização de mídia com alto grau de realismo visual e auditivo demanda sistemas especializados com capacidade computacional de alto desempenho. A profusão na última década de eletrônicos de consumo computacionais pessoais, como dispositivos móveis e portáteis, desperta o interesse em tornar possível, também nesses dispositivos, aplicações visuais com alto nível de realismo. Devido às limitações da capacidade computacional intrínsecas dos dispositivos móveis, decorrentes de suas características físicas, como dimensões, restrições de consumo e dissipação térmica, não é possível a execução direta de mídia interativa com o mesmo grau de realismo encontrado em sistemas especializados. Este trabalho sugere a exploração de uma solução tradicional: o processamento e a interação remota com esse tipo de mídia. Desafios decorrentes dessa solução são identificados e estudados. Soluções são propostas, analisadas e formalizadas em uma arquitetura de referência. Como prova de conceito da arquitetura explorou-se o desenvolvimento de aplicações em dois cenários: um em rede local com mídia de baixa tolerância a atrasos no tempo de resposta às interações e outra através da Internet com mídia de maior tolerância a atrasos. Mostrouse também a flexibilidade da arquitetura desenvolvida com a integração do componente cliente a um sistema com múltiplas mídias, em que a mídia remota relaciona-se integralmente com o contexto multimídia.