GPU-based raycasting is the state-of-the-art rendering technique for interactive volume visualization. The ray traversal is usually implemented in a fragment shader, utilizing the hardware in a way that was not originally intended. New programming interfaces for stream processing, such as CUDA, support a more general programming model and the use of additional device features, which are not accessible through traditional shader programming. In this paper we propose a slab-based raycasting technique that is modeled specifically to use these features to accelerate volume rendering. This technique is based on experience gained from comparing fragment shader implementations of basic raycasting to implementations directly translated to CUDA kernels. The comparison covers direct volume rendering with a variety of optional features, e.g., gradient and lighting calculations. Our findings are supported by benchmarks of typical volume visualization scenarios. We conclude that new stream processing models can only gain a small performance advantage when directly porting the basic raycasting algorithm. However, they can be advantageous through novel acceleration methods which use the hardware features not available to shader implementations.

<p>Ultrasound (US) volume data is noisy, so traditional methods for direct volume rendering (DVR) are less appropriate. Improved methods or new techniques are required. There are furthermore a high performance requirement and limited pre-processing to be considered in order for it to be used interactively, since the volume data might be time-varying.</p><p>There exist numerous techniques for improving visual perception of volume rendering, and while some perform well and produce a visually enhanced result, many are designed and compared for use with medical data that has a high signal-to-noise ratio. This master thesis describe and compare recent methods for DVR illumination, in the form of ambient occlusion or direct/indirect lighting from an external light source. New designs and modifications are introduced for efficiently and effectively enhancing the visual quality of DVR with US data. Furthermore, this thesis addresses the issue of how clipping is performed during rendering and for the different illumination techniques, which is commonly used in ultrasound visualization.</p><p>This diploma work was conducted at Siemens Corporate Research in Princeton, NJ where the partially open source framework XIP is developed. The framework was extended further to include modern methods for DVR illumination that are described in detail within this thesis. Finally, presented results show that several methods can be used to visually enhance the visualization within highly interactive frame-rates.</p>

The effectiveness of direct volume rendered images depends on finding transfer functions which emphasize structures in the underlying data. In order to support this process, we present a spreadsheet-like constructive visual component-based interface, which also allows novice users to efficiently find meaningful transfer functions. The interface uses a programming-by-example style approach and exploits the domain knowledge of the user without requiring visualization knowledge. Therefore, our application automatically analysis histograms with the Douglas-Peucker algorithm in order to identify potential structures in the data set. Sample visualizations of the resulting structures are presented to the user who can refine and combine them to more complex visualizations. Preliminary tests confirm that the interface is easy to use, and enables non-expert users to identify structures which they could not reveal with traditional transfer function editors. / <p>Short paper</p>

Ultrasound (US) volume data is noisy, so traditional methods for direct volume rendering (DVR) are less appropriate. Improved methods or new techniques are required. There are furthermore a high performance requirement and limited pre-processing to be considered in order for it to be used interactively, since the volume data might be time-varying. There exist numerous techniques for improving visual perception of volume rendering, and while some perform well and produce a visually enhanced result, many are designed and compared for use with medical data that has a high signal-to-noise ratio. This master thesis describe and compare recent methods for DVR illumination, in the form of ambient occlusion or direct/indirect lighting from an external light source. New designs and modifications are introduced for efficiently and effectively enhancing the visual quality of DVR with US data. Furthermore, this thesis addresses the issue of how clipping is performed during rendering and for the different illumination techniques, which is commonly used in ultrasound visualization. This diploma work was conducted at Siemens Corporate Research in Princeton, NJ where the partially open source framework XIP is developed. The framework was extended further to include modern methods for DVR illumination that are described in detail within this thesis. Finally, presented results show that several methods can be used to visually enhance the visualization within highly interactive frame-rates.

<p>Visualization of large scale time-varying volumetric datasets is an active topic of research. Technical limitations in terms of bandwidth and memory usage become a problem when visualizing these datasets on commodity computers at interactive frame rates. The overall objective is to overcome these limitations by adapting the methods of an existing Direct Volume Rendering pipeline. The objective is considered to be a proof of concept to assess the feasibility of visualizing large scale time-varying datasets using this pipeline. The pipeline consists of components from previous research, which make extensive use of graphics hardware to visualize large scale static data on commodity computers.</p><p>This report presents a diploma work, which adapts the pipeline to visualize flow features concealed inside the large scale Computational Fluid Dynamics dataset. The work provides a foundation to address the technical limitations of the commodity computer to visualize time-varying datasets. The report describes the components making up the Direct Volume Rendering pipeline together with the adaptations. It also briefly describes the Computational Fluid Dynamics simulation, the flow features and an earlier visualization approach to show the system’s limitations when exploring the dataset.</p>

Visualization of large scale time-varying volumetric datasets is an active topic of research. Technical limitations in terms of bandwidth and memory usage become a problem when visualizing these datasets on commodity computers at interactive frame rates. The overall objective is to overcome these limitations by adapting the methods of an existing Direct Volume Rendering pipeline. The objective is considered to be a proof of concept to assess the feasibility of visualizing large scale time-varying datasets using this pipeline. The pipeline consists of components from previous research, which make extensive use of graphics hardware to visualize large scale static data on commodity computers. This report presents a diploma work, which adapts the pipeline to visualize flow features concealed inside the large scale Computational Fluid Dynamics dataset. The work provides a foundation to address the technical limitations of the commodity computer to visualize time-varying datasets. The report describes the components making up the Direct Volume Rendering pipeline together with the adaptations. It also briefly describes the Computational Fluid Dynamics simulation, the flow features and an earlier visualization approach to show the system’s limitations when exploring the dataset.

This thesis proposes an efficient method to accelerate ray based volume rendering with texture slabs using programmable graphics hardware. In this method, empty space skipping and early ray termination are utilized without performing any preprocessing on CPU side. The acceleration structure is created on the fly by making use of depth buffer efficiently on Graphics Processing Unit (GPU) side. In the proposed method, texture slices are grouped together to form a texture slab. Rendering all the slabs from front to back viewing order in multiple rendering passes generates the resulting volume image. Slab silhouette maps (SSM) are created to identify and skip empty spaces along the ray direction at pixel level. These maps are created from the alpha component of the slab and stored in the depth buffer. In addition to the empty region information, SSM also contains information about the terminated rays. The method relies on hardware z-occlusion culling that is realized by means of SSMs to accelerate ray traversals. The cost of generating this acceleration data structure is very small compared to the total rendering time.

A exploração visual dos dutos biliares é de relevante interesse clínico, pois fornece informação relacionada com a Atresia Biliar (AB). A AB é uma doença cujas causas ainda permanecem desconhecidas e que eventualmente leva a um transplante de fígado ou, nos casos mais avançados da doença, leva a óbito do paciente. A única evidência física conhecida até agora da existencia de AB é a obstrução das vias biliares. No entanto, o estudo desta doença tem sido limitado pela incapacidade de analisar o duto biliar de pacientes em estágios precoces da doença e muito pouco se sabe sobre a estrutura interna do duto biliar. Nos últimos anos, a microscopia confocal, uma técnica que permite a obtenção de conjuntos de dados 3D de amostras biológicas, tem sido utilizada em experiências médicas para estudar a estrutura interna e anatômica dos dutos biliares. Neste trabalho, é objetivo apoiar o estudo dessas estruturas através da visualização volumétrica de imagens dos dutos biliares. É proposto um pipeline de fluxo de dados capaz de processar e "renderizar"conjuntos de dados de imagens confocais utilizando o VTK (do inglês The Visualization ToolKit). O pipeline foi construído em duas etapas principais e consecutivas. Uma primeira etapa tem o objetivo de remoção de ruído e realce das estruturas relevantes por meio de filtragem no domínio da freqüência e difusão anisotrópica. O conjunto de dados assim pré-processado é usado com técnicas diretas de visualização de volumes baseadas em funções de transferência para exibir as estruturas dos dutos biliares. Os resultados mostram que a visualização volumétrica em conjunto com um pré-processamento adequado das imagens confocais permite evidenciar as regiões de interesse nos dutos biliares e melhora detalhes que são dificilmente visualizados nos dados originais. / The visual exploration of bile ducts in the liver is of relevant clinical interest, as it provides information related to the Biliary Atresia, a disease of unknown origin, which eventually leads to a liver transplant or ultimately to death. The only physical known evidence of biliary atresia is the obstruction of the bile ducts. However, the study of this disease has been limited by the inability to observe the bile duct in patients at early stages of the disease. Moreover, very little is known about the internal structure of the bile duct. In recent years, confocal microscopy, a technique that allows to obtain 3D image datasets from biological samples, has been used in medical experiments for studying the anatomical internal structure of bile ducts. We are interested in supporting the study of these structures through volumetric visualization of bile ducts images. In this work, we propose a data flow pipeline capable of processing and rendering datasets of confocal images using The Visualization ToolKit - VTK. The pipeline was built as two consecutive stages. We propose a first stage for denoising and enhancing the relevant structures of sample based on filtering in the frequency domain and anisotropic diffusion. We use the dataset preprocessed in this way for applying a direct volume rendering technique in a second stage based on transfer functions to visualize the bile duct structures. Our results have shown that volumetric visualization together with an adequate pre-processing of the confocal images allow experts to visualize the regions of interest in the bile ducts, improving details that are hardly visualized in the original data.

A exploração visual dos dutos biliares é de relevante interesse clínico, pois fornece informação relacionada com a Atresia Biliar (AB). A AB é uma doença cujas causas ainda permanecem desconhecidas e que eventualmente leva a um transplante de fígado ou, nos casos mais avançados da doença, leva a óbito do paciente. A única evidência física conhecida até agora da existencia de AB é a obstrução das vias biliares. No entanto, o estudo desta doença tem sido limitado pela incapacidade de analisar o duto biliar de pacientes em estágios precoces da doença e muito pouco se sabe sobre a estrutura interna do duto biliar. Nos últimos anos, a microscopia confocal, uma técnica que permite a obtenção de conjuntos de dados 3D de amostras biológicas, tem sido utilizada em experiências médicas para estudar a estrutura interna e anatômica dos dutos biliares. Neste trabalho, é objetivo apoiar o estudo dessas estruturas através da visualização volumétrica de imagens dos dutos biliares. É proposto um pipeline de fluxo de dados capaz de processar e "renderizar"conjuntos de dados de imagens confocais utilizando o VTK (do inglês The Visualization ToolKit). O pipeline foi construído em duas etapas principais e consecutivas. Uma primeira etapa tem o objetivo de remoção de ruído e realce das estruturas relevantes por meio de filtragem no domínio da freqüência e difusão anisotrópica. O conjunto de dados assim pré-processado é usado com técnicas diretas de visualização de volumes baseadas em funções de transferência para exibir as estruturas dos dutos biliares. Os resultados mostram que a visualização volumétrica em conjunto com um pré-processamento adequado das imagens confocais permite evidenciar as regiões de interesse nos dutos biliares e melhora detalhes que são dificilmente visualizados nos dados originais. / The visual exploration of bile ducts in the liver is of relevant clinical interest, as it provides information related to the Biliary Atresia, a disease of unknown origin, which eventually leads to a liver transplant or ultimately to death. The only physical known evidence of biliary atresia is the obstruction of the bile ducts. However, the study of this disease has been limited by the inability to observe the bile duct in patients at early stages of the disease. Moreover, very little is known about the internal structure of the bile duct. In recent years, confocal microscopy, a technique that allows to obtain 3D image datasets from biological samples, has been used in medical experiments for studying the anatomical internal structure of bile ducts. We are interested in supporting the study of these structures through volumetric visualization of bile ducts images. In this work, we propose a data flow pipeline capable of processing and rendering datasets of confocal images using The Visualization ToolKit - VTK. The pipeline was built as two consecutive stages. We propose a first stage for denoising and enhancing the relevant structures of sample based on filtering in the frequency domain and anisotropic diffusion. We use the dataset preprocessed in this way for applying a direct volume rendering technique in a second stage based on transfer functions to visualize the bile duct structures. Our results have shown that volumetric visualization together with an adequate pre-processing of the confocal images allow experts to visualize the regions of interest in the bile ducts, improving details that are hardly visualized in the original data.

A exploração visual dos dutos biliares é de relevante interesse clínico, pois fornece informação relacionada com a Atresia Biliar (AB). A AB é uma doença cujas causas ainda permanecem desconhecidas e que eventualmente leva a um transplante de fígado ou, nos casos mais avançados da doença, leva a óbito do paciente. A única evidência física conhecida até agora da existencia de AB é a obstrução das vias biliares. No entanto, o estudo desta doença tem sido limitado pela incapacidade de analisar o duto biliar de pacientes em estágios precoces da doença e muito pouco se sabe sobre a estrutura interna do duto biliar. Nos últimos anos, a microscopia confocal, uma técnica que permite a obtenção de conjuntos de dados 3D de amostras biológicas, tem sido utilizada em experiências médicas para estudar a estrutura interna e anatômica dos dutos biliares. Neste trabalho, é objetivo apoiar o estudo dessas estruturas através da visualização volumétrica de imagens dos dutos biliares. É proposto um pipeline de fluxo de dados capaz de processar e "renderizar"conjuntos de dados de imagens confocais utilizando o VTK (do inglês The Visualization ToolKit). O pipeline foi construído em duas etapas principais e consecutivas. Uma primeira etapa tem o objetivo de remoção de ruído e realce das estruturas relevantes por meio de filtragem no domínio da freqüência e difusão anisotrópica. O conjunto de dados assim pré-processado é usado com técnicas diretas de visualização de volumes baseadas em funções de transferência para exibir as estruturas dos dutos biliares. Os resultados mostram que a visualização volumétrica em conjunto com um pré-processamento adequado das imagens confocais permite evidenciar as regiões de interesse nos dutos biliares e melhora detalhes que são dificilmente visualizados nos dados originais. / The visual exploration of bile ducts in the liver is of relevant clinical interest, as it provides information related to the Biliary Atresia, a disease of unknown origin, which eventually leads to a liver transplant or ultimately to death. The only physical known evidence of biliary atresia is the obstruction of the bile ducts. However, the study of this disease has been limited by the inability to observe the bile duct in patients at early stages of the disease. Moreover, very little is known about the internal structure of the bile duct. In recent years, confocal microscopy, a technique that allows to obtain 3D image datasets from biological samples, has been used in medical experiments for studying the anatomical internal structure of bile ducts. We are interested in supporting the study of these structures through volumetric visualization of bile ducts images. In this work, we propose a data flow pipeline capable of processing and rendering datasets of confocal images using The Visualization ToolKit - VTK. The pipeline was built as two consecutive stages. We propose a first stage for denoising and enhancing the relevant structures of sample based on filtering in the frequency domain and anisotropic diffusion. We use the dataset preprocessed in this way for applying a direct volume rendering technique in a second stage based on transfer functions to visualize the bile duct structures. Our results have shown that volumetric visualization together with an adequate pre-processing of the confocal images allow experts to visualize the regions of interest in the bile ducts, improving details that are hardly visualized in the original data.