O Color Mixture é uma técnica para segmentação de imagens coloridas, que cria uma \"Retina Artificial\" baseada na mistura de cores, e faz a quantização da imagem projetando todas as cores em 256 planos no cubo RGB. Em seguida, atravessa todos esses planos com um classificador Gaussiano, visando à segmentação da imagem. Porém, a abordagem atual possui algumas limitações. O classificador atual resolve exclusivamente problemas binários. Inspirado nesta \"Retina Artificial\" do Color Mixture, esta tese define uma nova \"Retina Artificial\", propondo a substituição do classificador atual por uma rede neural artificial para cada um dos 256 planos, com o objetivo de melhorar o desempenho atual e estender sua aplicação para problemas multiclasse e multiescala. Para esta nova abordagem é dado o nome de Neural Color Mixture. Para a validação da proposta foram realizadas análises estatísticas em duas áreas de aplicação. Primeiramente para a segmentação de pele humana, tendo sido comparado seus resultados com oito métodos conhecidos, utilizando quatro conjuntos de dados de tamanhos diferentes. A acurácia de segmentação da abordagem proposta nesta tese superou a de todos os métodos comparados. A segunda avaliação prática do modelo proposto foi realizada com imagens de satélite devido à vasta aplicabilidade em áreas urbanas e rurais. Para isto, foi criado e disponibilizado um banco de imagens, extraídas do Google Earth, de dez regiões diferentes do planeta, com quatro escalas de zoom (500 m, 1000 m, 1500 m e 2000 m), e que continham pelo menos quatro classes de interesse: árvore, solo, rua e água. Foram executados quatro experimentos, sendo comparados com dois métodos, e novamente a proposta foi superior. Conclui-se que a nova proposta pode ser utilizada para problemas de segmentação de imagens coloridas multiclasse e multiescala. E que possivelmente permite estender o seu uso para qualquer aplicação, pois envolve uma fase de treinamento, em que se adapta ao problema. / The Color Mixture is a technique for color images segmentation, which creates an \"Artificial Retina\" based on the color mixture, and quantizes the image by projecting all the colors in 256 plans into the RGB cube. Then, it traverses all those plans with a Gaussian classifier, aiming to reach the image segmentation. However, the current approach has some limitations. The current classifier solves exclusively binary problems. Inspired by this \"Artificial Retina\" of the Color Mixture, we defined a new \"Artificial Retina\", as well as we proposed the replacement of the current classifier by an artificial neural network for each of the 256 plans, with the goal of improving current performance and extending your application to multiclass and multiscale issues. We called this new approach \"Neural Color Mixture\". To validate the proposal, we analyzed it statistically in two areas of application. Firstly for the human skin segmentation, its results were compared with eight known methods using four datasets of different sizes. The segmentation accuracy of the our proposal in this thesis surpassed all the methods compared. The second practical evaluation of the our proposal was carried out with satellite images due to the wide applicability in urban and rural areas. In order to do this, we created and made available a database of satellite images, extracted from Google Earth, from ten different regions of the planet, with four zoom scales (500 m, 1000 m, 1500 m and 2000 m), which contained at least four classes of interest: tree, soil, street and water. We compared our proposal with a neural network of the multilayer type (ANN-MLP) and an Support Vector Machine (SVM). Four experiments were performed, compared to two methods, and again the proposal was superior. We concluded that our proposal can be used for multiclass and multiscale color image segmentation problems, and that it possibly allows to extend its use to any application, as it involves a training phase, in which our methodology adapts itself to any kind of problem.

The quantitative assessment of lymph node size plays an important role in treatment of diseases like cancer. In current clinical practice, lymph nodes are analyzed manually based on very rough measures of long and/or short axis length, which is error prone. In this paper we present a graph-based lymph node segmentation method to enable the computer-aided three-dimensional (3D) assessment of lymph node size. Our method has been validated on 111 cases of enlarged lymph nodes imaged with X-ray computed tomography (CT). For unsigned surface positioning error, Hausdorff distance and Dice coefficient, the mean was around 0.5 mm, under 3.26 mm and above 0.77 respectively. On average, 5.3 seconds were required by our algorithm for the segmentation of a lymph node.

This memo describes the initial results of a project to create a self-supervised algorithm for learning object segmentation from video data. Developmental psychology and computational experience have demonstrated that the motion segmentation of objects is a simpler, more primitive process than the detection of object boundaries by static image cues. Therefore, motion information provides a plausible supervision signal for learning the static boundary detection task and for evaluating performance on a test set. A video camera and previously developed background subtraction algorithms can automatically produce a large database of motion-segmented images for minimal cost. The purpose of this work is to use the information in such a database to learn how to detect the object boundaries in novel images using static information, such as color, texture, and shape. This work was funded in part by the Office of Naval Research contract #N00014-00-1-0298, in part by the Singapore-MIT Alliance agreement of 11/6/98, and in part by a National Science Foundation Graduate Student Fellowship.

Perceptual grouping is essential to manage the complexity of real world scenes. We explore bottom-up grouping at three different levels. Starting from low-level grouping, we propose a novel method for oversegmenting an image into compact superpixels, reducing the complexity of many high-level tasks. Unlike most low-level segmentation techniques, our geometric flow formulation enables us to impose additional compactness constraints, resulting in a fast method with minimal undersegmentation. Our subsequent work utilizes compact superpixels to detect two important mid-level shape regularities, closure and symmetry. Unlike the majority of closure detection approaches, we transform the closure detection problem into one of finding a subset of superpixels whose collective boundary has strong edge support in the image. Building on superpixels, we define a closure cost which is a ratio of a novel learned boundary gap measure to area, and show how it can be globally minimized to recover a small set of promising shape hypotheses. In our final contribution, motivated by the success of shape skeletons, we recover and group symmetric parts without assuming prior figure-ground segmentation. Further exploiting superpixel compactness, superpixels are this time used as an approximation to deformable maximal discs that comprise a medial axis. A learned measure of affinity between neighboring superpixels and between symmetric parts enables the purely bottom-up recovery of a skeleton-like structure, facilitating indexing and generic object recognition in complex real images.

Spaceborne Synthetic Aperture Radar (SAR) is commonly considered a powerful sensor to detect sea ice. Unfortunately, the sea-ice types in SAR images are difficult to be interpreted due to speckle noise. SAR image denoising therefore becomes a critical step of SAR sea-ice image processing and analysis. In this study, a two-phase approach is designed and implemented for SAR sea-ice image segmentation. In the first phase, a Gamma-based bilateral filter is introduced and applied for SAR image denoising in the local domain. It not only perfectly inherits the conventional bilateral filter with the capacity of smoothing SAR sea-ice imagery while preserving edges, but also enhances it based on the homogeneity in local areas and Gamma distribution of speckle noise. The Gamma-based bilateral filter outperforms other widely used filters, such as Frost filter and the conventional bilateral filter. In the second phase, the K-means clustering algorithm, whose initial centroids are optimized, is adopted in order to obtain better segmentation results. The proposed approach is tested using both simulated and real SAR images, compared with several existing algorithms including K-means, K-means based on the Frost filtered images, and K-means based on the conventional bilateral filtered images. The F1 scores of the simulated results demonstrate the effectiveness and robustness of the proposed approach whose overall accuracies maintain higher than 90% as variances of noise range from 0.1 to 0.5. For the real SAR images, the proposed approach outperforms others with average overall accuracy of 95%.

Perceptual grouping is essential to manage the complexity of real world scenes. We explore bottom-up grouping at three different levels. Starting from low-level grouping, we propose a novel method for oversegmenting an image into compact superpixels, reducing the complexity of many high-level tasks. Unlike most low-level segmentation techniques, our geometric flow formulation enables us to impose additional compactness constraints, resulting in a fast method with minimal undersegmentation. Our subsequent work utilizes compact superpixels to detect two important mid-level shape regularities, closure and symmetry. Unlike the majority of closure detection approaches, we transform the closure detection problem into one of finding a subset of superpixels whose collective boundary has strong edge support in the image. Building on superpixels, we define a closure cost which is a ratio of a novel learned boundary gap measure to area, and show how it can be globally minimized to recover a small set of promising shape hypotheses. In our final contribution, motivated by the success of shape skeletons, we recover and group symmetric parts without assuming prior figure-ground segmentation. Further exploiting superpixel compactness, superpixels are this time used as an approximation to deformable maximal discs that comprise a medial axis. A learned measure of affinity between neighboring superpixels and between symmetric parts enables the purely bottom-up recovery of a skeleton-like structure, facilitating indexing and generic object recognition in complex real images.

Image segmentation is an important step in image processing, with many applications such as pattern recognition, object detection, and medical image analysis. It is a technique that separates objects of interests from the background in an image. Geometric active contour is a recent image segmentation method that overcomes previous problems with snakes. It is an attractive method for medical image segmentation as it is able to capture the object of interest in one continuous curve. The theory and implementation details of geometric active contours are discussed in this work. The robustness of the algorithm is tested through a series of tests, involving both synthetic images and medical images. Curve leaking past boundaries is a common problem in cases of non-ideal edges. Noise is also problematic for the advancement of the curve. Smoothing and parameters selection are discussed as ways to help solve these problems. This work also explores the incorporation of the multi-resolution method of Gaussian pyramids into the algorithm. Multi-resolution methods, used extensively in the areas of denoising and edge-selection, can help capture the spatial structure of an image. Results show that similar to the multi-resolution methods applied to parametric active contours, the multi-resolution can greatly increase the computation without sacrificing performance. In fact, results show that with successive smoothing and sub-sampling, performance often improves. Although smoothing and parameter adjustment help improve the performance of geometric active contours, the edge-based approach is still localized and the improvement is limited. Region-based approaches are recommended for further work on active contours.

The task is to build an intelligent sensor that can instruct a Lego robot to perform certain tasks. The sensor is mounted on the Lego robot and it contains a digital camera which takes continuous images of the front view of the robot. These images are received by an FPGA which simultaneously saves them in an external storage device (SDRAM). At one time only one image is saved and during the time it is being saved, FPGA processes the image to extract some meaningful information. In front of digital camera there are different objects. The sensor is made to classify various objects on the basis of their color. For the classification, the requirement is to implement color image segmentation based object tracking algorithm on a small Field Programmable Gate array (FPGA). For the color segmentation in the images, we are using RGB values of the pixels and with the comparison of their relative values we get the binary image which is processed to determine the shape of the object. A histogram is used to retrieve object‟s features and saves results inside the memory of FPGA which can be read by an external microcontroller with the help of serial port (RS-232).

Image segmentation is an important step in image processing, with many applications such as pattern recognition, object detection, and medical image analysis. It is a technique that separates objects of interests from the background in an image. Geometric active contour is a recent image segmentation method that overcomes previous problems with snakes. It is an attractive method for medical image segmentation as it is able to capture the object of interest in one continuous curve. The theory and implementation details of geometric active contours are discussed in this work. The robustness of the algorithm is tested through a series of tests, involving both synthetic images and medical images. Curve leaking past boundaries is a common problem in cases of non-ideal edges. Noise is also problematic for the advancement of the curve. Smoothing and parameters selection are discussed as ways to help solve these problems. This work also explores the incorporation of the multi-resolution method of Gaussian pyramids into the algorithm. Multi-resolution methods, used extensively in the areas of denoising and edge-selection, can help capture the spatial structure of an image. Results show that similar to the multi-resolution methods applied to parametric active contours, the multi-resolution can greatly increase the computation without sacrificing performance. In fact, results show that with successive smoothing and sub-sampling, performance often improves. Although smoothing and parameter adjustment help improve the performance of geometric active contours, the edge-based approach is still localized and the improvement is limited. Region-based approaches are recommended for further work on active contours.

This thesis describes a probabilistic approach to imagesegmentation and interpretation. The focus of the investigation is the development of a systematic way of combining color, brightness, texture and geometric features extracted from an image to arrive at a consistent interpretation for each pixel in the image. The contribution of this thesis is thus the presentation of a novel framework for the fusion of extracted image features producing a segmentation of an image into relevant regions. Further, a solution to the sub-pixel mixing problem is presented based on solving a probabilistic linear program. This work is specifically aimed at interpreting and digitizing multi-spectral aerial imagery of the Earth's surface. The features of interest for extraction are those of relevance to environmental management, monitoring and protection. The presented algorithms are suitable for use within a larger interpretive system. Some results are presented and contrasted with other techniques. The integration of these algorithms into a larger system is based firmly on a probabilistic methodology and the use of statistical decision theory to accomplish uncertain inference within the visual formalism of a graphical probability model.