Road traffic signs provide instructions, warning information, to regulate driver behavior. In addition, these signs provide a reliable guarantee for safe and convenient driving. The Traffic Sign Detection and Recognition (TSDR) system is one of the primary applications for Advanced Driver Assistance Systems (ADAS). TSDR has obtained a great deal of attention over the recent years. But, it is still a challenging field of image processing. In this thesis, we first created our own dataset for North American Traffic Signs, which is still being updated. We then decided to choose Histogram Orientation Gradients (HOG) and Support Vector Machines (SVMs) to build our system after comparing them with some other techniques. For better results, we tested different HOG parameters to find the best combination. After this, we developed a TSDR system using HOG, SVM and our new color information extraction algorithm. To reduce time-consumption, we used the Maximally Stable Extremal Region (MSER) to replace the HOG and SVM detection stage. In addition, we developed a new approach based on Global Positioning System (GPS) information other than image processing. At last, we tested these three systems; the results show that all of them can recognize traffic signs with a good accuracy rate. The MSER based system is faster than the one using only HOG and SVM; and, the GPS based system is even faster than the MSER based system.

In this thesis, real time detection of traffic signs using FPGA hardware is presented. Traffic signs have distinctive color and shape properties. Therefore, color and shape based algorithms are chosen to implemented on FPGA. FPGA supports sufficient logic to implement complete systems and sub-systems. Color information of images/frames is used to minimize the search domain of detection process. Using FPGA, real time conversion of YUV space to RGB space is performed. Furthermore, color thresholding algorithm is used to localize the sign in the image/video depending on the color. Edges are the most important image/frame attributes that provide valuable information about the shape of the objects. Sobel edge detection algorithm is implemented on FPGA. After color segmentation, FPGA implementation of Sobel algorithm is used to find the edges of candidate traffic signs in real time. Later, radial symmetry based shape detection algorithm is used to determine circular traffic signs. Each FPGA implemented algorithm is tested by using video sequences and static images. In addition, combined implementation of color based and shape based algorithms are tested. Joint application of color and shape based algorithms are used in order to reduce search domain and the processing time of detection process. Designing architecture on FPGA makes traffic sign detection system portable as a final product and relatively more efficient than the computer based detection systems. The resulting hardware is suitable where cost and compactness constraints are important.

This master thesis deals with the design of a traffic sign detector using the image processing methods. The OpenCV library for working with images in programming language Python is used for this. The first part reports on the using methods. In the next part, these methods were tested on images of traffic signs taken in traffic in different lighting conditions. The results of these tests led to the design of optimal methods and their settings, which were re-verified by verifying on video of driving in traffic. This also revealed the conditions under which they can operate in real-time systems. Finally, an optimization algorithm for compensation of detection errors was proposed from the monitoring of detection waveforms.

A mobilidade é uma marca da nossa civilização. Tanto o transporte de carga quanto o de passageiros compartilham de uma enorme infra-estrutura de conexões operados com o apoio de um sofisticado sistema logístico. Simbiose otimizada de módulos mecânicos e elétricos, os veículos evoluem continuamente com a integração de avanços tecnológicos e são projetados para oferecer o melhor em conforto, segurança, velocidade e economia. As regulamentações organizam o fluxo de transporte rodoviário e as suas interações, estipulando regras a fim de evitar conflitos. Mas a atividade de condução pode tornar-se estressante em diferentes condições, deixando os condutores humanos propensos a erros de julgamento e criando condições de acidente. Os esforços para reduzir acidentes de trânsito variam desde campanhas de re-educação até novas tecnologias. Esses tópicos têm atraído cada vez mais a atenção de pesquisadores e indústrias para Sistemas de Transporte Inteligentes baseados em imagens. Este trabalho apresenta um estudo sobre técnicas de detecção e classificação de sinalização vertical de trânsito em imagens de cenários de tráfego complexos. O sistema de reconhecimento visual automático dos sinais destina-se a ser utilizado para o auxílio na atividade de direção de um condutor humano ou como informação para um veículo autônomo. Com base nas normas para sinalização viária, foram testadas duas abordagens para a segmentação de imagens e seleção de regiões de interesse. O primeiro, uma limiarização de cor em conjunto com Descritores de Fourier. Seu desempenho não foi satisfatório. No entanto, utilizando os seus princípios, desenvolveu-se um novo método de filtragem de cores baseado em Lógica Fuzzy que, juntamente com um algoritmo de seleção de regiões estáveis em diferentes tons de cinza (MSER), ganhou robustez à oclusão parcial e a diferentes condições de iluminação. Para classificação, duas Redes Neurais Convolucionais curtas são apresentadas para reconhecer sinais de trânsito brasileiros e alemães. A proposta é ignorar cálculos complexos ou features selecionadas manualmente para filtrar falsos positivos antes do reconhecimento, realizando a confirmação (etapa de detecção) e a classificação simultaneamente. A utilização de métodos do estado da arte para treinamento e otimização melhoraram a eficiência da técnica de aprendizagem da máquina. Além disso, este trabalho fornece um novo conjunto de imagens com cenários de tráfego em diferentes regiões do Brasil, contendo 2.112 imagens em resolução WSXGA+. As análises qualitativas são mostradas no conjunto de dados brasileiro e uma análise quantitativa com o conjunto de dados alemão apresentou resultados competitivos com outros métodos: 94% de acurácia na extração e 99% de acurácia na classificação. / Mobility is an imprint of our civilization. Both freight and passenger transport share a huge infrastructure of connecting links operated with the support of a sophisticated logistic system. As an optimized symbiosis of mechanical and electrical modules, vehicles are evolving continuously with the integration of technological advances and are engineered to offer the best in comfort, safety, speed and economy. Regulations organize the flow of road transportation machines and help on their interactions, stipulating rules to avoid conflicts. But driving can become stressing on different conditions, leaving human drivers prone to misjudgments and creating accident conditions. Efforts to reduce traffic accidents that may cause injuries and even deaths range from re-education campaigns to new technologies. These topics have increasingly attracted the attention of researchers and industries to Image-based Intelligent Transportation Systems. This work presents a study on techniques for detecting and classifying traffic signs in images of complex traffic scenarios. The system for automatic visual recognition of signs is intended to be used as an aid for a human driver or as input to an autonomous vehicle. Based on the regulations for road signs, two approaches for image segmentation and selection of regions of interest were tested. The first one, a color thresholding in conjunction with Fourier Descriptors. Its performance was not satisfactory. However, using its principles, a new method of color filtering using Fuzzy Logic was developed which, together with an algorithm that selects stable regions in different shades of gray (MSER), the approach gained robustness to partial occlusion and to different lighting conditions. For classification, two short Convolutional Neural Networks are presented to recognize both Brazilian and German traffic signs. The proposal is to skip complex calculations or handmade features to filter false positives prior to recognition, making the confirmation (detection step) and the classification simultaneously. State-of-the-art methods for training and optimization improved the machine learning efficiency. In addition, this work provides a new dataset with traffic scenarios in different regions of Brazil, containing 2,112 images in WSXGA+ resolution. Qualitative analyzes are shown in the Brazilian dataset and a quantitative analysis with the German dataset presented competitive results with other methods: 94% accuracy in extraction and 99% accuracy in the classification.

A mobilidade é uma marca da nossa civilização. Tanto o transporte de carga quanto o de passageiros compartilham de uma enorme infra-estrutura de conexões operados com o apoio de um sofisticado sistema logístico. Simbiose otimizada de módulos mecânicos e elétricos, os veículos evoluem continuamente com a integração de avanços tecnológicos e são projetados para oferecer o melhor em conforto, segurança, velocidade e economia. As regulamentações organizam o fluxo de transporte rodoviário e as suas interações, estipulando regras a fim de evitar conflitos. Mas a atividade de condução pode tornar-se estressante em diferentes condições, deixando os condutores humanos propensos a erros de julgamento e criando condições de acidente. Os esforços para reduzir acidentes de trânsito variam desde campanhas de re-educação até novas tecnologias. Esses tópicos têm atraído cada vez mais a atenção de pesquisadores e indústrias para Sistemas de Transporte Inteligentes baseados em imagens. Este trabalho apresenta um estudo sobre técnicas de detecção e classificação de sinalização vertical de trânsito em imagens de cenários de tráfego complexos. O sistema de reconhecimento visual automático dos sinais destina-se a ser utilizado para o auxílio na atividade de direção de um condutor humano ou como informação para um veículo autônomo. Com base nas normas para sinalização viária, foram testadas duas abordagens para a segmentação de imagens e seleção de regiões de interesse. O primeiro, uma limiarização de cor em conjunto com Descritores de Fourier. Seu desempenho não foi satisfatório. No entanto, utilizando os seus princípios, desenvolveu-se um novo método de filtragem de cores baseado em Lógica Fuzzy que, juntamente com um algoritmo de seleção de regiões estáveis em diferentes tons de cinza (MSER), ganhou robustez à oclusão parcial e a diferentes condições de iluminação. Para classificação, duas Redes Neurais Convolucionais curtas são apresentadas para reconhecer sinais de trânsito brasileiros e alemães. A proposta é ignorar cálculos complexos ou features selecionadas manualmente para filtrar falsos positivos antes do reconhecimento, realizando a confirmação (etapa de detecção) e a classificação simultaneamente. A utilização de métodos do estado da arte para treinamento e otimização melhoraram a eficiência da técnica de aprendizagem da máquina. Além disso, este trabalho fornece um novo conjunto de imagens com cenários de tráfego em diferentes regiões do Brasil, contendo 2.112 imagens em resolução WSXGA+. As análises qualitativas são mostradas no conjunto de dados brasileiro e uma análise quantitativa com o conjunto de dados alemão apresentou resultados competitivos com outros métodos: 94% de acurácia na extração e 99% de acurácia na classificação. / Mobility is an imprint of our civilization. Both freight and passenger transport share a huge infrastructure of connecting links operated with the support of a sophisticated logistic system. As an optimized symbiosis of mechanical and electrical modules, vehicles are evolving continuously with the integration of technological advances and are engineered to offer the best in comfort, safety, speed and economy. Regulations organize the flow of road transportation machines and help on their interactions, stipulating rules to avoid conflicts. But driving can become stressing on different conditions, leaving human drivers prone to misjudgments and creating accident conditions. Efforts to reduce traffic accidents that may cause injuries and even deaths range from re-education campaigns to new technologies. These topics have increasingly attracted the attention of researchers and industries to Image-based Intelligent Transportation Systems. This work presents a study on techniques for detecting and classifying traffic signs in images of complex traffic scenarios. The system for automatic visual recognition of signs is intended to be used as an aid for a human driver or as input to an autonomous vehicle. Based on the regulations for road signs, two approaches for image segmentation and selection of regions of interest were tested. The first one, a color thresholding in conjunction with Fourier Descriptors. Its performance was not satisfactory. However, using its principles, a new method of color filtering using Fuzzy Logic was developed which, together with an algorithm that selects stable regions in different shades of gray (MSER), the approach gained robustness to partial occlusion and to different lighting conditions. For classification, two short Convolutional Neural Networks are presented to recognize both Brazilian and German traffic signs. The proposal is to skip complex calculations or handmade features to filter false positives prior to recognition, making the confirmation (detection step) and the classification simultaneously. State-of-the-art methods for training and optimization improved the machine learning efficiency. In addition, this work provides a new dataset with traffic scenarios in different regions of Brazil, containing 2,112 images in WSXGA+ resolution. Qualitative analyzes are shown in the Brazilian dataset and a quantitative analysis with the German dataset presented competitive results with other methods: 94% accuracy in extraction and 99% accuracy in the classification.

A mobilidade é uma marca da nossa civilização. Tanto o transporte de carga quanto o de passageiros compartilham de uma enorme infra-estrutura de conexões operados com o apoio de um sofisticado sistema logístico. Simbiose otimizada de módulos mecânicos e elétricos, os veículos evoluem continuamente com a integração de avanços tecnológicos e são projetados para oferecer o melhor em conforto, segurança, velocidade e economia. As regulamentações organizam o fluxo de transporte rodoviário e as suas interações, estipulando regras a fim de evitar conflitos. Mas a atividade de condução pode tornar-se estressante em diferentes condições, deixando os condutores humanos propensos a erros de julgamento e criando condições de acidente. Os esforços para reduzir acidentes de trânsito variam desde campanhas de re-educação até novas tecnologias. Esses tópicos têm atraído cada vez mais a atenção de pesquisadores e indústrias para Sistemas de Transporte Inteligentes baseados em imagens. Este trabalho apresenta um estudo sobre técnicas de detecção e classificação de sinalização vertical de trânsito em imagens de cenários de tráfego complexos. O sistema de reconhecimento visual automático dos sinais destina-se a ser utilizado para o auxílio na atividade de direção de um condutor humano ou como informação para um veículo autônomo. Com base nas normas para sinalização viária, foram testadas duas abordagens para a segmentação de imagens e seleção de regiões de interesse. O primeiro, uma limiarização de cor em conjunto com Descritores de Fourier. Seu desempenho não foi satisfatório. No entanto, utilizando os seus princípios, desenvolveu-se um novo método de filtragem de cores baseado em Lógica Fuzzy que, juntamente com um algoritmo de seleção de regiões estáveis em diferentes tons de cinza (MSER), ganhou robustez à oclusão parcial e a diferentes condições de iluminação. Para classificação, duas Redes Neurais Convolucionais curtas são apresentadas para reconhecer sinais de trânsito brasileiros e alemães. A proposta é ignorar cálculos complexos ou features selecionadas manualmente para filtrar falsos positivos antes do reconhecimento, realizando a confirmação (etapa de detecção) e a classificação simultaneamente. A utilização de métodos do estado da arte para treinamento e otimização melhoraram a eficiência da técnica de aprendizagem da máquina. Além disso, este trabalho fornece um novo conjunto de imagens com cenários de tráfego em diferentes regiões do Brasil, contendo 2.112 imagens em resolução WSXGA+. As análises qualitativas são mostradas no conjunto de dados brasileiro e uma análise quantitativa com o conjunto de dados alemão apresentou resultados competitivos com outros métodos: 94% de acurácia na extração e 99% de acurácia na classificação. / Mobility is an imprint of our civilization. Both freight and passenger transport share a huge infrastructure of connecting links operated with the support of a sophisticated logistic system. As an optimized symbiosis of mechanical and electrical modules, vehicles are evolving continuously with the integration of technological advances and are engineered to offer the best in comfort, safety, speed and economy. Regulations organize the flow of road transportation machines and help on their interactions, stipulating rules to avoid conflicts. But driving can become stressing on different conditions, leaving human drivers prone to misjudgments and creating accident conditions. Efforts to reduce traffic accidents that may cause injuries and even deaths range from re-education campaigns to new technologies. These topics have increasingly attracted the attention of researchers and industries to Image-based Intelligent Transportation Systems. This work presents a study on techniques for detecting and classifying traffic signs in images of complex traffic scenarios. The system for automatic visual recognition of signs is intended to be used as an aid for a human driver or as input to an autonomous vehicle. Based on the regulations for road signs, two approaches for image segmentation and selection of regions of interest were tested. The first one, a color thresholding in conjunction with Fourier Descriptors. Its performance was not satisfactory. However, using its principles, a new method of color filtering using Fuzzy Logic was developed which, together with an algorithm that selects stable regions in different shades of gray (MSER), the approach gained robustness to partial occlusion and to different lighting conditions. For classification, two short Convolutional Neural Networks are presented to recognize both Brazilian and German traffic signs. The proposal is to skip complex calculations or handmade features to filter false positives prior to recognition, making the confirmation (detection step) and the classification simultaneously. State-of-the-art methods for training and optimization improved the machine learning efficiency. In addition, this work provides a new dataset with traffic scenarios in different regions of Brazil, containing 2,112 images in WSXGA+ resolution. Qualitative analyzes are shown in the Brazilian dataset and a quantitative analysis with the German dataset presented competitive results with other methods: 94% accuracy in extraction and 99% accuracy in the classification.

Computer vision is an area in computer science that attempts to give computers the ability to see and recognise objects using varying sources of input, such as video or pictures. This problem is usually solved by using artificial intelligence (AI) techniques. The most common being deep learning. The project investigates the possibility of using these techniques to recognisetraffic signs in real time. This would make it possible in the future to build a user application that does this. The case study gathers information about available AI techniques, and three object detection deep learning models are selected. These are YOLOv3, SSD, and Faster R-CNN. The chosen models are used in a case study to find out which one is best suited to the task of identifying parking signs in real-time. Faster R-CNN performed the best in terms of recall and precision combined. YOLOv3 slacked behind in recall, but this could be because of how we chose to label the training data. Finally, SSD performed the worst in terms of recall, but was also relatively fast. Evaluation of the case study shows that it is possible to detect parking signs in real time. However, the hardware necessary is more powerful than that offered by currently available mobile platforms. Therefore it is concluded that a cloud solution would be optimal, if the techniques tested were to be implemented in a parking sign reading mobile app. / Datorseende är ett område inom datorvetenskap som fokuserar på att ge maskiner förmågan att se och känna igen objekt med olika typer av input, såsom bilder eller video. Detta är ett problem som ofta löses med hjälp av artificiell intelligens (AI). Mer specifikt, djupinlärning. I detta projekt undersöks möjligheten att använda djupinlärning för att känna igen trafikskyltar i realtid. Detta så att i framtiden kunna bygga en applikation, som kan byggas att känna igen parkeringsskyltar i realtid. Fallstudien samlar information om tillgängliga AI-tekniker, och tre djupinlärningsmodeller väljs ut. Dessa är YOLOv, SSD, och Faster R-CNN. Dessa modeller används i en fallstudie för att ta reda på vilken av dem som är bäst lämpad för uppgiften att känna igen parkeringsskyltar i realtid. Faster R-CNN presterade bäst vad gäller upptäckande av objekt och precision tillsammans. YOLOv3 upptäckte färre object, men det är sannolikt att detta berodde på hur vi valde att markera träningsdatan. Slutligen upptäckte SSD minst antal objekt, men presterade också relativt snabbt. Bedömning av fallstudien visar att det är möjligt att känna igen parkeringsskyltar i realtid. Den nödvändiga hårdvaran är dock kraftfullare än den som erbjuds av mobiler för närvarande. Därför dras slutsatsen att en molnlösning skulle vara optimal, om de testade teknikerna skulle användas för att implementera en app för att känna igen parkeringskyltar.

In this thesis, detection of traffic signs is studied. Since, both color and shape properties of traffic signs are distinctive / these two properties have been employed for detection. Detection using color properties is studied in two different color domains in order to examine and compare the advantages and the disadvantages of these domains for detection purposes. In addition to their color information, shape information is also employed for detection purpose. Edge information (obtained by using the Sobel Operator) of the images/frames is considered as search domain to find triangular, rectangular, octagonal and circular traffic signs. In order to improve the performance of detection process a joint implementation of shape and color based algorithms is utilized. Two different methods have been used v in order to combine these two features. Both of the algorithms help reducing the number of pixels to check whether they belong to a sign or not. This, of course, reduces the processing time of detection process. Each utilized algorithm is tested and compared with the others by using both static images from different sources and video streams. Images having adverse properties are used in order to state algorithms response for some specific conditions such as bad illumination and shadow. After implementation, results show that joint implementation of the color and shape based detection algorithms produces more accurate results. Moreover, joint implementation reduces the processing time of the detection process when compared to application of algorithms individually since it diminishes the search domain.

The traffic sign detection and recognition system is an essential part of the driver warning and assistance systems. In this thesis, traffic sign recognition system is studied. We considered circular, triangular and square Turkish traffic signs. For detection stage, we have two different approaches. In first approach, we assume that the detected signs are available. In the second approach, the region of interest of the traffic sign image is given. Traffic sign is extracted from ROI by using a detection algorithm. In recognition stage, the ring-partitioned method is implemented. In this method, the traffic sign is divided into rings and the normalized fuzzy histogram is used as an image descriptor. The histograms of these rings are compared with the reference histograms. Ring-partitions provide robustness to rotation because the rotation does not change the histogram of the ring. This is very critical for circle signs because rotation is hard to detect in circle signs. To overcome illumination problem, specified gray scale image is used. To apply this method to triangle and square signs, the circumscribed circle of these shapes is extracted. Ring partitioned method is tested for the case where the detected signs are available and the region of interests of the traffic sign is given. The data sets contain about 500 static and video captured images and the images in the data set are taken in daytime.

This paper proposes robust algorithm for detection of traffic signs in well light conditional. The algorithm uses colour based segmentation method for finding red traffic signs. Fast radial symmetry method FRS is used for identification of constituent shapes. Traffic signs are divided into four classes on the basis of the method.