The aim of this master thesis is to design and implementation in language C++ a system for the detection, tracking and classification of vehicles from streams or records from traffic cameras. The system runs on the platform Robot Operating System and uses the OpenCV, FFmpeg, TensorFlow and Keras libraries. For detection is used cascade classifier, for tracking Kalman filter and for classification of the convolutional neural network. Success rate for detection is 91.93 %, tracking 81.94 % and classification 63.72 %. This system is part of a comprehensive system, that can moreover calibrate video and measure of vehicles speed. The resulting system can be used for traffic analysis.

This work focuses on creating mobile application, that helps visitors of galleries and museums to find, in a more easier way, interesting information about visual art objects.

Tato práce pojednává o technikách automatické analýzy obrazu založené na konvolučních neuronových sítích (CNN), zaměřených na klasifikaci planktonu. V oblasti studování planktonu panuje velká diverzita v jeho tvarech a velikostech. Kvůli tomuto bývá klasifikace pomocí CNN náročná, jelikož CNN typicky požadují definovanou velikost vstupu. Běžné metody využívají škálování obrazu do jednotné velikosti. Avšak kvůli tomuto jsou ztraceny drobné detaily potřebné ke správné klasifikaci. Cílem práce bylo navrhnout a implementovat CNN klasifikátor obrazových dat planktonu a prozkoumat metody, které jsou zaměřené na problematiku různorodých velikostí obrázků. Metody, jako jsou patch cropping, využití spatial pyramid pooling vrstvy, zahrnutí metadat a sestavení multi-stream modelu jsou vyhodnoceny na náročném datasetu obrázků fytoplanktonu. Takto bylo dosaženo zlepšení o 1.0 bodů pro InceptionV3 architekturu s výslednou úspěšností 96.2 %. Hlavním přínosem této práce je vylepšení CNN klasifikátorů planktonu díky úspěšné aplikaci těchto metod.

This master’s thesis deals with the implementation of functional solution for classifying road users using mobile device with Android operating system. The goal is to create Android application which classifies vehicles in real time using rear-facing camera and saves timestamps of classification. Testing is performed mostly with own, diversely modificated dataset. Five models are trained and their performance is measured in dependence on hardware. The best classification performance is from pretrained MobileNet model where transfer learning with 6 classes of own dataset is used – 62,33 %. The results are summarized and a method for faster and more accurate traffic analysis is proposed.

Diplomova praca sa zameriava na oblast zaostrovania obrazkov tvari. V teoretickej casti prace budu prezentovane moderne metody zaostrovania obrazkov pomocou jedineho obrazku a metody editacie obrazkov. Prakticka cast sa zameria na pristupy rekonstrukcie obrazkov zo sekvencie poskodenych obrazkov. Viacere modely neuronovych sieti so vstupom pre viacero obrazkov budu zhotovene a vyhodnotene. Alternativny pristup v podobe balika nastrojov na editaciu obrazkov bude taktiez predstaveny. Tieto nastroje budu vyuzivat najmodernejsie pristupy k editacii obrazkov s cielom spojit vizualne prvky tvari zo vstupnej sekvencie obrazkov do jedneho finalneho vystupu. V zavere prace budu vsetky metody navzajom porovnane.

The thesis deals with the classification of the retinal blood vessels in retinal image data. The first part of the thesis deals with the anatomy of the human eye and focuses on the description of the retina and its blood circulation. It further describes the principle of fundus camera and experimental video ophthalmoscope. The second part of the thesis is devoted to a literature search of academic publications that deal with the classification of the retinal vessels into arteries and veins. Subsequently, the principle of selected machine learning methods is presented. Based on the literature research, two methods for the classification of the blood vessels were proposed, the first one using the SVM classifier and the second one using the convolutional neural network U-Net. At the end, the analysis of vascular pulsations was performed. The practical part of the thesis was carried out in Matlab programming interface and images from the RITE, IOSTAR and AFIO database were used for classification and the retinal video sequences taken with an experimental video ophthalmoscope were processed in the analysis of pulsations.

Abstract: Background: From Previous research, state-of-the-art deep neural networks have accomplished impressive results on many images classification tasks. However, adversarial attacks can easily fool these deep neural networks by adding little noise to the input images. This vulnerability causes a significant concern in deploying deep neural network-based systems in real-world security-sensitive situations. Therefore, research in attacking and the architectures with adversarial examples has drawn considerable attention. Here, we use the technique for image classification called Convolutional Neural Networks (CNN), which is known for determining favorable results in image classification. Objectives: This thesis reviews all types of adversarial attacks and CNN architectures in the present scientific literature. Experiment to build a CNN architecture to classify the handwritten digits in the MNIST dataset. And they are experimenting with adversarial attacks on the images to evaluate the accuracy fluctuations in categorizing images. This study also includes an experiment using the defensive distillation technique to improve the architecture's performance under adversarial attacks.  Methods: This thesis includes two methods; the systematic literature review method involved finding the best performing CNN architectures and best performing adversarial attack techniques. The experimentation method consists in building a CNN model based on modified LeNet architecture with two convolutional layers, one max-pooling layer, and two dropouts. The model is trained and tested with the MNIST dataset. Then applying adversarial attacks FGSM, IFGSM, MIFGSM on the input images to evaluate the model's performance. Later this model will be modified a little by defensive distillation technique and then tested towards adversarial attacks to evaluate the architecture's performance. Results: An experiment is conducted to evaluate the robustness of the CNN architecture in classifying the handwritten digits. The graphs show the accuracy before and after implementing adversarial attacks on the test dataset. The defensive distillation mechanism is applied to avoid adversarial attacks and achieve robust architecture. Conclusions: The results showed that FGSM, I-FGSM, MI-FGSM attacks reduce the test accuracy from 95% to around 35%. These three attacks to the proposed network successfully reduced ~70% of the test accuracy in all three cases for maximum epsilon 0.3. By the defensive distillation mechanism, the test accuracy reduces from 90% to 88% for max epsilon 0.3. The proposed defensive distillation process is successful in defending the adversarial attacks.

Detta arbete presenterar en icke-destruktiv metod för att detektera och klassificera mognadsgraden hos äpplen med användning av hyperspektrala bilder. Fastställning av mognadsgraden hos äpplen är intressant för bland annat äppelodlare och musterier vid lagring och beredning. Äpplens mognadsgrad är även intressant inom växtförädling. För att fastställa mognadsgraden idag krävs att det skärs i frukten, en så kallad destruktiv metod. Hyperspektrala bilder kan idag användas inom områden som jordbruk, miljöövervakning och militär spaning. / <p>Examensarbetet är utfört vid Institutionen för teknik och naturvetenskap (ITN) vid Tekniska fakulteten, Linköpings universitet</p>

In industry, it is crucial to be able to detect damage or abnormal behavior in machines. A machine's downtime can be minimized by detecting and repairing faulty components of the machine as early as possible. It is, however, economically inefficient and labor-intensive to detect machine fault sounds manual. In comparison with manual machine failure detection, automatic failure detection systems can reduce operating and personnel costs.  Although prior research has identified many methods to detect failures in drill machines using vibration or sound signals, this field still remains many challenges. Most previous research using machine learning techniques has been based on features that are extracted manually from the raw sound signals and classified using conventional classifiers (SVM, Gaussian mixture model, etc.). However, manual extraction and selection of features may be tedious for researchers, and their choices may be biased because it is difficult to identify which features are good and contain an essential description of sounds for classification. Recent studies have used LSTM, end-to-end 1D CNN, and 2D CNN as classifiers for classification, but these have limited accuracy for machine failure detection. Besides, machine failure occurs very rarely in the data. Moreover, the sounds in the real-world dataset have complex waveforms and usually are a combination of noise and sound presented at the same time. Given that drill failure detection is essential to apply in the industry to detect failures in machines, I felt compelled to propose a system that can detect anomalies in the drill machine effectively, especially for a small dataset. This thesis proposed modern artificial intelligence methods for the detection of drill failures using drill sounds provided by Valmet AB. Instead of using raw sound signals, the image representations of sound signals (Mel spectrograms and log-Mel spectrograms) were used as the input of my proposed models. For feature extraction, I proposed using deep learning 2-D convolutional neural networks (2D-CNN) to extract features from image representations of sound signals. To classify three classes in the dataset from Valmet AB (anomalous sounds, normal sounds, and irrelevant sounds), I proposed either using conventional machine learning classifiers (KNN, SVM, and linear discriminant) or a recurrent neural network (long short-term memory). For using conventional machine learning methods as classifiers, pre-trained VGG19 was used to extract features and neighborhood component analysis (NCA) as the feature selection. For using long short-term memory (LSTM), a small 2D-CNN was proposed to extract features and used an attention layer after LSTM to focus on the anomaly of the sound when the drill changes from normal to the broken state. Thus, my findings will allow readers to detect anomalies in drill machines better and develop a more cost-effective system that can be conducted well on a small dataset. There is always background noise and acoustic noise in sounds, which affect the accuracy of the classification system. My hypothesis was that noise suppression methods would improve the sound classification application's accuracy. The result of my research is a sound separation method using short-time Fourier transform (STFT) frames with overlapped content. Unlike traditional STFT conversion, in which every sound is converted into one image, a different approach is taken. In contrast, splitting the signal into many STFT frames can improve the accuracy of model prediction by increasing the variability of the data. Images of these frames separated into clean and noisy ones are saved as images, and subsequently fed into a pre-trained CNN for classification. This enables the classifier to become robust to noise. The FSDNoisy18k dataset is chosen in order to demonstrate the efficiency of the proposed method. In experiments using the proposed approach, 94.14 percent of 21 classes were classified successfully, including 20 classes of sound events and a noisy class. / <p>Vid tidpunkten för disputationen var följande delarbeten opublicerade: delarbete 2 och 3 inskickat.</p><p>At the time of the doctoral defence the following papers were unpublished: paper 2 and 3 submitted.</p> / AISound – Akustisk sensoruppsättning för AI-övervakningssystem / MiLo — miljön i kontrolloopen

Goal of this Diploma thesis was Convolutional neural network investigation in last years. Diploma thesis also contains information about designing of appropriate Convolutional neural network models and implementation of these models in Java programming language. Result of the thesis are comparison and evaluation of results which were reached from implemented application.