This dissertation develops new techniques employing the Low-rank and Sparse Representation approaches to improve the performance of state-of-the-art algorithms in hyperspectral image analysis. The contributions of this dissertation are outlined as follows. 1) Low-rank and sparse representation approaches, i.e., low-rank representation (LRR) and low-rank subspace representation (LRSR), are proposed for hyperspectral image analysis, including target and anomaly detection, estimation of the number of signal subspaces, supervised and unsupervised classification. 2) In supervised target and unsupervised anomaly detection, the performance can be improved by using the LRR sparse matrix. To further increase detection accuracy, data is partitioned into several highly-correlated groups. Target detection is performed in each group, and the final result is generated from the fusion of the output of each detector. 3) In the estimation of the number of signal subspaces, the LRSR low-rank matrix is used in conjunction with direct rank calculation and soft-thresholding. Compared to the state-of-the-art algorithms, the LRSR approach delivers the most accurate and consistent results across different datasets. 4) In supervised and unsupervised classification, the use of LRR and LRSR low-rank matrices can improve classification accuracy where the improvement of the latter is more significant. The investigation on state-of-the-art classifiers demonstrate that, as a pre-preprocessing step, the LRR and LRSR produce low-rank matrices with fewer outliers or trivial spectral variations, thereby enhancing class separability.

In this dissertation, the general problem of the dimensionality reduction of hyperspectral imagery is considered. Data dimension can be reduced through compression, in which an original image is encoded into bitstream of greatly reduced size; through application of a transformation, in which a high-dimensional space is mapped into a low-dimensional space; and through a simple process of subsampling, wherein the number of pixels is reduced spatially during image acquisition. All three techniques are investigated in the course of the dissertation. For data compression, an approach to calculate an operational bitrate for JPEG2000 in conjunction with principal component analysis is proposed. It is shown that an optimal bitrate for such a lossy compression method can be estimated while maintaining both class separability as well as anomalous pixels in the original data. On the other hand, the transformation paradigm is studied for spectral dimensionality reduction; specifically, dataindependent random spectral projections are considered, while the compressive projection principal component analysis algorithm is adopted for data reconstruction. It is shown that, by incorporating both spectral and spatial partitioning of the original data, reconstruction accuracy can be improved. Additionally, a new supervised spectral dimensionality reduction approach using a sparsity-preserving graph is developed. The resulting sparse graph-based discriminant analysis is seen to yield superior classification performance at low dimensionality. Finally, for spatial dimensionality reduction, a simple spatial subsampling scheme is considered for a multitemporal hyperspectral image sequence, such that the original image is reconstructed using a sparse dictionary learned from a prior image in the sequence.

No description available.

The digitalization of the energy industry has made tremendous energy data available. This data is utilized across the entire energy value chain to provide value for customers and energy providers. One area that has gained recent attention in the energy industry is the electricity load forecasting for better scheduling and bidding on the electricity market. However, the electricity data that is used for forecasting is prone to have anomalies, which can affect the accuracy of forecasts. In this thesis we propose two anomaly detection methods to tackle the issue of anomalies in electricity demand data. We propose Long short-term memory (LSTM) and Feed-forward neural network (FFNN) based methods, and compare their anomaly detection performance on two real-world electricity demand datasets. Our results indicate that the LSTM model tends to produce a more robust behavior than the FFNN model on the dataset with regular daily and weekly patterns. However, there was no significant difference between the performance of the two models when the data was noisy and showed no regular patterns. While our results suggest that the LSTM model is effective when a regular pattern in data is present, the results were not found to be statistically significant to claim superiority of LSTM over FFNN. / Digitaliseringen inom energibranschen har tillgängliggjort enorma mängder energidata. Dessa data används över hela värdekedjan för energisystem i syfte att skapa värde för kunder och energileverantörer. Ett område som nyligen uppmärksammats inom energibranschen är att skapa prognoser för elbelastning för bättre schemaläggning och budgivning på elmarknaden. Data som används för sådana prognoser är dock benägna att ha avvikelser, vilket kan påverka prognosernas noggrannhet. I det här examensarbetet föreslår vi två metoder för detektering av avvikelser för att ta itu med frågan om avvikelser i data för elektricitetsbehov. Vi föreslår metoder baserade på Long short-term memory (LSTM) och Feedforward neural network (FFNN) och jämför dess prestanda att upptäcka avvikelser på två verkliga databanker över elbehovsdata. Våra resultat indikerar att LSTM-modellen tenderar att producera ett mer robust beteende än FFNN-modellen på data med upprepande dagliga samt veckovisa mönster. Det fanns dock ingen signifikant skillnad mellan prestanda för de två modellerna när data inte uppvisade regelbunda mönster. Även om våra resultat antyder att LSTM-modellen är effektiv när ett regelbundet datamönster finns närvarande, var resultaten inte statistiskt signifikanta för att påstå överlägsenhet av LSTM jämfört med FFNN.

Embedded platforms are often used as a sensor data processing node to collect data and transmit the data to the remote server. Due to the poor performance and power limitation, data processing was often left to the remote server. With the improvement of the computation ability, it is becoming possible to do some partial data processing on the embedded platforms, which would reduce the power and time consumption on the data transmission. Moreover, processing the data locally on the embedded platforms could reduce the dependence on the network. The platform could even do some tasks offline. This project aims to explore effective data analysis methods, especially for anomaly detection, which could be implemented on the embedded platform to be analyzed and detected locally. In this project, we select four methods: Seasonal and Trend Decomposition Using Loess (STL), Autoregressive Integrated Moving Average Model (ARIMA), Vector Autoregression (VAR), Long ShortTerm Memory (LSTM), to implement on the embedded platform ESP32. To test which methods could better fit the platform, we evaluate and compare the result from two aspects: the time overhead and the accuracy. The results show that the STL has the highest detection accuracy, but its time overhead is significantly higher than all other methods. ARIMA has the smallest time overhead and higher accuracy than LSTM and VAR. For LSTM, the method performs better with univariable input than multivariable input. Finally, we discuss the factors that may influence the result and future works. / Inbäddade plattformar används ofta som en sensor databehandlingsnod för att samla in och sedan överföra data till fjärrservern. Databehandling lämnades ofta till fjärrservern på grund av den dåliga prestandan och effektbegränsningen. Med förbättrad beräkningsförmåga blir det framkomligt att göra en del databehandling på de inbäddade plattformarna, vilket skulle minska ström och tidsförbrukningen för dataöverföringen. För övrigt kan lokal behandling av data på de inbäddade plattformarna minska beroendet av nätverket. Plattformen kan till och med utföra vissa uppgifter I nedkopplat läge. Detta projekt avser att utforska effektiva dataanalysmetoder särskilt för avvikelsedetektering, som kan verkställas på den inbäddade plattformen för att analyseras och upptäckas lokalt. I det här projektet väljer vi fyra metoder för att införa på den inbäddade plattformen ESP32: Seasonal and Trend Decomposition Using Loess (STL), Autoregressive Integrated Moving Average Model (ARIMA), Vector Autoregression (VAR), Long Short-Term Memory (LSTM). För att testa vilka metoder som bättre passar plattformen utvärderar och jämför vi resultatet med hänsyn till två aspekter: tidsomkostnaderna och noggrannheten. Resultaten visar att STL har den högsta detektionsnoggrannheten, men dess tidsomkostning är betydligt högre än alla andra metoder. ARIMA har den minsta tidsomkostningen och högre noggrannhet än LSTM och VAR. För LSTM fungerar metoden bättre med univariable input än multivariable input. Slutligen diskuterar vi faktorerna som möjligtvis påverkar resultatet och framtida arbeten.

The ability to observe temperature variations inside the human body may help in detecting the presence of medical anomalies. Abnormal changes in physiological parameters (such as metabolic and blood perfusion rates) cause localized tissue temperature change. If the anatomical information of an observed tissue region is known, then a nominal temperature profile can be created using the nominal physiological parameters. Temperature-varying radiation emitted from the human body can be captured using microwave radiometry and compared to the expected radiation from nominal temperature profiles to detect anomalies. Microwave radiometry is a passive system with the ability to capture radiation from tissue up to several centimeters deep into the body. Our proposed method is to use microwave radiometry in conjunction with another imaging modality (such as ultrasound) that can provide the anatomical information needed to generate nominal profiles and improve detection of temperature anomalies. An inference framework is developed for using the nominal temperature profiles and radiometric weighting functions obtained from electromagnetic simulation software, to detect and estimate the location of temperature anomalies. The effects on inference performance of random and systematic deviations from nominal tissue parameter values in normal tissue are discussed and analyzed.

This thesis investigates the existence of the turn-of-the-month (ToM) effect on the Swedish stock market and further examines whether this calendar anomaly is persistent but different during the Covid-19 pandemic. The main purpose of this study is to determine if the ToM effect is significant in the Swedish stock market over twelve years, particularly during the Covid-19 pandemic. The major finding is that the ToM effect is statistically significant for all indexes except for the large cap. The ToM window for the mid- and all cap indexes is significant for the last four trading days of the month to the first trading day of the next month. It is also significant for the small cap index during the last four trading days of the month to the first two trading days of the next month. The results of a significant ToM effect are similar to those of prior research, except that the Swedish stock market has an earlier ToM window. The Covid-19 pandemic is divided into three windows – before the virus has reached Sweden, before vaccinations, and after vaccinations. The results indicate that the ToM effect is insignificant when Covid-19 had not yet reached Sweden. Additionally, this study discovers a significant ToM pattern in the small cap and mid cap indexes, but not for the large cap or all cap indexes before vaccinations and after vaccinations. Hence, the ToM effect is persistent but different during a time of a major crisis, which in this paper is the time of the Covid-19 pandemic.  The research approach is deductive and quantitative. All data is collected from Nasdaq as observations of the daily adjusted closing prices starting from 1/4/2010 to 4/22/2022, and consists of the indexes: OMXSCAPGI, OMXS30GI, OMXSSCGI, and OMXSMCGI. The daily returns are then regressed on dummy variables for the trading days, by using different ToM windows to find results if these ToM windows are significant or not.

Ore is transported using belt conveyor systems. The transported ore has various anomalous objects that must be removed to prevent damage to the system. Currently anomalies are detected manually using humans. This leads to increased costs of wages and damage to the system overmissed anomalies. The thesis aims to solve this problem via the use of trained neural networks which can run on relatively cheap systems with a greater accuracy than humans. A set of neural networks were trained on both the BCS dataset consisting of data collected from the belt conveyor system and on the MVTec dataset. The latter dataset was used as a way of checking the correctness of the implementation of the models. As training neural networks usually requires large datasets, this thesis also focuses on the effect of the portion of labelled versus unlabelled data on the models. Labelling data can be time consuming and expensive so investigating if or how much data can be unlabelled without any or minimal loss to accuracy could lead to further cost reductions. The convolutional autoencoder (CAE) performed best on the classification based task on the BCS dataset where it managed to classify most of the dataset correctly, with an F1-score of 0.94 on data without anomalies and an F1-score of 0.86 on data with anomalies, as long as suitable thresholds were set. ResNet performed somewhat well with a 0.91 F1-score in detecting anomaly free data and a 0.50 F1-score in detecting anomaly containing data. The SimCLR and SimCLRv2 models were unable to learn from the data and defaulted to always assuming the data contained anomalies. The CAE model trained using the L1 loss function performed best with an IoU of 0.272 and performed worst with the SSIM based loss function with an IoU of 0.160. The effect of labelled versus unlabelled data using the MVTec dataset was tested using the SimCLR and SimCLRv2 models and the models performed best with the fully labelled dataset which was expected. The SimCLR model was able to identify all categories with an F1-score greater than 0.67 whereas the other splits performed worse overall with two or more categories completely misclassified. The SimCLRv2 was able to classify six categories with an F1-score greater than 0.0 which was significantly better than all other labelled and unlabelled splits.

Critical networks require defence in depth incorporating many different security technologies including intrusion detection. One important intrusion detection approach is called anomaly detection where normal (good) behaviour of users of the protected system is modelled, often using machine learning or data mining techniques. During detection new data is matched against the normality model, and deviations are marked as anomalies. Since no knowledge of attacks is needed to train the normality model, anomaly detection may detect previously unknown attacks. In this thesis we present ADWICE (Anomaly Detection With fast Incremental Clustering) and evaluate it in IP networks. ADWICE has the following properties: (i) Adaptation - Rather than making use of extensive periodic retraining sessions on stored off-line data to handle changes, ADWICE is fully incremental making very flexible on-line training of the model possible without destroying what is already learnt. When subsets of the model are not useful anymore, those clusters can be forgotten. (ii) Performance - ADWICE is linear in the number of input data thereby heavily reducing training time compared to alternative clustering algorithms. Training time as well as detection time is further reduced by the use of an integrated search-index. (iii) Scalability - Rather than keeping all data in memory, only compact cluster summaries are used. The linear time complexity also improves scalability of training. We have implemented ADWICE and integrated the algorithm in a software agent. The agent is a part of the Safeguard agent architecture, developed to perform network monitoring, intrusion detection and correlation as well as recovery. We have also applied ADWICE to publicly available network data to compare our approach to related works with similar approaches. The evaluation resulted in a high detection rate at reasonable false positives rate. / <p>Report code: LiU-Tek-Lic-2006:12.</p>

Anomaly detection is an important first step of quality control in manufacturing processes. In wooden planks, anomalies such as broken knots and resin pockets can lower the quality of the final product. With the help of machine vision, inspections can be made faster, at higher accuracy, and at a lower cost. Therefore, this Master's Thesis project aims to explore different machine vision-based machine learning methods for anomaly detection in images of wooden planks. Both unsupervised and supervised methods were used. The evaluated unsupervised methods were two variations of student-teacher frameworks, while the supervised methods were different semantic segmentation models. The evaluation results showed that the pre-trained DeepLabV3 semantic segmentation model performed the best, with a pixel-level IoU of 0.780, an object-level precision of 89.3% and object-level recall of 96.9%. Findings suggest that for this data set of images of wooden planks, the benefits of training on labeled data outweigh the time cost of annotation.