Proteins are considered the primary actors in living organisms. Proteins mainly perform their functions by interacting with other proteins. Protein-protein interactions underpin various biological activities such as metabolic cycles, signal transduction, and immune response. PPI identification has been addressed by various experimental methods such as the yeast two-hybrid, mass spectrometry, and protein microarrays, to mention a few. However, due to the sheer number of proteins, experimental methods for finding interacting and non-interacting protein pairs are time-consuming and costly. Therefore a sequence-based framework called ProtInteract is developed to predict protein-protein interaction. ProtInteract comprises two components: first, a novel autoencoder architecture that encodes each protein's primary structure to a lower-dimensional vector while preserving its underlying sequential pattern by extracting uncorrelated attributes and more expressive descriptors. This leads to faster training of the second network, a deep convolutional neural network (CNN) that receives encoded proteins and predicts their interaction. Three different scenarios formulate the prediction task. In each scenario, the deep CNN predicts the class of a given encoded protein pair. Each class indicates different ranges of confidence scores corresponding to the probability of whether a predicted interaction occurs or not. The proposed framework features significantly low computational complexity and relatively fast response. The present study makes two significant contributions to the field of protein-protein interaction (PPI) prediction. Firstly, it addresses the computational challenges posed by the high dimensionality of protein datasets through the use of dimensionality reduction techniques, which extract highly informative sequence attributes. Secondly, the proposed framework, ProtInteract, utilises this information to identify the interaction characteristics of a protein based on its amino acid configuration. ProtInteract encodes the protein's primary structure into a lower-dimensional vector space, thereby reducing the computational complexity of PPI prediction. Our results provide evidence of the proposed framework's accuracy and efficiency in predicting protein-protein interactions.

Sound source separation is a popular and active research area, especially with modern machine learning techniques. In this thesis, the focus is on single-channel separation of two speakers into individual streams, and specifically considering the case where two speakers are also accompanied by background noise. There are different methods to separate speakers and in this thesis three different methods are evaluated: the Conv-TasNet, the DPTNet, and the FaSNetTAC.  The methods were used to train models to perform the sound source separation. These models were evaluated and validated through three experiments. Firstly, previous results for the chosen separation methods were reproduced. Secondly, appropriate models applicable for NFC's datasets and applications were created, to fulfill the aim of this thesis. Lastly, all models were evaluated on an independent dataset, similar to datasets from NFC. The results were evaluated using the metrics SI-SNRi and SDRi. This thesis provides recommended models and methods suitable for NFC applications, especially concluding that the Conv-TasNet and the DPTNet are reasonable choices.

Recently, Deep Learning has revolutionized many fields, where one such area is Voice Activity Detection (VAD). This is of great interest to sectors of society concerned with detecting speech in sound signals. One such sector is the police, where criminal investigations regularly involve analysis of audio material. Convolutional Neural Networks (CNN) have recently become the state-of-the-art method of detecting speech in audio. But so far, understanding the impact of noise and sampling rates on such methods remains incomplete. Additionally, there are evaluation metrics from neighboring fields that remain unintegrated into VAD. We trained on four different sampling rates and found that changing the sampling rate could have dramatic effects on the results. As such, we recommend explicitly evaluating CNN-based VAD systems on pertinent sampling rates. Further, with increasing amounts of white Gaussian noise, we observed better performance by increasing the capacity of our Gated Recurrent Unit (GRU). Finally, we discuss how careful consideration is necessary when choosing a main evaluation metric, leading us to recommend Polyphonic Sound Detection Score (PSDS).

This thesis examines two different approaches to parsing event-based vehicular signal data to produce input to a neural network prediction model: event parsing, where the data is kept unevenly spaced over the temporal domain, and slice parsing, where the data is made to be evenly spaced over the temporal domain instead. The dataset used as a basis for these experiments consists of a number of vehicular signal logs taken at Scania AB. Comparisons between the parsing methods have been made by first training long short-term memory (LSTM) recurrent neural networks (RNN) on each of the parsed datasets and then measuring the output error and resource costs of each such model after having validated them on a number of shared validation sets. The results from these tests clearly show that slice parsing compares favourably to event parsing. / Denna avhandling jämför två olika tillvägagångssätt vad gäller parsningen av händelsebaserad signaldata från fordon för att producera indata till en förutsägelsemodell i form av ett neuronnät, nämligen händelseparsning, där datan förblir ojämnt fördelad över tidsdomänen, och skivparsning, där datan är omgjord till att istället vara jämnt fördelad över tidsdomänen. Det dataset som används för dessa experiment är ett antal signalloggar från fordon som kommer från Scania. Jämförelser mellan parsningsmetoderna gjordes genom att först träna ett lång korttidsminne (LSTM) återkommande neuronnät (RNN) på vardera av de skapade dataseten för att sedan mäta utmatningsfelet och resurskostnader för varje modell efter att de validerats på en delad uppsättning av valideringsdata. Resultaten från dessa tester visar tydligt på att skivparsning står sig väl mot händelseparsning.

Information Filtering and Recommender Systems have been used and has been implemented in various ways from various entities since the dawn of the Internet, and state-of-the-art approaches rely on Machine Learning and Deep Learning in order to create accurate and personalized recommendations for users in a given context. These models require big amounts of data with a variety of features such as time, location and user data in order to find correlations and patterns that other classical models such as matrix factorization and collaborative filtering cannot. This thesis researches, implements and compares a variety of models with the primary focus of Machine Learning and Deep Learning for the task of music recommendation and do so successfully by representing the task of recommendation as a multi-class extreme classification task with 100 000 distinct labels. By comparing fourteen different experiments, all implemented models successfully learn features such as time, location, user features and previous listening history in order to create context-aware personalized music predictions, and solves the cold start problem by using user demographic information, where the best model being capable of capturing the intended label in its top 100 list of recommended items for more than 1/3 of the unseen data in an offine evaluation, when evaluating on randomly selected examples from the unseen following week. / Informationsfiltrering och rekommendationssystem har använts och implementeratspå flera olika sätt från olika enheter sedan gryningen avInternet, och moderna tillvägagångssätt beror påMaskininlärrning samtDjupinlärningför att kunna skapa precisa och personliga rekommendationerför användare i en given kontext. Dessa modeller kräver data i storamängder med en varians av kännetecken såsom tid, plats och användardataför att kunna hitta korrelationer samt mönster som klassiska modellersåsom matris faktorisering samt samverkande filtrering inte kan. Dettaexamensarbete forskar, implementerar och jämför en mängd av modellermed fokus påMaskininlärning samt Djupinlärning för musikrekommendationoch gör det med succé genom att representera rekommendationsproblemetsom ett extremt multi-klass klassifikationsproblem med 100000 unika klasser att välja utav. Genom att jämföra fjorton olika experiment,så lär alla modeller sig kännetäcken såsomtid, plats, användarkänneteckenoch lyssningshistorik för att kunna skapa kontextberoendepersonaliserade musikprediktioner, och löser kallstartsproblemet genomanvändning av användares demografiska kännetäcken, där den bästa modellenklarar av att fånga målklassen i sin rekommendationslista medlängd 100 för mer än 1/3 av det osedda datat under en offline evaluering,när slumpmässigt valda exempel från den osedda kommande veckanevalueras.

<p dir="ltr">Detecting anomalies in spacecraft time-series data is a high priority, especially considering the harshness of the spacecraft operating environment. These anomalies often function as precursors for system failure. Traditionally, the time-series data channels are monitored manually by domain experts, which is time-consuming. Additionally, there are thousands of channels to monitor. Machine learning methods have proven to be useful for automatic anomaly detection, but a unique model must be trained from scratch for each time-series. This thesis proposes three approaches for reducing training costs. First, a transfer learning approach that finetunes a general pre-trained model to reduce training time and the number of unique models required for a given spacecraft. The second and third approaches both use online learning to reduce the amount of training data and time needed to identify anomalies. The second approach leverages an ensemble of extreme learning machines while the third approach uses deep learning models. All three approaches are shown to achieve reasonable anomaly detection performance with reduced training costs.</p><p dir="ltr">Measuring the phenotypes, or observable traits, of a plant enables plant scientists to understand the interaction between the growing environment and the genetic characteristics of a plant. Plant phenotyping is typically done manually, and often involves destructive sampling, making the entire process labor-intensive and difficult to replicate. In this thesis, we use image processing for characterizing two different disease progressions. Tar spot disease can be identified visually as it induces small black circular spots on the leaf surface. We propose using a Mask R-CNN to detect tar spots from RGB images of leaves, thus enabling rapid non-destructive phenotyping of afflicted plants. The second disease, bacteria-induced wilting, is measured using a visual assessment that is often subjective. We design several metrics that can be extracted from RGB images that can be used to generate consistent wilting measurements with a random forest. Both approaches ensure faster, replicable results, enabling accurate, high-throughput analysis to draw conclusions about effective disease treatments and plant breeds.</p>

Объект исследования – кибер-физические системы, подверженные различным инцидентам, отказам и сбоям в своей работе. Цель работы – разработка модели машинного обучения для определения корневых причин сбоев в производственной системе, а также исследование возможности использования машинного обучения для определения причин будущих сбоев. Методы исследования: сбор, анализ и синтез данных, сравнение, обобщение, классификация, аналогия, эксперимент, измерение, описание. Результаты работы: разработана и обучена модель машинного обучения для анализа корневых причин инцидентов производственной установки методом классификации на выбранном наборе «сырых» данных небольшого объема с последующей проверкой качества ее работы на тестовых данных. Область применения – обучение модели корневым причинам инцидентов (отказов, сбоев) производственных систем на имеющихся данных с последующим оперативным обнаружением причин аномальной работы систем в тандеме с работой алгоритма по автоматическому обнаружению и прогнозированию аномалий. / The object of research is cyber-physical systems that are susceptible to various incidents, failures and malfunctions in their operation. The goal of the work is to develop a machine learning model to determine the root causes of failures in a production system, as well as to explore the possibility of using machine learning to determine the causes of future failures. Research methods: collection, analysis and synthesis of data, comparison, generalization, classification, analogy, experiment, measurement, description. Results of the work: a machine learning model was developed and trained to analyze the root causes of incidents in a production facility using the classification method on a selected set of small-volume “raw” data, followed by checking the quality of its work on test data. Scope of application: training a model for the root causes of incidents (failures, failures) of production systems using available data, followed by prompt detection of the causes of abnormal operation of systems in tandem with the work of the algorithm for automatic detection and prediction of anomalies.

No description available.

Real-time prediction of taxi demand in a discrete geographical space is useful as it can minimise service disequilibrium by informing idle drivers of the imbalance, incentivising them to reduce it. This, in turn, can lead to improved efficiency, more stimulating work conditions, and a better customer experience. This study aims to investigate the possibility of utilising an artificial neural network model to make such a prediction for Stockholm. The model was trained on historical demand data and - uniquely - crowd flow data from a cellular provider (aggregated and anonymised). Results showed that the final model could generate very helpful predictions (only off by less than 1 booking on average). External factors - including crowd flow data - had a minor positive impact on performance, but limitations regarding the setup of the zones lead to the study being unable to make a definitive conclusion about whether crowd flow data is effective in improving taxi demand predictors or not. / Prognos av taxiefterfrågan i ett diskret geografiskt utrymme är användbart då det kan minimera obalans mellan utbud och efterfrågan genom att informera lediga taxiförare om obalansen och därmed utjämna den. Detta kan i sin tur leda till förbättrad effektivitet, mer stimulerande arbetsförhållanden och en bättre kundupplevelse. Denna studie ämnar att undersöka möjligheten att använda artificiella neurala nätverk för att göra en sådan prognos för Stockholm. Modellen tränades på historisk data om efterfrågan och - unikt för studien - folkströmsdata (aggregerad och anonymiserad) från en mobiloperatör. Resultaten visade att den slutgiltiga modellen kunde generera användbara prognoser (med ett genomsnittligt prognosfel med mindre än 1 bil per tidsenhet). Externa faktorer – inklusive folkströmsdata – hade en märkbar positiv inverkan på prestandan, men begränsningar rörande framställningen av zonerna ledde till att studien inte kunde dra en definitiv slutsats om huruvida folkströmsdata är effektiva för att förbättra prognoser för taxiefterfrågan eller ej.

本研究考慮重要且對台股大盤指數走勢有連動影響的因素，主要納入對台股有領頭作用的美國三大股市，那斯達克(NASDAQ)指數、道瓊工業(Dow Jones)指數、標準普爾500(S&P500)指數;其他對台股緊密連動效果的國際股票市場，香港恆生指數、上海證券綜合指數、深圳證券綜合指數、日經225指數;以及納入左右國際經濟表現的國際原油價格走勢，美國西德州原油、中東杜拜原油和歐洲北海布蘭特原油;在宏觀經濟因素方面則考量失業率、消費者物價指數、匯率、無風險利率、美國製造業重要指標的存貨/銷貨比率、影響貨幣數量甚鉅的M1B;在技術分析方面則納入多種重要的指標，心理線 (PSY) 指標、相對強弱(RSI) 指標、威廉(WMS%R) 指標、未成熟隨機(RSV) 指標、K-D隨機指標、移動平均線(MA)、乖離率(BIAS)、包寧傑%b和包寧傑帶狀寬度(BandWidth%);所有考量因素共計35項，因為納入重要因子比較多，所以完備性較高。 本研究先採用的贏者全拿(Winner-Take-All) 競爭學習策略的自組織映射網路(Self-Organizing Feature Maps, SOM)，藉由將相似資料歸屬到已身的神經元萃取出關聯分類且以計算距離來衡量神經元的離散特徵，對於探索大量且高維度的非線性複雜特徵俱有優良的因素相依性投射效果，將有利於提高預測模式精準度。在線性擬合部分則結合倒傳遞(Back-Propagation, BP)、Elman反饋式和徑向基底函數類網路(Radial-Basis-Function Network, RBF)模式為指數預測輸出，並對台股加權指數隔日收盤指數進行預測和評量。而在傳統的Elman反饋式網路只在隱藏層存在反饋機制，本研究則在輸入層和隱藏層皆建立反饋機制，將儲存在輸入層和隱藏層的過去時間資訊回饋給網路未來參考。在徑向基底函數網路方面，一般選取中心聚類點採用隨機選取方式，若能有效降低中心點個數，可降低網路複雜度，本研究導入垂直最小平方法以求取誤差最小的方式強化非監督式學習選取中心點的能力，以達到網路快速收斂，提昇網路學習品質。 研究資料為台股指數交易收盤價，日期自2001/1/2，至2011/10/31共2676筆資料。訓練資料自2001/1/2至2009/12/31，共2223筆;實證測試資料自2010/1/4至2011/10/31，計453個日數。主要評估指標採用平均相對誤差(AMRE)和平均絕對誤差 (AAE)。在考慮因子較多的狀況下，實證結果顯示，在先透過SOM進行因子聚類分析之後，預測因子被分成四個組別，分別再透過BP、Elman recurrent和RBF方法進行線性擬合，平均表現方面，以RBF模式下的四個群組因子表現最佳，其中RBF模式之下的群組4，其AMRE可達到0.63%，最差的AMRE則是群組1，約為1.05%;而Elman recurrent模式下的四組群組因子之ARME則介於1.01%和1.47%之間;其中預測效果表現最差則是BP模式的預測結果。顯示RBF具有絕佳的股價預測能力。最後，在未來研究建議可以運用本文獻所探討之其他數種類神經網路模式進行股價預測。 / In this study, we considering the impact factors for TWSE index tendency, mainly aimed at the three major American stock markets, NASDAQ index, Dow Jones index, S&P 500, which leading the Taiwan stock market trend; the other international stock markets, such as the Hong Kong Hang-Seng Index, Shanghai Stock Exchange Composite Index, Shenzhen Stock Exchange Composite Index, NIKKEI 225 index, which have close relationship with Taiwan stock market; we also adopt the international oil price trend, such as the West Texas Intermediate Crude Oil in American, the Dubai crude oil in Middle Eastern, North Sea Brent crude oil in European, which affects international economic performance widely; On the side of macroeconomic factors, we considering the Unemployed rate, Consumer Price Index, exchange rate, riskless rate, the Inventory to Sales ratio which it is important index of American manufacturing industry, and the M1b factor which did greatly affect to currency amounts; In the part of Technical Analysis index, we adopt several important indices, such as the Psychology Line Index (PSY), Relative Strength Index (RSI), the Wechsler Memory Scale—Revised Index (WMS%R), Row Stochastic Value Index (RSV), K-D Stochastics Index, Moving Average Line (MA), BIAS, Bollinger %b (%b), Bollinger Band Width (Band Width%);All factors total of 35 which we have considered the important factor is numerous, so the integrity is high. In this study, at first we adopt the Self-Organizing Feature Maps Network which based on the Winner-Take-All competition learning strategy, Similar information by the attribution to the body of the neuron has been extracted related categories and to calculate the distance to measure the discrete characteristics of neurons, it has excellent projection effect by exploring large and complex high-dimensional non-linear characteristics for all the dependency factors , would help to improve the accuracy of prediction models, would be able to help to improve the accuracy of prediction models. The part of the curve fitting combine with the back-propagation (Back-Propagation, BP), Elman recurrent model and radial basis function network (Radial-Basis-Function Network, RBF) model for the index prediction outputs, forecast and assessment the next close price of Taiwan stocks weighted index. In the traditional Elman recurrent network exists only one feedback mechanism in the hidden layer, in this study in the input and hidden layer feedback mechanisms are established, the previous information will be stored in the input and hidden layer and will be back to the network for future reference. In the radial basis function network, the general method is to selecting cluster center points by random selection, if we have the effectively way to reduce the number of the center points, which can reduces network complexity, in this study introduce the Orthogonal Least Squares method in order to obtain the smallest way to strengthen unsupervised learning center points selecting ability, in order to achieve convergence of the network fast, and improve network learning quality. Research data for the Trading close price of Taiwan Stock Index, the date since January 2, 2001 until September 30, 2011, total data number of 2656. since January 2, 2001 to December 31, 2009 a total number of 2223 trading close price as training data; empirical testing data, from January 4, 2010 to September 30, 2011, a total number of 433. The primary evaluation criteria adopt the Average Mean Relative Error (AMRE) and the Average Absolute Error (AAE). In the condition for consider more factors, the empirical results show that, by first through SOM for factor clustering analysis, the prediction factors were divided into four categories and then through BP, Elman recurrent and RBF methods for curve fitting, at the average performance , the four group factors of the RBF models get the best performance, the group 4 of the RBF model, the AMRE can reach 0.63%, the worst AMRE is group 1, about 1.05%; and the four groups of Elman recurrent model of ARME is between 1.01% and 1.47%; the worst prediction model is BP method. RBF has shown excellent predictive ability for stocks index. Finally, the proposal can be used in future studies of the literatures that we have explore several other methods of neural network model for stock trend forecasting.