Yes / Human activity recognition from sensor data is a critical research topic to achieve remote health monitoring and ambient assisted living (AAL). In AAL, sensors are integrated into conventional objects aimed to support targets capabilities through digital environments that are sensitive, responsive and adaptive to human activities. Emerging technological paradigms to support AAL within the home or community setting offers people the prospect of a more individually focused care and improved quality of living. In the present work, an ambient human activity classification framework that augments information from the received signal strength indicator (RSSI) of passive RFID tags to obtain detailed activity profiling is proposed. Key indices of position, orientation, mobility, and degree of activities which are critical to guide reliable clinical management decisions using 4 volunteers are employed to simulate the research objective. A two-layer, fully connected sequence long short-term memory recurrent neural network model (LSTM RNN) is employed. The LSTM RNN model extracts the feature of RSS from the sensor data and classifies the sampled activities using SoftMax. The performance of the LSTM model is evaluated for different data size and the hyper-parameters of the RNN are adjusted to optimal states, which results in an accuracy of 98.18%. The proposed framework suits well for smart health and smart homes which offers pervasive sensing environment for the elderly, persons with disability and chronic illness.

Loss reserving in P&C insurance, is the common practice of estimating the insurer’s liability from future claims it will have to pay out on. In the recent years, it has been popular to explore the options of forecasting this loss with the help of machine learning methods. This is mainly attributed to the increase in computational power, opening up opportunities for handling more complex computations with large datasets. The main focus of this paper is to implement and evaluate a recurrent neural network called the deeptriangle by Kuo for modelling payments of individual reported but not settled claims. The results are compared with the traditional Chain Ladder method and a baseline model on a simulated dataset provided by Wüthrich’s simulation machine.  The models were implemented in Python using Tensorflow’s functional API. The results show that the recurrent neural network does not outperform the Chain Ladder method on the given data. The recurrent neural network is weak towards the sparse and chaotic nature of individual claim payments and is unable to detect a stable sequential pattern. Results also show that the neural network is prone to overfitting, which can theoretically be compensated with larger dataset but comes at a cost in terms of feasibility. / Reservsättning inom skadeförsäkring handlar om att beräkna framtida kostnader av en försäkringsgivare. Under de senaste åren har det blivit allt populärare att undersöka tillämpningen av olika statistiska inlärningsmetoder inom reservsättning. Den här uppsatsen syftar till att implementera och utvärdera ett återkommande neuraltnätverk som kallas för ”deeptriangle by Kuo” för att modellera utbetalningar av individuella rapporterade men icke­ färdigbetalda försäkringsfordringar. Resultaten kommer att jämföras med den traditionella Chain Ladder metoden samt en grundmodell på ett simulerat dataset som tillhandahålls av ”Wüthrichs simulation machine”. Modellerna implementeras i Python med hjälp av Tensorflows Functional API. Resultatet är att det återkommande neurala nätverket inte överträffar Chain Ladder metoden med den givna datan. Det återkommande neurala nätverket har svårigheter för att känna igen mönster i datamängder som individuella skadebetalningar eftersom datamängden till sin natur är spridd och kaotisk. Resultaten visar också att det neurala nätverket är benäget att överanpassa, vilket teoretiskt kan kompenseras med en större datamängd men som i sin tur bidrar till en risk för ogenomförbarhet.

In modern communication systems, it’s important to detect and use available radio frequencies effectively. However, current methods face challenges with complexity and noise interference. We’ve developed a new approach using advanced artificial intelligence (AI) based computing techniques to improve efficiency and accuracy in this process. Our method shows promising results, requiring only minimal additional resources in exchange of improved performance compared to older techniques. / Master of Science / In modern communication systems, it’s important to detect and use available radio frequencies effectively. However, current methods face challenges with complexity and noise interference. We’ve developed a new approach using advanced artificial intelligence (AI) based computing techniques to improve efficiency and accuracy in this process. Our method shows promising results, requiring only minimal additional resources in exchange of improved performance compared to older techniques.

One of the many challenges of machine learning are systems for automatic tagging of music, the complexity of this issue in particular. These systems can be practically used in the content analysis of music or the sorting of music libraries. This thesis deals with the design, training, testing, and evaluation of artificial neural network architectures for automatic tagging of music. In the beginning, attention is paid to the setting of the theoretical foundation of this field. In the practical part of this thesis, 8 architectures of neural networks are designed (4 fully convolutional and 4 convolutional recurrent). These architectures are then trained using the MagnaTagATune Dataset and mel spectrogram. After training, these architectures are tested and evaluated. The best results are achieved by the four-layer convolutional recurrent neural network (CRNN4) with the ROC-AUC = 0.9046 ± 0.0016. As the next step of the practical part of this thesis, a completely new Last.fm Dataset 2020 is created. This dataset uses Last.fm and Spotify API for data acquisition and contains 100 tags and 122877 tracks. The most successful architectures are then trained, tested, and evaluated on this new dataset. The best results on this dataset are achieved by the six-layer fully convolutional neural network (FCNN6) with the ROC-AUC = 0.8590 ± 0.0011. Finally, a simple application is introduced as a concluding point of this thesis. This application is designed for testing individual neural network architectures on a user-inserted audio file. Overall results of this thesis are similar to other papers on the same topic, but this thesis brings several new findings and innovations. In terms of innovations, a significant reduction in the complexity of individual neural network architectures is achieved while maintaining similar results.

O presente trabalho propõe resolver o clássico problema combinatorial conhecido como problema do caixeiro viajante. Foi usado no sistema de otimização de busca do menor caminho uma rede neural recorrente. A topologia de estrutura de ligação das realimentações da rede adotada aqui é conhecida por rede recorrente de Wang. Como regra de treinamento de seus pesos sinápticos foi adotada a técnica de perturbação simultânea com aproximação estocástica. Foi elaborado ainda uma minuciosa revisão bibliográfica sobre todos os temas abordados com detalhes sobre a otimização multivariável com perturbação simultânea. Comparar-se-á também os resultados obtidos aqui com outras diferentes técnicas aplicadas no problema do caixeiro viajante visando propósitos de validação. / This work proposes to solve the classic combinatorial optimization problem known as traveling salesman problem. A recurrent neural network was used in the system of optimization to search the shorter path. The structural topology linking the feedbacks of the network adopted here is known by Wang recurrent network. As learning rule to find the appropriate values of the weights was used the simultaneous perturbation with stochastic approximation. A detailed bibliographical revision on multivariable optimization with simultaneous perturbation is also described. Comparative results with other different techniques applied to the traveling salesman are still presented for validation purposes.

O presente trabalho propõe resolver o clássico problema combinatorial conhecido como problema do caixeiro viajante. Foi usado no sistema de otimização de busca do menor caminho uma rede neural recorrente. A topologia de estrutura de ligação das realimentações da rede adotada aqui é conhecida por rede recorrente de Wang. Como regra de treinamento de seus pesos sinápticos foi adotada a técnica de perturbação simultânea com aproximação estocástica. Foi elaborado ainda uma minuciosa revisão bibliográfica sobre todos os temas abordados com detalhes sobre a otimização multivariável com perturbação simultânea. Comparar-se-á também os resultados obtidos aqui com outras diferentes técnicas aplicadas no problema do caixeiro viajante visando propósitos de validação. / This work proposes to solve the classic combinatorial optimization problem known as traveling salesman problem. A recurrent neural network was used in the system of optimization to search the shorter path. The structural topology linking the feedbacks of the network adopted here is known by Wang recurrent network. As learning rule to find the appropriate values of the weights was used the simultaneous perturbation with stochastic approximation. A detailed bibliographical revision on multivariable optimization with simultaneous perturbation is also described. Comparative results with other different techniques applied to the traveling salesman are still presented for validation purposes.

The present work focuses on the two areas of investigation: system identification of helicopter and design of controller for the helicopter. Helicopter system identification, the first subject of investigation in this thesis, can be described as the extraction of system characteristics/dynamics from measured flight test data. Wind tunnel experimental data suffers from scale effects and model deficiencies. The increasing need for accurate models for the design of high bandwidth control system for helicopters has initiated a renewed interest in and a more active use of system identification. Besides, system identification is likely to become mandatory in the future for model validation of ground based helicopter simulators. Such simulators require accurate models in order to be accepted by pilots and regulatory authorities like Federal Aviation Regulation for realistic complementary helicopter mission training. Two approaches are widely used for system identification, namely, black box and gray box approach. In the black-box approach, the relationship between input-output data is approximated using nonparametric methods such as neural networks and in such a case, internal details of the system and model structure may not be known. In the gray box approach, parameters are estimated after defining the model structure. In this thesis, both black box and gray box approaches are investigated. In the black box approach, in this thesis, a comparative study and analysis of different Recurrent Neural Networks(RNN) for the identification of helicopter dynamics using flight data is investigated. Three different RNN architectures namely, Nonlinear Auto Regressive eXogenous input(NARX) model, neural network with internal memory known as Memory Neuron Networks(MNN)and Recurrent MultiLayer perceptron (RMLP) networks are used to identify dynamics of the helicopter at various flight conditions. Based on the results, the practical utility, advantages and limitations of the three models are critically appraised and it is found that the NARX model is most suitable for the identification of helicopter dynamics. In the gray box approach, helicopter model parameters are estimated after defining the model structure. The identification process becomes more difficult as the number of degrees-of-freedom and model parameters increase. To avoid the drawbacks of conventional methods, neural network based techniques, called the delta method is investigated in this thesis. This method does not require initial estimates of the parameters and the parameters can be directly extracted from the flight data. The Radial Basis Function Network(RBFN)is used for the purpose of estimation of parameters. It is shown that RBFN is able to satisfactorily estimate stability and control derivatives using the delta method. The second area of investigation addressed in this thesis is the control of helicopter in flight. Helicopter requires use of a control system to achieve satisfactory flight. Designing a classical controller involves developing a nonlinear model of the helicopter and extracting linearized state space matrices from the nonlinear model at various flight conditions. After examining the stability characteristics of the helicopter, the desired response is obtained using a feedback control system. The scheduling of controller gains over the entire envelope is used to obtain the desired response. In the present work, a helicopter having a soft inplane four bladed hingeless main rotor and a four-bladed tail rotor with conventional mechanical controls is considered. For this helicopter, a mathematical model and also a model based on neural network (using flight data) has been developed. As a precursor, a feed back controller, the Stability Augmentation System(SAS), is designed using linear quadratic regulator control with full state feedback and LQR with out put feedback approaches. SAS is designed to meet the handling qualities specification known as Aeronautical Design Standard ADS-33E-PRF. The control gains have been tuned with respect to forward speed and gain scheduling has been arrived at. The SAS in the longitudinal axis meets the requirement of the Level1 handling quality specifications in hover and low speed as well as for forward speed flight conditions. The SAS in the lateral axis meets the requirement of the Level2 handling quality specifications in both hover and low speed as well as for forward speed flight conditions. Such conventional design of control has served useful purposes, however, it requires considerable flight testing which is time consuming, to demonstrate and tune these control law gains. In modern helicopters, the stringent requirements and non-linear maneuvers make the controller design further complicated. Hence, new design tools have to be explored to control such helicopters. Among the many approaches in adaptive control, neural networks present a potential alternative for modeling and control of nonlinear dynamical systems due to their approximating capabilities and inherent adaptive features. Furthermore, from a practical perspective, the massive parallelism and fast adaptability of neural network implementations provide more incentive for further investigation in problems involving dynamical systems with unknown non-linearity. Therefore, adaptive control approach based on neural networks is proposed in this thesis. A neural network based Feedback Error Neural adaptive Controller(FENC) is designed for a helicopter. The proposed controller scheme is based on feedback error learning strategy in which the outer loop neural controller enhances the inner loop conventional controller by compensating for unknown non-linearity and parameter un-certainties. Nonlinear Auto Regressive eXogenous input(NARX)neural network architecture is used to approximate the control law and the controller network parameters are adapted using updated rules Lyapunov synthesis. An offline (finite time interval)and on-line adaptation strategy is used to approximate system uncertainties. The results are validated using simulation studies on helicopter undergoing an agile maneuver. The study shows that the neuro-controller meets the requirements of ADS-33 handling quality specifications. Even though the tracking error is less in FENC scheme, the control effort required to follow the command is very high. To overcome these problems, a Direct Adaptive Neural Control(DANC)scheme to track the rate command signal is presented. The neural controller is designed to track rate command signal generated using the reference model. For the simulation study, a linearized helicopter model at different straight and level flight conditions is considered. A neural network with a linear filter architecture trained using back propagation through time is used to approximate the control law. The controller network parameters are adapted using updated rules Lyapunov synthesis. The off-line trained (for finite time interval)network provides the necessary stability and tracking performance. The on-line learning is used to adapt the network under varying flight conditions. The on-line learning ability is demonstrated through parameter uncertainties. The performance of the proposed direct adaptive neural controller is compared with feedback error learning neural controller. The performance of the controller has been validated at various flight conditions. The theoretical results are validated using simulation studies based on a nonlinear six degree-of-freedom helicopter undergoing an agile maneuver. Realistic gust and sensor noise are added to the system to study the disturbance rejection properties of the neural controllers. To investigate the on-line learning ability of the proposed neural controller, different fault scenarios representing large model error and control surface loss are considered. The performances of the proposed DANC scheme is compared with the FENC scheme. The study shows that the neuro-controller meets the requirements of ADS-33 handling quality specifications.

This diploma thesis is devided into theoretic and practice parts. Theoretic part contains basic information about history and development of Artificial Neural Networks (ANN) from last century till present. Prove of the theoretic section is discussed in the practice part, for example learning, training each types of topology of artificial neural networks on some specifics works. Simulation of this networks and then describing results. Aim of thesis is simulation of the active networks element controlling by artificial neural networks. It means learning, training and simulation of designed neural network. This section contains algorithm of ports switching by address with Hopfield's networks, which used solution of typical Trade Salesman Problem (TSP). Next point is to sketch problems with optimalization and their solutions. Hopfield's topology is compared with Recurrent topology of neural networks (Elman's and Layer Recurrent's topology) their main differents, their advantages and disadvantages and supposed their solution of optimalization in controlling of network's switch. From thesis experience is introduced solution with controll function of ANN in active networks elements in the future.

In this master’s thesis are discussed static properties of network traffic trace. There are also addressed the possibility of a predication with a focus on neural networks. Specifically, therefore recurrent neural networks. Training data were downloaded from freely accessible on the internet link. This is the captured packej of traffic of LAN network in 2001. They are not the most actual, but it is possible to use them to achieve the objective results of the work. Input data needed to be processed into acceptable form. In the Visual Studio 2005 was created program to aggregate the intensities of these data. The best combining appeared after 100 ms. This was achieved by the input vector, which was divided according to the needs of network training and testing part. The various types of networks operate with the same input data, thereby to make more objective results. In practical terms, it was necessary to verify the two principles. Principle of training and the principle of generalization. The first of the nominated designs require stoking training and verification training by using gradient and mean square error. The second one represents unknown designs application on neural network. It was monitored the response of network to these input data. It can be said that the best model seemed the Layer recurrent neural network (LRN). So, it was a solution developed in this direction, followed by searching the appropriate option of recurrent network and optimal configuration. Found a variant of topology is 10-10-1. It was used the Matlab 7.6, with an extension of Neural Network toolbox 6. The results are processed in the form of graphs and the final appreciation. All successful models and network topologies are on the enclosed CD. However, Neural Network toolbox reported some problems when importing networks. In creating this work wasn’t import of network functions practically used. The network can be imported, but the majority appear to be non-trannin. Unsuccessful models of networks are not presented in this master’s thesis, because it would be make a deterioration of clarity and orientation.

Diese Dissertation beschäftigt sich mit drei relevanten Aufgabebereichen einer Zentralbank und untersucht die makroökonomische Prognose, die Analyse der Geldpolitik in einem makroökonomischen Modell und die Analyse des Währungssystems. Jedes dieser Phänomene wird mit Hilfe des passenden Modells nach Nichtlinearitäten untersucht. Der erste Teil der Dissertation zeigt, dass nichtlineare rekurrente neuronale Netze, eine Methode aus dem Bereich Maschinelles Lernen, die Standard-Methoden übertreffen können und präzise Vorhersagen der Inflation in 1 bis 12 Monaten liefern können. Der zweiter Teil analysiert eine nichtlineare Formulierung der monetären Taylor-Regel. Anhand der Schätzung eines nichtlinearen DSGE Modells wird gezeigt, dass die Taylor-Regel in den USA asymmetrisch ist. Die Zentralbank ergreift stärkere Maßnahmen, wenn die Inflation höher ist als die Zielinflation, und reagiert weniger wenn die Inflation niedriger als die Zielinflation ist. Gleicherweise ist die Reaktion der monetären Politik stärker bei zu geringem Produktionswachstum als bei zu hohem. Der dritte Teil der Dissertation formuliert ein theoretisches Modell, das für eine Analyse der digitalen dezentralen Währungen verwendet werden kann. Es werden die Bedingungen bestimmt, unter denen der Wettbewerb zwischen der Währung der Zentralbank und den digitalen Währungen einige Beschränkungen für die Geldpolitik darstellt. / This thesis addresses three topics that are relevant for the central bank policy design. It analyzes forecasting of the macroeconomic time series, accurate monetary policy formulation in a general equilibrium macroeconomic model and monitoring of the novel developments in the monetary system. All these issues are analyzed in a nonlinear framework with the help of a macroeconomic model. The first part of the thesis shows that nonlinear recurrent neural networks – a method from the machine learning literature – outperforms the usual benchmark forecasting models and delivers accurate inflation predictions for 1 to 12 months ahead. The second part of the thesis analyzes a nonlinear formulation of the Taylor rule. With the help of the nonlinear Bayesian estimation of a DSGE model it shows that the Taylor rule in the US is asymmetric. The central bank reacts stronger to inflation when it is above the target than when it is below the target. Similarly, the reaction to the output growth rate is stronger when the output growth is too weak than when it is too strong. The last part of the thesis develops a theoretical model that is suitable for the analysis of decentralized digital currencies. The model is used to derive the conditions, under which the competition between digital and fiat currencies imposes restrictions on the monetary policy design.