Today, everyday objects are becoming more and more intelligent and some-times even have self-learning capabilities. These self-learning capacities in particular also act as catalysts for new developments in the steel industry.Technical developments that enhance the sustainability and productivity of steel production are very much in demand in the long-term. The methods of Industry 4.0 can support the steel production process in a way that enables steel to be produced in a more cost-effective and environmentally friendly manner. This thesis describes the development of an opto-acoustic system for the early detection of slag slopping in the BOF (Basic Oxygen Furnace) converter process. The prototype has been installed in Salzgitter Stahlwerks, a German steel plant for initial testing. It consists of an image monitoring camera at the converter mouth, a sound measurement system and an oscillation measurement device installed at the blowing lance. The camera signals are processed by a special image processing software. These signals are used to rate the amount of spilled slag and for a better interpretation of both the sound data and the oscillation data. A certain aspect of the opto-acoustic system for slopping detection is that all signals, i.e. optic, acoustic and vibratory, are affected by process-related parameters which are not always relevant for the slopping event. These uncertainties affect the prediction of the slopping phenomena and ultimately the reliability of the entire slopping system. Machine Learning algorithms have been been applied to predict the Slopping phenomenon based on the data from the sensors as well as the other process parameters. / Idag blir vardagliga föremål mer och mer intelligenta och ibland har de självlärande möjligheter. Dessa självlärande förmågor fungerar också som katalysatorer för den nya utvecklingen inom stålindustrin. Teknisk utveckling som stärker hållbarheten och produktiviteten i stålproduktionen är mycket efterfrågad på lång sikt. Metoderna för Industry 4.0 kan stödja stålproduktionsprocessen på ett sätt som gör att stål kan produceras på ett mer kostnadseffektivt och miljövänligt sätt. Denna avhandling beskriver utvecklingen av ett opto-akustiskt system för tidig detektering av slaggsslipning i konverteringsprocessen BOF (Basic Oxygen Furnace). Prototypen har installerats i Salzgitter Stahlwerks, en tysk stålverk för första provning. Den består av en bildövervakningskamera på omvandlarens mun, ett ljudmätningssystem och en oscillationsmätningsenhet som installeras vid blåsans. Kamerans signaler behandlas av en speciell bildbehandlingsprogram. Dessa signaler används för att bestämma mängden spilld slagg och för bättre tolkning av både ljuddata och oscillationsdata. En viss aspekt av det optoakustiska systemet för släckningsdetektering är att alla signaler, dvs optiska, akustiska och vibrerande, påverkas av processrelaterade parametrar som inte alltid är relevanta för slöjningsevenemanget. Dessa osäkerheter påverkar förutsägelsen av slopfenomenerna och i slutändan tillförlitligheten för hela slöjningssystemet. Maskininlärningsalgoritmer har tillämpats för att förutsäga Slopping-fenomenet baserat på data från sensorerna liksom de andra processparametrarna.

Location-based services (LBSs) have become pervasive, and the demand for these systems and services is rising. Indoor Positioning Systems (IPSs) are key to extend location-based services indoors where the Global Positioning System (GPS) is not reliable due to low signal strength and complicated signal propagation environment. Most existing IPSs either require the installation of special hardware devices or build a fingerprint map, which is expensive, time-consuming, and labor-intensive. Developments in microelectromechanical systems (MEMS) have resulted in significant advancements in the low-cost compact MARG inertial sensors, making it possible to achieve low-cost and high-accuracy IPSs. This research considers the indoor positioning problem and aims to design and develop an infrastructure-free self-contained indoor positioning and tracking system based on Pedestrian Dead Reckoning (PDR) using MEMS MARG inertial sensors. PDR-based systems rely on MARG inertial sensor measurements to estimate the current position of the object by using a previously determined position without external references. Many issues still exist in developing such systems, such as cumulative errors, high-frequency sensor noises, the gyro drift issue, magnetic distortions, etc. As the MARG sensors are inherently error-prone, the most significant challenge is how to design sensor fusion models and algorithms to accurately extract useful location-based information from individual motion and magnetic sensors. The objective of this thesis is to solve these issues and mitigate the challenges. The proposed positioning system is designed with four main modules at the system level and a dual-mode feature. Specifically, the four main modules are mode detection, step detection and moving distance estimation, heading and orientation estimation, and position estimation. To address the cumulative error issue of using low-cost inertial sensors, signal processing and sensor fusion techniques are utilized for algorithm design. Experimental evaluations show that the proposed position estimation algorithm is able to achieve high positioning accuracy at low costs for the indoor environment. / Thesis / Master of Applied Science (MASc) / With the maturity of microelectromechanical systems (MEMS) technology in recent years, Magnetic, Angular Rate, and Gravity (MARG) sensors are embedded in most smart devices. This research considers the indoor positioning problem and aims to design and develop an infrastructure-free self-contained MEMS MARG inertial sensor-based indoor positioning and tracking system with high precision. The proposed positioning system uses the Pedestrian Dead Reckoning (PDR) approach and includes four main modules at the system level with a dual-mode feature. Specifically, the four main modules are mode detection, step detection and moving distance estimation, heading and orientation estimation, and position estimation. The two modes are static mode and dynamic mode. To address the cumulative error issue of using low-cost inertial sensors, signal processing and sensor fusion techniques are utilized for algorithm design. The detection and estimation algorithms of each module are presented in the system design chapter. Experimental evaluations including trajectory results under five scenarios show that the proposed position estimation algorithm achieves a higher position accuracy than that of conventional estimation methods.

No description available.

A system of an unmanned aerial vehicle (UAV) collaborating with an unmanned ground vehicle (UGV) for use in for example surveillance, reconnaissance, transport and target acquisition is studied. The project investigates the problem of estimating the relative position, velocity and orientation between the UAV and the UGV required to autonomously land the UAV on the UGV during movement. The use of global navigation satellite system (GNSS) receivers are not considered since they are sensitive to interference and spoofing attacks.  The developed estimation system consists of an extended Kalman filter (EKF) using measurements from several sensors, including: a camera, barometers, inertial measurement units (IMUs) and impulse-radio ultra-wide bandwidth (IRUWB) transceivers. Primarily the use of near infrared (NIR) light emitting diodes (LEDs) attached to the UGV and a camera on the UAV is investigated. Several configurations of LED placements, and what errors to expect when measuring them with the camera, are evaluated. The performance is evaluated in both simulations and hardware sensor tests, but no live experiments that include any autonomous landing manoeuvre are conducted.  The results indicate that high estimation precision can be achieved, at close range the errors in position average below 2 cm and in orientation under 0.5 degrees. However, some problems arise from the detection and identification of the LEDs. Further, if measurements of the LEDs are completely missing, the estimation precision suffers due to error accumulation in the inertial navigation. These results indicate that autonomous landing is possible, since the amount of LED measurements and consequently also the estimation precision increases as the relative position decreases.

This thesis presents an estimator to assist or replace a fighter aircraft’s air datasystem (ADS). The estimator is based on machine learning and LSTM neuralnetworks and uses the statistical correlation between states to estimate the angleof attack, angle of sideslip and Mach number using only the internal sensorsof the aircraft. The model is trained and extensively tested on a fighter jetsimulation model and shows promising results. The methodology and accuracyof the estimator are discussed, together with how a real-world implementationwould work. The estimators presented should act as a proof of concept of thepower of neural networks in state estimation, whilst the report discusses theirstrengths and weaknesses. The estimators can estimate the three targets wellin a vast envelope of altitudes, speeds, winds and manoeuvres. However, thetechnology is quite far from real-world implementation as it lacks transparencybut shows promising potential for future development. / Det här examensarbetet presenterar en estimator för att hjälpa eller ersätta ettstridsflygplans luftdatasystem (ADS). Estimatorn är baserad på maskininlärningoch LSTM neurala nätverk och använder statistisk korrelation mellan tillstånd föratt uppskatta anfallsvinkeln, sidglidningsvinkel och Mach-tal endast med hjälpav flygplanets interna sensorer. Modellen är tränad och utförligt testad på ensimuleringsmodell för stridsflygplan och visar lovande resultat. Estimatornsmetodik och noggrannhet diskuteras, tillsammans med hur en implementeringi verkligheten skulle fungera. De presenterade estimatorerna bör fungera somett “proof of concept” för kraften hos neurala nätverk för tillståndsuppskattning,medan rapporten diskuterar deras styrkor och svagheter. Estimatorerna kanuppskatta de tre tillstånden väl i ett stort spektra av altituder, hastigheter, vindaroch manövrar. Tekniken är dock ganska långt ifrån en verklig implementeringeftersom den saknar transparens, men visar lovande potential för framtidautveckling.

In some dense urban environments (e.g., a street with tall buildings around), vehicle localization result provided by Global Positioning System (GPS) receiver might not be accurate or even unavailable due to signal reflection (multi-path) or poor satellite visibility. In order to improve the accuracy and robustness of assisted navigation systems so as to guarantee driving security and service continuity on road, a vehicle localization approach is presented in this thesis by taking use of the redundancy and complementarities of multiple sensors. At first, GPS localization method is complemented by onboard dead-reckoning (DR) method (inertial measurement unit, odometer, gyroscope), stereovision based visual odometry method, horizontal laser range finder (LRF) based scan alignment method, and a 2D GIS road network map based map-matching method to provide a coarse vehicle pose estimation. A sensor selection step is applied to validate the coherence of the observations from multiple sensors, only information provided by the validated sensors are combined under a loosely coupled probabilistic framework with an information filter. Then, if GPS receivers encounter long term outages, the accumulated localization error of DR-only method is proposed to be bounded by adding a GIS building map layer. Two onboard LRF systems (a horizontal LRF and a vertical LRF) are mounted on the roof of the vehicle and used to detect building facades in urban environment. The detected building facades are projected onto the 2D ground plane and associated with the GIS building map layer to correct the vehicle pose error, especially for the lateral error. The extracted facade landmarks from the vertical LRF scan are stored in a new GIS map layer. The proposed approach is tested and evaluated with real data sequences. Experimental results with real data show that fusion of the stereoscopic system and LRF can continue to localize the vehicle during GPS outages in short period and to correct the GPS positioning error such as GPS jumps; the road map can help to obtain an approximate estimation of the vehicle position by projecting the vehicle position on the corresponding road segment; and the integration of the building information can help to refine the initial pose estimation when GPS signals are lost for long time.

Este trabalho apresenta um sistema de auxilio à navegação autônoma para veículos terrestres com foco em ambientes estruturados em um cenário agrícola. É gerada a estimativa das posições dos obstáculos baseado na fusão das detecções provenientes do processamento dos dados de duas câmeras, uma estéreo e outra térmica. Foram desenvolvidos três módulos de detecção de obstáculos. O primeiro módulo utiliza imagens monoculares da câmera estéreo para detectar novidades no ambiente através da comparação do estado atual com o estado anterior. O segundo módulo utiliza a técnica Stixel para delimitar os obstáculos acima do plano do chão. Por fim, o terceiro módulo utiliza as imagens térmicas para encontrar assinaturas que evidenciem a presença de obstáculo. Os módulos de detecção são fundidos utilizando a Teoria de Dempster-Shafer que fornece a estimativa da presença de obstáculos no ambiente. Os experimentos foram executados em ambiente agrícola real. Foi executada a validação do sistema em cenários bem iluminados, com terreno irregular e com obstáculos diversos. O sistema apresentou um desempenho satisfatório tendo em vista a utilização de uma abordagem baseada em apenas três módulos de detecção com metodologias que não tem por objetivo priorizar a confirmação de obstáculos, mas sim a busca de novos obstáculos. Nesta dissertação são apresentados os principais componentes de um sistema de detecção de obstáculos e as etapas necessárias para a sua concepção, assim como resultados de experimentos com o uso de um veículo real. / This work presents a support system to the autonomous navigation for ground vehicles with focus on structured environments in an agricultural scenario. The estimated obstacle positions are generated based on the fusion of the detections from the processing of data from two cameras, one stereo and other thermal. Three modules obstacle detection have been developed. The first module uses monocular images of the stereo camera to detect novelties in the environment by comparing the current state with the previous state. The second module uses Stixel technique to delimit the obstacles above the ground plane. Finally, the third module uses thermal images to find signatures that reveal the presence of obstacle. The detection modules are fused using the Dempster-Shafer theory that provides an estimate of the presence of obstacles in the environment. The experiments were executed in real agricultural environment. System validation was performed in well-lit scenarios, with uneven terrain and different obstacles. The system showed satisfactory performance considering the use of an approach based on only three detection modules with methods that do not prioritize obstacle confirmation, but the search for new ones. This dissertation presents the main components of an obstacle detection system and the necessary steps for its design as well as results of experiments with the use of a real vehicle.

A utilização de sistemas de controle para estabilidade de conjuntos de barras para pulverizadores agrícolas é uma tendência devida principalmente aos problemas ambientais e de custo. Neste trabalho, o comportamento dinâmico de um pulverizador de arrasto é analisado através de um modelo não linear, obtido através de técnicas de modelagem de sistemas multicorpos utilizando-se o programa ADAMS. Foram utilizadas duas estratégias de controle PID e \"fuzzy\" a partir de medidas obtidas com fusão de sensores. A estratégia de controle clássica PID foi desenvolvida e implementada no modelo não linear no ADAMS através de ferramentas internas existentes no programa. Já a estratégia \"fuzzy\" foi desenvolvida e implementada no modelo não linear no ADAMS através da técnica de co-simulação ADAMS/Matlab. O comportamento dos sistemas de controle foi investigado através de simulação computacional. Foram testados alguns tipos de entradas (entrada degrau, entrada harmônica, entrada randômica e entrada randômica com descontinuidades bruscas). Em todas as simulações os resultados obtidos com os sistemas de controles ativos mostraram melhor estabilidade do conjunto de barras. Entre as leis de controle implementadas (PID e \"fuzzy\") não houve grandes diferenças entre as oscilações da barra exceto na entrada do tipo randômica com descontinuidades bruscas. Neste caso a lei de controle \"fuzzy\" apresentou uma grande melhoria com boa atenuação das oscilações do conjunto de barras quando comparadas com a aplicação do sistema de controle PID. / The use of active control systems for stability of booms in agricultural sprayers trend is mainly due to the environmental and costs question. In this work, the dynamic behavior of a trailed sprayer is analyzed using a nonlinear model, obtained through techniques of modeling multibody systems using the ADAMS. It is used two active control strategies, PID classical control and fuzzy, with measured data from sensor fusion. The classical PID control strategy was developed and implemented in a nonlinear model on ADAMS software using existing tools built into the program. Fuzzy was another strategy developed and implemented in the nonlinear model on ADAMS software using a technique of co-simulation ADAMS/Matlab. The behavior of control systems was investigated through computer simulation. It was tested some types of inputs (step input, harmonic input, random input and random input with abrupt discontinuities). All simulations data obtained from the applications of active systems showed better stability for boom assembly. Among the implemented two active control laws (PID and \"fuzzy\") there were no significant differences between the oscillations attenuation of the boom, except with the random input with abrupt discontinuities. wherein this case the application of the active control \"fuzzy\" strategy developed better stability on boom than the application of PID control.

This thesis represents Bayesian joint audio-visual tracking for the 3D locations of multiple people and a current speaker in a real conference environment. To achieve this objective, it focuses on several different research interests, such as acoustic-feature detection, visual-feature detection, a non-linear Bayesian framework, data association, and sensor fusion. As acoustic-feature detection, time-delay-of-arrival~(TDOA) estimation is used for multiple source detection. Localization performance using TDOAs is also analyzed according to different configurations of microphones. As a visual-feature detection, Viola-Jones face detection is used to initialize the locations of unknown multiple objects. Then, a corner feature, based on the results from the Viola-Jones face detection, is used for motion detection for robust objects. Simple point-to-line correspondences between multiple cameras using fundamental matrices are used to determine which features are more robust. As a method for data association and sensor fusion, Monte-Carlo JPDAF and a data association with IPPF~(DA-IPPF) are implemented in the framework of particle filtering. Three different tracking scenarios of acoustic source tracking, visual source tracking, and joint acoustic-visual source tracking are represented using the proposed algorithms. Finally the real-time implementation of this joint acoustic-visual tracking system using a PC, four cameras, and six microphones is addressed with two parts of system implementation and real-time processing.

[pt] Quadrirrotores são veículos aéreos que possuem quatro rotores fixos e orientados na direção vertical. Devido à sua simplicidade mecânica frente aos helicópteros tradicionais, os mesmos têm se tornado cada vez mais populares nos meios de pesquisa, militares e, mais recentemente, industriais. Essa topologia de veículo data do início do século XX mas o desenvolvimento em escala só foi possível após a recente evolução e miniaturização dos sistemas eletrônicos embarcados, dos motores elétricos e das baterias. A movimentação desses veículos no espaço é possível graças à sua inclinação em relação ao solo e, para tal, é imprescindível obter e controlar corretamente a atitude do mesmo. As unidades de medidas inerciais (IMU) surgiram como uma solução para esse problema. Através da fusão dos dados obtidos com os sensores presentes nessas centrais (acelerômetros, girômetros e magnetômetro) é possível estimar a atitude do veículo. O presente trabalho apresenta soluções tanto para a estimativa quanto para o controle de atitude de quadrirrotor. Os modelos matemáticos desenvolvidos são validados em simulações numéricas e em testes experimentais. O objetivo é que as soluções propostas apresentem resultados positivos para que possam ser empregadas nos quadrirrotores em escala. / [en] Quadrotors are vehicles that have four fixed rotors in the vertical direction. Due to its mechanical simplicity compared to traditional helicopters, these vehicles have become increasingly popular in the research, military and, more recently, industrial fields. This type of vehicle first appeared in the early twentieth century, but the development of small-scale models was only possible after the recent evolution and miniaturization of embedded electronics, electric motors and batteries. A Quadrotor can fly in any direction by changing its inclination relative to the ground, so it is essential to calculate and properly adjust its attitude. The inertial measurement units (IMU) emerged as one solution to this problem. By merging the IMU sensors data, it is possible to estimate the vehicle s attitude. This dissertation presents solutions for both the estimation and the control of the vehicle s attitude. The developed mathematical models are validated with numerical simulations and experimental tests. The goal is that the presented solutions give enough good results so they can be used in small-scale Quadrotors.