Michigan Technological University
A reinforcement learning-based approach for adaptive real-time sensor data denoising in mining operations
Abstract
dc:description.abstractThe mining industry has traditionally relied on geostatistical models for estimating and managing mineral resources. In modern mining operations, real-time updates to these models are critical, as sensor data plays a vital role in characterizing deposit properties. However, noise often affects sensor measurements, compromising the accuracy and reliability of resource models. This study presents a novel reinforcement learning (RL) framework designed to dynamically denoise sensor readings and improve resource model updates. The methodology begins by reviewing current approaches to integrating sensor data into geostatistical models, highlighting their vulnerability to noise. The proposed framework leverages a Deep Deterministic Policy Gradient (DDPG) algorithm with a recurrent neural network (RNN) agent. This self-learning system sequentially processes noisy sensor data, using state representations that incorporate noise characteristics, spatial locations of sensor data, and uncertainty metrics derived from Monte Carlo (MC) Dropout. The RNN-based actor network generates actions to iteratively denoise the sensor value, while the critic network evaluates the denoising performance to optimize the process. The reward function is designed to prioritize the agent's proximity to the clean sensor value, minimize uncertainty, and promote exploration in high-variance scenarios. Training involves experience replay and interaction across multiple episodes, enabling the agent to learn robust denoising strategies. Experimental validation using a public dataset demonstrates improvements in signal quality and model reliability. By integrating this RL-based denoising algorithm into geostatistical resource model updating frameworks enables more robust tracking of mineral quality variations and enhances decision-making during mining operations. This approach offers a scalable solution for real-time data processing, with potential applications in other domains requiring dynamic sensor data refinement.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Geological Engineering (MS)
- Level thesis:degree_level
- Campus Access Master's Thesis
- Discipline thesis:degree_discipline
- Department of Geological and Mining Engineering and Sciences
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Sanchez Aguilar, Jhuleyssy Liesseth
- Committee members dc:contributor.committeemember
-
- Xiang Li
- Ashish Kumar
- Contributors dc:contributor
-
- Snehamoy Chatterjee
Identifiers
dc:identifier.*- Identifier
- https://digitalcommons.mtu.edu/etdr/1864