Back to search

University of South Florida

Enhancing State-of-the-Art Motor Imagery Classification with Reinforcement Learning

Abstract

dc:description

One of the key obstacles to the rapid adoption of non-invasive Brain-Computer Interfaces (BCIs) for Motor Imagery (MI) is the low signal-to-noise ratio, and the substantial data requirements which can be mentally taxing for users. EEGNet, a compact Convolutional Neural Network (CNN), has long been considered the state-of-the-art (SOTA) for MI classification, demonstrating strong performance even with limited data. However, recent studies advocate for integrating Deep Reinforcement Learning (RL) to further enhance classification accuracy by dynamically optimizing feature extraction and decision-making processes. Despite this potential, practical implementations remain scarce due to challenges in stabilizing RL training and adapting it to noisy EEG data. This work addresses these limitations by extending the Shallow Convolutional Network, a SOTA model for EEG classification, with a Stochastic Policy Gradient (SPG) policy. SPG was chosen for its ability to handle continuous action spaces, making it well-suited for working with EEG signal representations. The proposed approach uses reward-driven optimization to adaptively enhance feature selection and classification performance. Using the publicly available BCI Competition IV dataset, the model performs within-subject MI classification, achieving results that are comparable to, and in some cases exceed, existing SOTA approaches.

Degree

thesis:*
Name thesis:degree_name
MS in Computer Science (M.S.C.S.)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Shepelev, Anton
Contributors dc:contributor
  • Marvin Andujar, Ph.D.
  • Shaun Canavan, Ph.D.
  • Tempestt Neal, Ph.D.

Subjects

dc:subject × 8

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/11005

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Shepelev, Anton. Enhancing State-of-the-Art Motor Imagery Classification with Reinforcement Learning. Thesis thesis, University of South Florida, 2025. https://digitalcommons.usf.edu/etd/11005