Back to search

University of South Florida

Classifying Emotions with EEG and Peripheral Physiological Data Using 1D Convolutional Long Short-Term Memory Neural Network

Abstract

dc:description

Recognizing emotions is very important while building robust and interactive Affective Brain-Computer Interfaces as it allows the machines to have some degree of emotional intelligence with the help of which they can understand the changing emotional state of users. In the past, emotions have been recognized via unimodal data such as electroencephalography (EEG) signals, speech, facial expressions or peripheral physiological signals. However, emotions are complex as they are a combination of human behavior, thinking and feeling. Therefore, as compared to unimodal methods, multi-modal techniques, recognize emotions with more reliability. This thesis aims to recognize and classify human emotions into high/low arousal and high/low valence using a multi-modal approach. The different modalities used are EEG, blood pressure, respiration, skin temperature, eye movements, muscle movements and skin conductance. The data is taken from a publicly available dataset called DEAP. The experiments are performed using the 1D Convolutional LSTM network and its performance is then compared with three baseline Machine Learning (ML) algorithms – Support Vector Machine, K-Nearest Neighbor and Random Forest. To investigate further, the emotion classification performance of different regions of the brain such as frontal lobe, parietal lobe, temporal lobe, occipital lobe, left hemisphere and right hemisphere are also compared. The model achieved an average accuracy of 91.19% for valence and 91.51% for arousal when used with a combination of EEG and peripheral data. The overall results show that the proposed neural network outperforms the traditional ML algorithms and gives a high emotion classification accuracy.

Degree

thesis:*
Name thesis:degree_name
MS in Computer Science (M.S.C.S.)
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2020

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Agarwal, Rupal
Contributors dc:contributor
  • Marvin Andujar, Ph.D.
  • Shaun Canavan, Ph.D.
  • Paul A. Rosen, Ph.D.

Subjects

dc:subject × 5

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/8908

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Agarwal, Rupal. Classifying Emotions with EEG and Peripheral Physiological Data Using 1D Convolutional Long Short-Term Memory Neural Network. Thesis thesis, University of South Florida, 2020. https://digitalcommons.usf.edu/etd/8908