Back to search

Georgia Institute of Technology

The sound within: Learning audio features from electroencephalogram recordings of music listening

Abstract

dc:description.abstract

We look at the intersection of music, machine Learning and neuroscience. Specifically, we are interested in understanding how we can predict audio onset events by using the electroencephalogram response of subjects listening to the same music segment. We present models and approaches to this problem using approaches derived by deep learning. We worked with a highly imbalanced dataset and present methods to solve it - tolerance windows and aggregations. Our presented methods are a feed-forward network, a convolutional neural network (CNN), a recurrent neural network (RNN) and a RNN with a custom unrolling method. Our results find that at a tolerance window of 40 ms, a feed-forward network performed well. We also found that an aggregation of 200 ms suggested promising results, with aggregations being a simple way to reduce model complexity.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Music
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2020

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Vinay, Ashvala
Advisor dc:contributor.advisor
  • Leslie, Grace
Committee members dc:contributor.committeemember
  • Lerch, Alexander
  • Romberg, Justin

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/62866

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Vinay, Ashvala. The sound within: Learning audio features from electroencephalogram recordings of music listening. Masters thesis, Georgia Institute of Technology, 2020. http://hdl.handle.net/1853/62866