Back to search

Michigan State University

Vocal style factorization for effective speaker recognition in affective scenarios

Abstract

dc:description

The accuracy of automated speaker recognition is negatively impacted by change in emotions in a person's speech. In this thesis, we hypothesize that speaker identity is composed of various vocal style factors that may be learned from unlabeled speech data and re-combined using a neural network architecture to generate holistic speaker identity representations for affective scenarios. In this regard we propose the E-Vector neural network architecture, composed of a 1-D CNN for learning speaker identity features and a vocal style factorization technique for determining vocal styles. Experiments conducted on the MSP-Podcast dataset demonstrate that the proposed architecture improves state-of-the-art speaker recognition accuracy in the affective domain over baseline ECAPA-TDNN speaker recognition models. For instance, the true match rate at a false match rate of 1% improves from 27.6% to 46.2%. Additionally, we provide an analysis between speaker recognition match scores and emotions to identify challenging affective scenarios.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Sandler, Morgan Lee
Contributors dc:contributor
  • Ross, Arun A.
  • Kordjamshidi, Parisa
  • Yan, Qiben

Subjects

dc:subject × 2

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
etd:51270
isbn:9798379615116
oclc:on1396767666
oclc:1396767666
umi:30494340
local:Sandler_grad.msu_0128N_19864

Chain of custody

source
Harvested from
Michigan State University
Base URL
d.lib.msu.edu/oai
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Sandler, Morgan Lee. Vocal style factorization for effective speaker recognition in affective scenarios. 2023. https://doi.org/doi:10.25335/nrsx-g437