Back to search

Georgia Institute of Technology

Real-Time Speaker Diarization with Dynamic Enrollment Using External Knowledge

Abstract

dc:description.abstract

Real-time speaker diarization with dynamic enrollment faces a fundamental challenge: building reliable speaker models from limited data while maintaining consistent speaker identities throughout recordings. Existing systems suffer from two critical limitations: covariance instability causing speaker fragmentation, and threshold sensitivity preventing universal deployment. This thesis introduces two complementary contributions to address these limitations. First, VoxCeleb1 acoustic matching stabilizes speaker covariance estimation by identifying the reference speaker whose covariance structure best fits the target speaker's observed data through log-likelihood scoring, rather than estimating covariances from limited enrollment data. Second, a scale-invariant, outlier-robust detection mechanism replaces the summation-based distance metric with trimmed mean Mahalanobis distance computation, enabling universal threshold usage across different covariance structures and system configurations. Experimental evaluation on the VoxConverse dataset demonstrates that the proposed method achieves an 87.9% reduction in mean absolute speaker counting error compared to the baseline, with 75% of recordings falling within ±2 speakers of ground truth. These results establish that principled integration of external knowledge with robust statistical methods can significantly enhance real-time speaker diarization performance.

Degree

thesis:*
Name thesis:degree_name
Electrical and Computer Engineering, MS
Department thesis:degree_department
Electrical and Computer Engineering
Grantor
Georgia Institute of Technology
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Sohn, Chanwoo
Advisor dc:contributor.advisor
  • Anderson, David V.
Committee members dc:contributor.committeemember
  • Moore, Elliot
  • Heck, Larry

Rights

Language dc:language.iso
English

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/81664

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Sohn, Chanwoo. Real-Time Speaker Diarization with Dynamic Enrollment Using External Knowledge. Georgia Institute of Technology, 2026. https://hdl.handle.net/1853/81664