Back to search

Institutes outside Greece

Psychophysical scaling of timbre-related audio descriptors

Abstract

dc:description

Timbre has most often been studied through correlational analyses that associate perceptualdimensions (or in other words, the orthogonal axes of a timbre space), with a wideset of audio descriptors. These timbre-related descriptors have been widely used for taskssuch as acoustical interpretation of perceptual dimensions, explaining listeners’ dissimilarityratings between pairs of sounds, content delivery in music information retrieval systems,investigating timbre semantics, quantifying affective responses to sound, predictingthe amount of blend between instrumental sounds, investigating cognitive factors relatedto memory for timbre, and developing perceptually based audio processing strategies andsound effects. However, audio descriptors identified through correlational analyses do notnecessarily causally relate to listeners’ perceptions and when entered into statistical regressionmodels may lead to false positive interpretations about their perceptual significance, especially when features also strongly covary. The present thesis undertakes an investigation of timbre by establishing psychophysicalcorrespondences between perception and several timbre-related audio descriptors. Threestudies investigate whether listeners perceive spectral audio descriptors on perceptual ordinal,interval, and ratio scales, and temporal descriptors on an ordinal scale. The stimuliused in each of the presented experiments were constructed through specifically designedsynthesis algorithms that enabled control of each audio descriptor independently of the restand that therefore isolated as much as was feasible the effect of each descriptor on listeners’perceptions. The first study perceptually validates spectral audio descriptors through an ordinalscaling experiment. The results indicate that listeners were overall able to rank orderthe stimuli of a particular feature set when presented with an appropriate spacing of descriptorvalues. The second study underpins the effect of amplitude envelope features andspectral envelope features on the perceptual relevance of temporal audio descriptors andinharmonicity, through another ordinal scaling experiment. In addition, the results of thatexperiment suggested a combination of acoustically independent descriptors that could potentiallyexplain variation along a spectrotemporal perceptual dimension, which in previoustimbre studies had been considered to be strictly temporal. The above hypothesis was confirmedby conducting a meta-analysis on the timbre spaces derived from previous studies. The third study comprises two experiments that provided interval scale and ratio scalemeasurements on spectral audio descriptors. The results of the first experiment indicated that listeners were overall able to estimate intervals of spectral descriptors. We thereforeproceeded to a ratio scaling experiment the results of which indicated that listeners canalso produce ratios of descriptor values and enabled the construction of psychophysicalratio scales of each descriptor tested. The findings advance the current knowledge on timbre perception both by establishingcause-and-effect relations between audio descriptors and perceptual dimensions and by expanding previous research in which the acoustical interpretations of perceptual dimensions were made solely under the prism of correlational analysis. The psychophysical correspondencesbetween perception and audio descriptors reported in this thesis will hopefully serveas a basis for future research, which may attempt to study timbre as a phenomenon thatemerges from a combination of audio features and explore its psychophysical attributesthrough perceptual dominance hierarchies of those features.

Degree

thesis:*
Grantor dc:publisher
Institutes outside Greece
Year dc:date
2020

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Kazazis, Savvas
  • Καζάζης, Σάββας

Subjects

dc:subject × 8

Rights

Language dc:language
eng

Identifiers

dc:identifier.*
Identifier
10.12681/eadd/62804

Chain of custody

source
Harvested from
Greek National Archive of PhD Theses
Base URL
phdtheses.ekt.gr/eadd_oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Kazazis, Savvas; Καζάζης, Σάββας. Psychophysical scaling of timbre-related audio descriptors. Institutes outside Greece, 2020. http://hdl.handle.net/10442/hedi/62804