{"id":{"repo_id":"mcmaster","oai_identifier":"oai:macsphere.mcmaster.ca:11375/33815"},"canonical_url":"https://search.ndltd.org/etd/mcmaster/oai:macsphere.mcmaster.ca:11375/33815","repository":{"repo_id":"mcmaster","name":"McMaster University","base_url":"https://macsphere.mcmaster.ca/server/oai/request"},"display":{"title":"Chasing Wild Horses: Towards Robust Music Content Analysis Without Relying Upon Ground Truth","abstract":"Music Information Retrieval (MIR) tools extract features--tempo, mode, onset location, genre--that stand in for perceived musical properties. Evaluating these tools typically requires ground truth: correct reference values against which predictions are checked. For many musical properties, however, ground truth is contested, unavailable, or conceptually incoherent, leaving such features largely untested. We develop and validate evaluation frameworks that assess MIR features without ground truth, testing instead whether predictions remain stable under conditions that should not, musically speaking, alter them. We introduce Variation Between Versions (VBV), comparing feature extraction across 17 commercial recordings of J.S. Bach's Well-Tempered Clavier (Book 1) using three popular tools. Mode predictions varied substantially more than note-event counts, revealing pronounced tool-dependent instability. We extend this logic experimentally with the Instability Audit, applying controlled transformations (dynamics, tempo, pitch height) to procedurally generated audio and measuring resulting shifts in mode and onset-detection features across three tools. Stability varied by transformation and tool, with pitch-height changes proving most disruptive. Finally, we test whether robustness is associated with accuracy, comparing 17 onset-detection algorithms against ground truth alongside robustness under the same transformations, and find a significant correlation between the two, with the most robust algorithms converging with the most accurate. Together, these studies show that instability in MIR features is measurable, tool-dependent, and diagnostic even absent ground truth, and that robustness can serve as an alternative for accuracy where accuracy cannot otherwise be assessed. This thesis contributes two novel, ground-truth-free evaluation frameworks, empirical evidence of instability in widely used tools, and support for robustness as a meaningful evaluation criterion. More broadly, it lowers the technical barrier to rigorous MIR evaluation, extending it to researchers with musical rather than computational expertise, and argues for the relevance of feature-level evaluation as the usage of these tools becomes more widespread.","abstract_html":"Music Information Retrieval (MIR) tools extract features--tempo, mode, onset location, genre--that stand in for perceived musical properties. Evaluating these tools typically requires ground truth: correct reference values against which predictions are checked. For many musical properties, however, ground truth is contested, unavailable, or conceptually incoherent, leaving such features largely untested. We develop and validate evaluation frameworks that assess MIR features without ground truth, testing instead whether predictions remain stable under conditions that should not, musically speaking, alter them. We introduce Variation Between Versions (VBV), comparing feature extraction across 17 commercial recordings of J.S. Bach&#x27;s Well-Tempered Clavier (Book 1) using three popular tools. Mode predictions varied substantially more than note-event counts, revealing pronounced tool-dependent instability. We extend this logic experimentally with the Instability Audit, applying controlled transformations (dynamics, tempo, pitch height) to procedurally generated audio and measuring resulting shifts in mode and onset-detection features across three tools. Stability varied by transformation and tool, with pitch-height changes proving most disruptive. Finally, we test whether robustness is associated with accuracy, comparing 17 onset-detection algorithms against ground truth alongside robustness under the same transformations, and find a significant correlation between the two, with the most robust algorithms converging with the most accurate. Together, these studies show that instability in MIR features is measurable, tool-dependent, and diagnostic even absent ground truth, and that robustness can serve as an alternative for accuracy where accuracy cannot otherwise be assessed. This thesis contributes two novel, ground-truth-free evaluation frameworks, empirical evidence of instability in widely used tools, and support for robustness as a meaningful evaluation criterion. More broadly, it lowers the technical barrier to rigorous MIR evaluation, extending it to researchers with musical rather than computational expertise, and argues for the relevance of feature-level evaluation as the usage of these tools becomes more widespread.","abstract_has_math":false,"creators":["Konrad Swierczek"],"institution":null,"degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Psychology","school":null,"contributors":[],"advisors":["Schutz, Michael"],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026","date_published":"2026","updated_at":"2026-11-18T19:38:35Z","subjects":["Music","Music Information Retrieval","Music Cognition","Predictive Models"],"languages":["en"],"rights":["Attribution-NonCommercial 2.5 Canada"],"rights_urls":["http://creativecommons.org/licenses/by-nc/2.5/ca/"],"identifier_entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://doi.org/10.71548/25585"],"render_values":[{"text":"https://doi.org/10.71548/25585","href":"https://doi.org/10.71548/25585","code":true}]}],"person_identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/11375/33815","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/11375/33815","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://macsphere.mcmaster.ca/server/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Amacsphere.mcmaster.ca%3A11375%2F33815","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Schutz, Michael"]},{"key":"dc:contributor.department","label":"Department","values":["Psychology"]},{"key":"dc:creator","label":"Author","values":["Konrad Swierczek"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-10-14T17:26:40Z"]},{"key":"dc:date.issued","label":"Date","values":["2026"]},{"key":"dc:type","label":"Dc Type","values":["Dissertation","Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Music","Music Information Retrieval","Music Cognition","Predictive Models"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution-NonCommercial 2.5 Canada"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by-nc/2.5/ca/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/11375/33815","https://doi.org/10.71548/25585"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Music Information Retrieval (MIR) tools extract features--tempo, mode, onset location, genre--that stand in for perceived musical properties. Evaluating these tools typically requires ground truth: correct reference values against which predictions are checked. For many musical properties, however, ground truth is contested, unavailable, or conceptually incoherent, leaving such features largely untested. We develop and validate evaluation frameworks that assess MIR features without ground truth, testing instead whether predictions remain stable under conditions that should not, musically speaking, alter them. We introduce Variation Between Versions (VBV), comparing feature extraction across 17 commercial recordings of J.S. Bach's Well-Tempered Clavier (Book 1) using three popular tools. Mode predictions varied substantially more than note-event counts, revealing pronounced tool-dependent instability. We extend this logic experimentally with the Instability Audit, applying controlled transformations (dynamics, tempo, pitch height) to procedurally generated audio and measuring resulting shifts in mode and onset-detection features across three tools. Stability varied by transformation and tool, with pitch-height changes proving most disruptive. Finally, we test whether robustness is associated with accuracy, comparing 17 onset-detection algorithms against ground truth alongside robustness under the same transformations, and find a significant correlation between the two, with the most robust algorithms converging with the most accurate. Together, these studies show that instability in MIR features is measurable, tool-dependent, and diagnostic even absent ground truth, and that robustness can serve as an alternative for accuracy where accuracy cannot otherwise be assessed. This thesis contributes two novel, ground-truth-free evaluation frameworks, empirical evidence of instability in widely used tools, and support for robustness as a meaningful evaluation criterion. More broadly, it lowers the technical barrier to rigorous MIR evaluation, extending it to researchers with musical rather than computational expertise, and argues for the relevance of feature-level evaluation as the usage of these tools becomes more widespread."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Doctor of Philosophy (PhD)"]},{"key":"dc:title","label":"Title","values":["Chasing Wild Horses: Towards Robust Music Content Analysis Without Relying Upon Ground Truth"]},{"key":"dc:title.alternative","label":"Alternative Title","values":["Towards Robust Music Content Analysis Without Ground Truth"]},{"key":"others:access_status","label":"Others Access Status","values":["embargo"]}]}],"canonical_facts":{"dc:contributor.advisor":["Schutz, Michael"],"dc:contributor.department":["Psychology"],"dc:creator":["Konrad Swierczek"],"dc:date.accessioned":["2026-10-14T17:26:40Z"],"dc:date.issued":["2026"],"dc:description.abstract":["Music Information Retrieval (MIR) tools extract features--tempo, mode, onset location, genre--that stand in for perceived musical properties. Evaluating these tools typically requires ground truth: correct reference values against which predictions are checked. For many musical properties, however, ground truth is contested, unavailable, or conceptually incoherent, leaving such features largely untested. We develop and validate evaluation frameworks that assess MIR features without ground truth, testing instead whether predictions remain stable under conditions that should not, musically speaking, alter them. We introduce Variation Between Versions (VBV), comparing feature extraction across 17 commercial recordings of J.S. Bach's Well-Tempered Clavier (Book 1) using three popular tools. Mode predictions varied substantially more than note-event counts, revealing pronounced tool-dependent instability. We extend this logic experimentally with the Instability Audit, applying controlled transformations (dynamics, tempo, pitch height) to procedurally generated audio and measuring resulting shifts in mode and onset-detection features across three tools. Stability varied by transformation and tool, with pitch-height changes proving most disruptive. Finally, we test whether robustness is associated with accuracy, comparing 17 onset-detection algorithms against ground truth alongside robustness under the same transformations, and find a significant correlation between the two, with the most robust algorithms converging with the most accurate. Together, these studies show that instability in MIR features is measurable, tool-dependent, and diagnostic even absent ground truth, and that robustness can serve as an alternative for accuracy where accuracy cannot otherwise be assessed. This thesis contributes two novel, ground-truth-free evaluation frameworks, empirical evidence of instability in widely used tools, and support for robustness as a meaningful evaluation criterion. More broadly, it lowers the technical barrier to rigorous MIR evaluation, extending it to researchers with musical rather than computational expertise, and argues for the relevance of feature-level evaluation as the usage of these tools becomes more widespread."],"dc:description.degree":["Doctor of Philosophy (PhD)"],"dc:identifier.uri":["https://hdl.handle.net/11375/33815","https://doi.org/10.71548/25585"],"dc:language.iso":["en"],"dc:rights":["Attribution-NonCommercial 2.5 Canada"],"dc:rights.uri":["http://creativecommons.org/licenses/by-nc/2.5/ca/"],"dc:subject":["Music","Music Information Retrieval","Music Cognition","Predictive Models"],"dc:title":["Chasing Wild Horses: Towards Robust Music Content Analysis Without Relying Upon Ground Truth"],"dc:title.alternative":["Towards Robust Music Content Analysis Without Ground Truth"],"dc:type":["Dissertation","Thesis"],"others:access_status":["embargo"]},"updated_at":"2026-11-18T19:38:35Z"}