University of Victoria (Canada)
Content-aware visualizations of audio data in diverse contexts
Abstract
dc:description.abstractThe visualization of the high-dimensional feature landscapes that are encountered when analyzing audio data is a challenging problem and is the focus of much research in the field of Music Information Retrieval. Typical feature sets extracted from sound have anywhere from dozens to hundreds of dimensions and have complex interrelationships between data elements. In this work, we apply various modern techniques for the visualization of audio data to a number of diverse problem domains, including the bioacoustics of Orcinus Orca (killer whale) song, partially annotated chant traditions including Torah recitation and the the analysis of music collections and live DJ sets. We also develop a number of graphical user interfaces to allow users to interact with these visualizations. These interfaces include Flash-enabled web applications, desktop applications, and novel interfaces including the use of the Radiodrum, a three-dimension position sensing musical interface.
Degree
thesis:*- Level thesis:degree_level
- Master of Science M.Sc.
- Department thesis:degree_department
- Department of Computer Science
- Year dc:date.issued
- 2009
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Ness, Steven
- Advisor dc:contributor.supervisor
-
- Tzanetakis, George
Subjects
dc:subject × 3Rights
dc:rights- Statement dc:rights
-
- Available to the World Wide Web
- Language dc:language.iso
- en, English
Identifiers
dc:identifier.*- Dc Identifier Citation
-
Steven R. Ness, Daniel Peter Biro and George Tzanetakis Computer-assisted cantillation and chant research using content-aware web visualization tools, Multimedia Tools and Applications, Accepted for publication.
S. R. Ness, A. Theocharis, G. Tzanetakis, L. G. Martins Improving Automatic Music Tag Annotation Using Stacked Generalization Of Probabilistic SVM Outputs, ACM Multimedia 2009.
Steven R. Ness, George Tzanetakis, Audioscapes: exploring surface interfaces for music exploration - ICMC 2009.
Steven R. Ness, George Tzanetakis, SOMba : Multiuser music creation using Self-Organizing Maps and motion tracking - ICMC 2009.
Steven R. Ness, Daniel Peter Biro, George Tzanetakis : Content-aware web browsing and visualization tools for cantillation and chant research, 7th International Workshop on Content-Based Multimedia Indexing.
George Tzanetakis, Manjinder Singh Benning, Steven R. Ness, Darren Minifie, Nigel Livingston : Assistive Music Browsing using Self-Organizing Maps - PETRA 2009 : 2nd International Conference on PErvasive Technologies Related to Assistive Environments.
Steven R. Ness, Matthew Wright, Luis Gustavo Martins, George Tzanetakis: Chants and Orcas: semi-automatic tools for audio annotation and analysis in niche domains. ACM Multimedia 2008: 9-16.
Daniel Peter Biro, Steven Ness, Matthew Wright, W. Andrew Schloss and George Tzanetakis Decoding the Song: Histogram-Based Paradigmatic and Syntagmatic Analysis of Melodic Formulae in Hungarian Laments, Jewish Torah Trope, Tenth Century Plainchant and Koran Recitation EMUS Expressivity in MUsic and Speech : IRCAM - Institut de Recherche et de Coordination Acoustique/Musique - Paris, France.