Back to search

University of Victoria (Canada)

Free-space gesture mappings for music and sound

Abstract

dc:description.abstract

This thesis describes a set of software applications for real-time gesturally con- trolled interactions with music and sound. The applications for each system are varied but related, addressing unsolved problems in the field of audio and music technology. The three systems presented in this work capture 3D human motion with spatial sensors and map position data from the sensors onto sonic parameters. Two different spatial sensors are used interchangeably to perform motion capture: the radiodrum and the Xbox Kinect. The first two systems are aimed at creating immersive virtually-augmented environments. The first application uses human ges- ture to move sounds spatially in a 3D surround sound by physically modelling the movement of sound in a space. The second application is a gesturally controlled self- organized music browser in which songs are clustered based on auditory similarity. The third application is specifically aimed at extending musical performance through the development of a digitally augmented vibraphone. Each of these applications is presented with related work, theoretical and technical details for implementation, and discussions of future work.

Degree

thesis:*
Level thesis:degree_level
Master of Applied Science M.A.Sc.
Department thesis:degree_department
Department of Electrical and Computer Engineering
Year dc:date.issued
2012

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Odowichuk, Gabrielle
Advisors dc:contributor.supervisor
  • Driessen, Peter F.
  • Tzanetakis, George

Subjects

dc:subject × 8

Rights

dc:rights
Statement dc:rights
  • Available to the World Wide Web
Language dc:language.iso
en, English

Identifiers

dc:identifier.*
Dc Identifier Citation
Odowichuk G. and Tzanetakis G., "Browsing Music and Sound in a Self-organized 3D Space", In the Proceedings of the International Computer Music Conference, Ljubljana, Slovenia, 2012
Trail S., Dean M., Tavares T., Odowichuk G., Driessen P., Schloss W.A., Tzanetakis G., "Non-invasive sensing and gesture control for pitched percussion hyper-instruments using the Kinect", In the Proceedings of the International Conference on New Interfaces for Musical Expression, Ann Arbor, USA, 2012
Odowichuk G., Driessen P., Ness S., and Tzanetakis G., "Controlling Real Time Sound Spatialization Using the Radiodrum ", In the Proceedings of the International Computer Music Conference, Huddersfield, UK, 2011
Odowichuk G., Trail S., Driessen P., Nie W. and Page W., "Sensor Fusion: Towards a Fully Expressive 3D Music Control Interface ", In the Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, Victoria, CA, 2011

Chain of custody

source
Harvested from
University of Victoria (Canada)
Base URL
dspace.library.uvic.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Odowichuk, Gabrielle. Free-space gesture mappings for music and sound. Master of Applied Science M.A.Sc. thesis, 2012. http://hdl.handle.net/1828/4288