Abstract
dc:description.abstractThis thesis describes a set of software applications for real-time gesturally con- trolled interactions with music and sound. The applications for each system are varied but related, addressing unsolved problems in the field of audio and music technology. The three systems presented in this work capture 3D human motion with spatial sensors and map position data from the sensors onto sonic parameters. Two different spatial sensors are used interchangeably to perform motion capture: the radiodrum and the Xbox Kinect. The first two systems are aimed at creating immersive virtually-augmented environments. The first application uses human ges- ture to move sounds spatially in a 3D surround sound by physically modelling the movement of sound in a space. The second application is a gesturally controlled self- organized music browser in which songs are clustered based on auditory similarity. The third application is specifically aimed at extending musical performance through the development of a digitally augmented vibraphone. Each of these applications is presented with related work, theoretical and technical details for implementation, and discussions of future work.
Degree
thesis:*- Level thesis:degree_level
- Master of Applied Science M.A.Sc.
- Department thesis:degree_department
- Department of Electrical and Computer Engineering
- Year dc:date.issued
- 2012
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Odowichuk, Gabrielle
- Advisors dc:contributor.supervisor
-
- Driessen, Peter F.
- Tzanetakis, George
Subjects
dc:subject × 8Rights
dc:rights- Statement dc:rights
-
- Available to the World Wide Web
- Language dc:language.iso
- en, English
Identifiers
dc:identifier.*- Dc Identifier Citation
-
Odowichuk G. and Tzanetakis G., "Browsing Music and Sound in a Self-organized 3D Space", In the Proceedings of the International Computer Music Conference, Ljubljana, Slovenia, 2012
Trail S., Dean M., Tavares T., Odowichuk G., Driessen P., Schloss W.A., Tzanetakis G., "Non-invasive sensing and gesture control for pitched percussion hyper-instruments using the Kinect", In the Proceedings of the International Conference on New Interfaces for Musical Expression, Ann Arbor, USA, 2012
Odowichuk G., Driessen P., Ness S., and Tzanetakis G., "Controlling Real Time Sound Spatialization Using the Radiodrum ", In the Proceedings of the International Computer Music Conference, Huddersfield, UK, 2011
Odowichuk G., Trail S., Driessen P., Nie W. and Page W., "Sensor Fusion: Towards a Fully Expressive 3D Music Control Interface ", In the Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, Victoria, CA, 2011