Through its portfolio of practical case studies and its engagement with critical thinking from a range of disciplines, the PhD investigates the following key question: what are the technical, aesthetic and conceptual impacts of using binaural technology to create a soundscape? ‘Using binaural technology’ implies users and users are essentially at the heart of this impact because users mediate the technical and aesthetic aspects of binaural technology and also inherently shape the theoretical ideology of this technology. By analysing users’ interactions with binaural technology from a social constructivist perspective, this thesis gains rich insights into the impact of using binaural technology when creating soundscapes. Chapter One explores sound artists’ and field recordists’ work that use binaural technology for the shared purpose of documenting urban soundwalks. The first case study “Audio Postcards” is also informed by questions drawn from acoustic ecology, socio-political theories on the practices of everyday life and the challenges that arise in finding, recording and preserving ‘soundmarks’. Chapter Two outlines practitioners’ applications of binaural technology to create an intimate connection to an art piece such as theatre director David Rosenberg’s productions. Peter Salvatore Petralia’s concept of headspace is applied to the chapter’s case study: “From Austria To America” to further understand binaural technology’s psychoacoustic effects. Chapter Three studies the impact of social groups who use binaural technology to record classical music performances. Traditional stereo and binaural classical music recording conventions are shaped in a new direction in two case studies: “Point of Audition” and “From Page to Stage”. Questions of ‘fidelity’ also arise from this creative practice. The outcomes of this reflective binaural practice unearth deep layers of understanding. This thesis discovers the impact of binaural technology moves beyond the effect it has on a listener to realise this recording practice also impacts a recordist’s decisions in the field and a sound artist’s creative choices when crafting soundscapes. The beneficial impact of binaural technology including its inconspicuous nature, the ability to imprint an artist’s subjective signature on recordings and its lifelike immersive qualities in playback are revealed through practice and reflection. Representing the real, the role of artist and point of audition are also themes explored throughout each chapter. Ultimately, insights gained are woven together as a means of constructing an original theoretical framework for an under-theorised subject: understanding how social user groups shape the impact of using binaural technology when creating soundscapes.

Children with central auditory processing disorders (CAPD) have a normal pure-tone audiogram, however, they have difficulty understanding speech in the presence of background noise. The present study examined binaural hearing in normal children and those with possible CAPD. Each subject was administered the SCAN or SCAN-A, screening tests for CAPD, to determine whether they were at risk for CAPD. Participants were then subjected to several monaural and binaural speech tasks, in quiet and noise. Spondee words were utilized in each task, under headphone and soundfield conditions.

La grande majorité des systèmes perceptifs proposés en robotique héritent d'une conception passive de la perception dans laquelle la génération d'une commande motrice est l'étape ultime d'une succession de traitements purement passifs. Dans le cadre de la localisation de sources sonores, qui est une tâche fondamentale du système auditif, cette approche passive offre de bons résultats lorsque les conditions environnementales sont bien connues et facilement modélisables. Cependant des difficultés apparaissent lorsque l'environnement se complexifie, a fortiori s'il est inconnu ou changeant. Ces difficultés constituent un enjeu important dans le domaine de l'audition artificielle. Cette thèse considère une approche radicalement différente de l'approche passive, inspirée de la psychologie de la perception et de la théorie des contingences sensorimotrices. Cette approche place l'action au coeur du processus de perception, qui est alors vu comme une interaction qu'un agent biologique ou robotique entretient avec son environnement. Alors que l'approche passive nécessite des connaissances sur l'environnement, implicement intégrées dans les traitements par le roboticien, l'approche sensorimotrice suggère au contraire que ces connaissances sont acquises par l'agent de manière autonome, à travers son expérience sensorimotrice. Ainsi cette thèse applique la théorie des contingences sensorimotrices à la localisation de sources sonores pour la robotique autonome. Sur la base d'un modèle bioinspiré du système auditif adapté au contexte robotique, cette thèse propose une redéfinition du problème de la localisation en termes sensorimoteurs. Un modèle de localisation sensorimotrice est alors proposé. Celui-ci se base sur des capacités de perception active bas-niveau pour construire une représentation de l'espace auditif qui est ensuite utilisée pour une localisation passive. En exploitant les capacités d'action du robot, ce modèle permet de s'affranchir des dépendances à l'environnement qui mettent en difficulté l'approche passive, en proposant ainsi un degré d'autonomie supérieur à celui des modèles actuels / The vast majority of perceptual systems proposed in robotics inherit apassive conception of perception, in which the generation of a motor command is the final stage of successive passive processes. In the field of sound sources localization, which is a fundamental task of the auditory system, this passive approach provides good results when the environment is well known and easily modeled. However, difficulties arise when the environment becomes more complex, unknown or changing. These difficulties are a major issue in the field of machine hearing. This thesis considers a radically different approach inspired by the psychology of perception and theory of sensorimotor contingencies. This approach places action at the heart of the process of perception, which is seen as an interaction of a biological or robotic agent with it's environment. While passive approach requires environmental knowledge, implicitly integrated into models by the robotisist, the sensorimotor approach suggests that this knowledge is acquired by the agent by itself, through its sensorimotor experience. Thus, this thesis applies the theory of sensorimotor contingencies to sound sources localization for autonomous robots. Based on a model of the auditory system adapted to robotics, this thesis proposes a redefinition of the localization problem in sensorimotor terms. A sensorimotor model of localization is then proposed. It is based on active and low-level perception skills which are used to learn a representation of the auditory space. This representation is then used for a passive localization of new sound sources. By exploiting the active capabilities of the robot, this model eliminates the environment dependencies that put difficulty in the passive approach, thus offering a degree of autonomy higher than current models

Cette thèse se concentre sur l'individualisation des HRTF pour la synthèse binaurale. Les systèmes permettant de mesurer des HRTF sont difficiles d'accès au grand public, ce qui pose un problème pour la démocratisation de l'audio binaurale de haute qualité. C'est pour cette raison que nous recherchons une méthode permettant de calculer les HRTF d'une personne qu'à partir de la connaissance de sa morphologie. Ces travaux de thèse avancent sur les investigations visant à avoir une technique de personnalisation de l'audio binaurale. La technique de personnalisation proposée part du principe qu'il existe un lien direct et systématique liant des paramètres de la morphologie d'un individu avec les indices spectraux de ses HRTF. Elle est basée sur la détermination d'une fonction qui prend en entrée des paramètres morphologiques et qui donne en sortie des paramètres de transformation à appliquer à un jeu de HRTF existant pour obtenir un jeu de HRTF personnalisé. Cette fonction est estimée à partir d'analyses statistiques faits sur une base de données contenant des modèles numériques des individus ainsi que leurs HRTF. Pour atteindre cet objectif, il faut construire dans un premier temps les données à partir desquelles nous allons estimer notre fonction de personnalisation. Ces travaux expliquent les systèmes que nous avons conçus pour mesurer les HRTF des individus ainsi que pour obtenir leur modèle numérique tridimensionnel. De plus, les protocoles de mesure associés à chaque système sont expliqués. Enfin, nous expliquons comment les données obtenues peuvent être exploitées pour développer un procédé de personnalisation des HRTF. / This thesis focuses on the HRTF individualization problem in the context of binaural synthesis for general applications. HRTF strongly depend on morphological features of a person and, in order to provide compelling auditory spaces, binaural synthesis requires the use of individualized HRTF. Measuring or calculating the HRTF of a listener are common but lengthy and costly methods that are not feasible for general public applications. That is the reason why we aim to develop an alternative technique to obtain customized HRTF. The technique proposed relies on estimating the spectral cues of the HRTF, corresponding to the colorations induced by pinna filtering, from a person's morphology. The spectral cues represent the most complex and individual part of HRTF. The work presented in this thesis is based on the existence of a direct and systematic link between the morphology of a person and the spectral cues of their HRTF. The goal is to start from individualization techniques of HRTF and make studies for better understanding the relationship between the morphology of a person and their HRTF. The ultimate goal is then to find a proper morphological matching personalization technique. The first step to achieve this goal is to build the measuring systems who will help us create the databases that we will use for our analyses. This thesis explains the two measuring systems that were created and the measuring protocols that were used to create two related databases containing the 3D models and the measured HRTFs of a collection of people. We then explain how these databases can be used to fit the HRTF individualization technique we have proposed.

This thesis describes the development of the real-time convolution system (RTCS) for a little-studied talker/listener in virtual acoustic environments. We include descriptions of the high-resolution directivity measurements of human speech, the RTCS system components, the measurement and characterization of oral-binaural room impulse responses (OBRIRs) for a variety of acoustic environments, and the compensation filter necessary for its validity. In addition to incorporating the high-resolution directivity measurements, this RTCS improved on that developed by Cabrera et al. [1] through the derivation and inclusion of the compensation filter. Objective measures in the time- and frequency-domains, as well as subjective measures, were developed to asses the validity of the RTCS. The utility of the RTCS is demonstrated in the study on vocal effort, and the results of an initial investigation into the vocal effort data are presented.

Abstract is available through the Abstracts of the Association for Research in Otolaryngology.

Three experiments investigated the ability and means by which Florida manatees determine sound source directionality. An eight-choice discrimination paradigm determined the sound localization abilities of two manatees within a 360° array of speakers. Five conditions were tested including a 3,000 and 200 ms, 95 dB, 0.2-24 kHz signal, a 3,000 ms, 80 dB, 18-24 kHz signal, a 3000 ms, 110 dB, 0.2-1.5 kHz signal and a 200 ms, 101 dB, 4 kHz tonal signal. A sixth condition attenuated the level of the 3,000 ms, 95 dB, 0.2-24 kHz signal in 3 dB increments until accuracy reached 75%. Subjects performed above the 12.5% chance level for all broadband frequencies and were able to localize over a large level range. Errors were typically located to either side of the signal source location when presented in the front 180° but were more dispersed when presented from the 135°, 180° and 225° locations. Front-to-back confusions were few and accuracy was greater when signals originated from the front 180°. Head/body related transfer functions determined how different frequencies were filtered by the manatees' head/torso to create frequency-specific interaural level differences (ILDs). Hydrophones were suspended next to each manatee ear and Fast Fourier transform (FFT) ratios compared received signals with and without the subject's presence. ILD magnitudes were derived for all frequencies, as well as specific 0.2-1.5, 0.2-5, and 18-30 kHz bands of frequencies. ILDs were found for all frequencies as a function of source location, although they were largest with frequencies above 18 kHz and when signals originated at 90° and 270°. Larger ILDs were found when the signals originated behind the subjects as compared to in front of them. Auditory evoked potential (AEP) techniques were used to map manatee sound conduction pathways in-water and in-air using 15 and 24 kHz carriers. All subjects produced AEPs at each position the transducer was placed, however specific sound conduction pathway(s) were not identified. AEP amplitudes were usually greater with the 24 kHz carrier, however patterns between carriers at identical body positions were highly variable between subjects.

Previous research suggests that larger context effects are observed when participants are required to search a scene in order to find the to-be-remembered stimuli. Similarly, animal research on brain oscillations has shown theta wave activation when animals are searching their environment. These theta wave oscillations are positively correlated with learning. However, theta activation can also occur in response to sensory stimulation, for example, auditory stimulation with binaural beats or visual stimulation with a checkerboard pattern reversal. The results of several studies suggest that while a visual search task seems to reliably improve free recall performance, the effects of passive sensory stimulation on memory are less consistent. Implications and suggestions for future research are discussed.

Les implants cochléaires sont des appareils destinés à la réhabilitationdes surdités profondes et totales. Ils assurent la stimulation du nerf auditif en plaçant des électrodes dans la cochlée. Différentes études ont été établis afin d'améliorer l'intelligibilité de la parole dans le bruit chez le patientporteur de cet appareil. Les techniques bilatérales et binaurales permettent dereproduire une audition binaurale, car les deux oreilles sont simulées (commepour les personnes normo-entendantes). Ainsi la localisation et la perceptiondes sons environnants sont améliorées par rapport à une implantationmonaurale. Toutefois, les capacit'es de reconnaissances des mots sont trèsvite limitées en pr'esence de bruits. Nous avons d'evelopp'es des techniquesde r'eduction de bruit afin d'augmenter les performances de reconnaissance.Des améliorations de 10% à 15% suivant les conditions ont été observées. Néanmoins, si la perception est améliorée par les algorithmes, ils focalisent sur une direction, et ainsi, la localisation est alors réduite à l'angle delocalisation. Une seconde étude a alors été effectuée pour mesurer l'effetdes algorithmes sur la localisation. Ainsi, le beamformer donne les meilleurs résultats de compréhension mais la moins bonne localisation. La ré-injectiond'un pourcentage du signal d'entrée sur la sortie a permis de compenser laperte de la localisation sans détériorer l'intelligibilité. Le résultat de ces deux expériences montre qu'il faut un compromis entre laperception et la localisation des sons pour obtenir les meilleures performances.

Based on prior research on concepts such as kinesonic feedback, and the here presented concept of kinesonic perspective, this study investigates whether or not players prefer binaurally recorded Foley over monophonically recorded Foley in a first-person video game environment, and whether or not binaural Foley has an impact on their relationship to, or perception of, the avatar. A game environment was created, in which players could switch at will between two audio modes; one containing binaurally recorded Foley, and the other containing monophonically recorded Foley. In the study, subjects were asked to state their preference between the two modes, motivate said preference, rate the two modes on three attributes, and answer questions regarding their perceived relationship to the avatar. Results showed no statistical significance regarding the preference of the sample, but a potential link was found between subjects’ preference and their perceived believability of the Foley sounds. The qualitative results showed that the binaural Foley had a complex impact on the subjects’ perception of and relationship to the avatar. The qualitative data also showed that subjects generally felt that the binaural Foley originated from their own body. Due to the small sample size and diversity of subject opinions it is however difficult to make any generalizations regarding the average player. Further research could investigate what role sound plays in the player’s ability to embody the avatar, as well as more thoroughly investigate the complex relationship between the kinesonic perspective of the avatar and that of the player.