No description available.

Preponderant visual interface use for conveying information from machine to human admits failures due to overwhelming the visual channel. This thesis investigates the suitability of auditory feedback and certain related design choices in settings involving background speech. Communicating a tele-operated vehicle’s tilt angle was the focal application. A simulator experiment with pitch feedback on one system variable, tilt angle, and its safety threshold was conducted. Manipulated in a within-subject design were: (1) presence vs. absence of speech, (2) discrete tilt alarm vs. discrete alarm and tilt sonification (continuous feedback), (3) tilt sonification vs. tilt and threshold sonification, and (4) linear vs. quadratic transfer function of variable to pitch. Designs with both variable and reference sonification were found to significantly reduce the time drivers spent exceeding the safety limit compared to the designs with no sonification, though this effect was not detected within the set of conditions with background speech audio.

Preponderant visual interface use for conveying information from machine to human admits failures due to overwhelming the visual channel. This thesis investigates the suitability of auditory feedback and certain related design choices in settings involving background speech. Communicating a tele-operated vehicle’s tilt angle was the focal application. A simulator experiment with pitch feedback on one system variable, tilt angle, and its safety threshold was conducted. Manipulated in a within-subject design were: (1) presence vs. absence of speech, (2) discrete tilt alarm vs. discrete alarm and tilt sonification (continuous feedback), (3) tilt sonification vs. tilt and threshold sonification, and (4) linear vs. quadratic transfer function of variable to pitch. Designs with both variable and reference sonification were found to significantly reduce the time drivers spent exceeding the safety limit compared to the designs with no sonification, though this effect was not detected within the set of conditions with background speech audio.

This portfolio of compositions researches the use of DNA sequences as a system for music composition. The main objective is to identify and create musical expression using sequences of DNA, which carry embedded structure and organisation. An effective model of DNA sonification was implemented through the use of a Parameter Mapping Sonification Interface that can obtain a musical rendering of the genetic material through the replication of different stages of DNA coding. In this way the composer could make compositional decisions a priori in mapping musical parameters (musification), and make use of sonification as a tool in order to successfully generate, organise and develop musical material in a compositional system based on DNA and RNA sequences. This is in contrast to a hard scientific sonification perspective, where unedited outputs are presented as a musical composition. As a result, the portfolio provides an intelligible corpus of music that integrates science, literature, cultural heritage and the social sphere in order to deliver my musical discourse. Nine compositions are presented in the portfolio, each of these explores the use of sonification and musification as a compositional tool to generate and organise musical materials.

Recent guidelines recommend oxygen saturation (SpO(2)) levels of 90%-95% for preterm neonates on supplemental oxygen but it is difficult to discern such levels with current pulse oximetry sonifications. We tested (1) whether adding levels of tremolo to a conventional log-linear pulse oximetry sonification would improve identification of SpO(2) ranges, and (2) whether adding a beacon reference tone to conventional pulse oximetry confuses listeners about the direction of change. Participants using the Tremolo (94%) or Beacon (81%) sonifications identified SpO(2) range significantly more accurately than participants using the LogLinear sonification (52%). The Beaton sonification did not confuse participants about direction of change. The Tremolo sonification may have advantages over the Beacon sonification for monitoring SpO(2) of preterm neonates, but both must be further tested with clinicians in clinically representative scenarios, and with different levels of ambient noise and distractions. Crown Copyright (C) 2016 Published by Elsevier Ltd. All rights reserved.

Att presentera information eller påverka användarens upplevelser via ljudsättning av gränssnitt är lågt prioriterat inom systemutveckling. Design av gränssnitt håller den visuella presentationen av information central därtill sammankopplar detta främst med områden som exempelvis användbarhet eller funktionell form. Syftet med denna studie har varit att undersöka hur ljud påverkar upplevelsen samt hur detta skulle kunna implementeras för att förbättra användares upplevelser av internetbaserade gränssnitt. Det vetenskapliga ramverket har sammanställts genom ett artikelunderlag vilket genererat en grundläggande kategorisering. Detta avsåg koppling till ”Estetik”, ”Sonification”, ”Att ljudsätta användardata” samt ”User experience och audio”. Arbetssättet byggde på en metodkombination där ett kvantitativt internetbaserat frågeformulär undersökte områden inom ramverkets kategorisering samt en kvalitativ ”Think-aloud” undersökning där två verksamma systemutvecklare testade en ljudsatt prototyp. Resultatet från den kvalitativa undersökningen visade hur ljudsättning initialt inte värdesatts vid interaktion med ett gränssnitt samtidigt som prototypens ljudsättning inte upplevdes störande eller negativ. Prototypen framkom som ”för” kreativt vinklat vilket återkopplar till ramverkets beskrivning gällande två estetiska huvudspår inom webbdesign. Den kvantitativa analysen framställer hur användbarhet och ordning värdesatts högre än kreativa upplevelser samt att information i gränssnitt inte sågs lämpligt att förmedla via ljud. Slutsatsen inom arbetet ligger vid att ljudsättning av gränssnitt genom ett balanserat formspråk och en bibehållen känsla av kontroll, kan och bör kopplas till användarens interaktion med gränssnittet. Detta kan trots ett viss motstånd användas för att påverka upplevelser, känslor och därtill uppfattad användbarhet inom ett system.

Sonification is the process of mapping non-musical data to sound. The field is comprised of three key areas of research: (1) psychological research in perception and cognition, (2) the development of tools, and (3) sonification design and application. The goals of this research were twofold: (1) To provide insights to the development of sonification tools within the programming environment Max for use in further sonification/interdisciplinary research, as well as (2) provide a framework for a musical sonification system. The sonification system discussed was developed to audify spectrometry data, with the purpose of better understanding how multi-purpose systems can be easily modified to suit a particular need. Since all sonification systems may become context specific to the data they audify, a system was developed in the programming language Max that is both modular and responsive to the parameterization of data to create musical outcomes. The trends and phenomena of spectral data in the field of spectroscopy are plotted musically through the system and further enhanced by processes that associate descriptors of said data with compositional idioms, rhythmically, melodically, and harmonically. This process was achieved in Max by creating a modular system that handles the importing and formatting of spectral data (or any data in an array format) to send that data to a variety of subprograms for sonification. Subprograms handle timing and duration, diatonic melody, harmony, and timbral aspects including synthesis and audio effects. These systems are accessible both at a high level for novice users, as well as within the Max environment for more nuanced modification to support further research.

Visualização é o processo genérico que utiliza representações visuais e interativas para facilitar a análise e o entendimento de informações de conjunto de dados. A maioria das ferramentas de visualização existentes atualmente utiliza exclusivamente recursos visuais para representar informações e isto tem limitado a capacidade exploratória e a apresentação de dados. Vários estudos têm demonstrado que o uso do som como recurso alternativo para representação de dados (sonificação) pode ser útil na interpretação de informações e também pode apoiar o aumento da dimensionalidade da apresentação visual. A sonificação é o objeto de estudo deste trabalho. Este trabalho implementa o novo módulo de sonificação de um sistema de exploração visual de dados, o Super Spider (Watanabe, 2007), que foi estendido com a implementação de recursos que auxiliam a exploração de dados por meio de sons. Um novo sistema, chamado Sonar 2D, também foi desenvolvimento de forma integrada ao Super Spider e apresenta uma nova técnica para sonificação de dados. Além disso, são apresentados resultados de testes com usuários aplicados para avaliar e validar os mapeamentos visuais e sonoros utilizados nos sistemas / Visualization is a generic process that uses visual and interactive representations to easy the analysis and the understanding of complex datasets. To this date, most of the visualization toolkits make use almost exclusively of visual aid to represent information, which has limited the capacity for data presentation and exploration. Many studies have shown that sound as an alternative data display tool (sonification) can be useful to support information interpretation and may also add dimensions to a visual display. Sonification is the object of study of this work. This work implements the new sonification module for a recently developed visual exploration system, the Super Spider (Watanabe, 2007). It has been extended with the implementation of functionalities in order to support data exploration through sounds. A new system, called Sonar 2D, was also developed and integrated to Super Spider, including a new technique of data sonification. In addition, this work presents results user evaluation for validation of some of the visual and sound mappings employed in both systems

Visualização é o processo genérico que utiliza representações visuais e interativas para facilitar a análise e o entendimento de informações de conjunto de dados. A maioria das ferramentas de visualização existentes atualmente utiliza exclusivamente recursos visuais para representar informações e isto tem limitado a capacidade exploratória e a apresentação de dados. Vários estudos têm demonstrado que o uso do som como recurso alternativo para representação de dados (sonificação) pode ser útil na interpretação de informações e também pode apoiar o aumento da dimensionalidade da apresentação visual. A sonificação é o objeto de estudo deste trabalho. Este trabalho implementa o novo módulo de sonificação de um sistema de exploração visual de dados, o Super Spider (Watanabe, 2007), que foi estendido com a implementação de recursos que auxiliam a exploração de dados por meio de sons. Um novo sistema, chamado Sonar 2D, também foi desenvolvimento de forma integrada ao Super Spider e apresenta uma nova técnica para sonificação de dados. Além disso, são apresentados resultados de testes com usuários aplicados para avaliar e validar os mapeamentos visuais e sonoros utilizados nos sistemas / Visualization is a generic process that uses visual and interactive representations to easy the analysis and the understanding of complex datasets. To this date, most of the visualization toolkits make use almost exclusively of visual aid to represent information, which has limited the capacity for data presentation and exploration. Many studies have shown that sound as an alternative data display tool (sonification) can be useful to support information interpretation and may also add dimensions to a visual display. Sonification is the object of study of this work. This work implements the new sonification module for a recently developed visual exploration system, the Super Spider (Watanabe, 2007). It has been extended with the implementation of functionalities in order to support data exploration through sounds. A new system, called Sonar 2D, was also developed and integrated to Super Spider, including a new technique of data sonification. In addition, this work presents results user evaluation for validation of some of the visual and sound mappings employed in both systems

Unintentional encounters between robots and humans will increase in the future and require concepts for communicating the robots’ internal states. Auditory displays can be used to convey the relevant information to people who share public spaces with social robots. Based on data gathered in a participatory design workshop with robot experts, a layer based approach for real-time generated audio feedback is introduced, where the information to be displayed is mapped to certain audio parameters. First exploratory sound designs were created and evaluated in an online study. The results show which audio parameter mappings should be examined further to display certain internal states, like e.g. mapping amplitude modulation to the robot’s speed or enhancing alarm frequencies for indicating urgent tasks. Features such as speed, urgency and large size were correctly identified in more than 50% of evaluations, while information about the robot’s interactivity or its small size were not comprehensible to the participants. / Oavsiktliga möten mellan robotar och människor kommer öka i framtiden vilket kräver koncept för att kommunicera robotarnas inre tillstånd. Ljuddisplayer kan användas för att förmedla relevant information till människor som delar offentliga utrymmen med sociala robotar. Baserat på data som samlats in i en deltagande designworkshop med robottexperter introduceras ett lagerbaserat tillvägagångssätt för realtidsgenererad ljudåterkoppling, där den information som ska visas mappas till vissa ljudparametrar. Explorativa ljuddesigns skapades och utvärderades i en online-studie. Resultaten visar vilka ljudparametrar som bör undersökas ytterligare för att visa vissa interna tillstånd, som t.ex. att mappa amplitudmodulering till robotens hastighet eller att förbättra larmfrekvenser för att indikera brådskande ärenden. Egenskaper som hastighet, brådska och stor storlek identifierades korrekt i mer än 50 % av utvärderingarna, men information om robotens interaktivitet och lilla storlek var svårbegriplig för deltagarna.