Mobile music applications are becoming commonplace around the world, and mobile devices are used as digital instruments everywhere. Controlling, performing, or composing music in real time with these devices encourages collaboration and interaction, as telecommunication improvements allow many people to cooperate through local networks or the Internet. In this context, the aim of this thesis is to evaluate mobile technologies that might be suitable for mobile musicians and their audiences while performing or composing. Specifically, the main goal is to explore technologies for collaborative mobile music and to obtain quantitative and qualitative data regarding these technologies and their settings, so that composers might take full advantage of the available options for mobile applications. This evaluation focuses on message exchange using Multicast, Unicast, and Cloud Services, using academic networks as the main pathway. With these services, messages are organized as packet streams, characterized by different sizes and time intervals. Evaluation also includes the development of several applications that make use of these technologies running on Android devices and web browsers. These applications were used in actual performances, serving as both evaluation tools and experimental music instruments. The results were analyzed in terms of round trip time and data loss under very different configuration scenarios, demonstrating that although some obvious impediments are unavoidable (e.g. significant delays in international settings), it is possible to choose the specific technology and achieve interesting results under most music application scenarios. I argue that although in theory Multicast appears to be the best technology to use by far, it is the most difficult to implement due to the burden of configuring every step of the network pathway. On the other hand, Cloud Services are certainly slower than direct connections, but are the most compatible and easiest technology to set up, and are definitely suitable for many collaborative music experiences. To conclude, there is a discussion of how mobile music practitioners can take advantage of these results for composition and performance by considering specific technological advantages or drawbacks that are inherent to each technology and setting. / Aplicações de Música Móvel estão se tornando populares ao redor do mundo e dispositivos móveis estão sendo utilizados como instrumentos musicais em diversos lugares. Controlar, apresentar ou compor música em tempo real com estes dispositivos estimula a colaboração e a interação, e os avanços nas telecomunicações permitem a um grande número de pessoas cooperar musicalmente através de redes locais ou da Internet. Neste contexto, o objetivo desta tese é avaliar as tecnologias móveis que podem ser úteis para músicos e público na performance ou na composição. De maneira mais específica, o objetivo principal é explorar as tecnologias para Música Móvel colaborativa e obter resultados quantitativos e qualitativos referentes a estas tecnologias e suas configurações, de modo que compositores possam usufruir de todas as vantagens das opções para aplicações móveis. Esta avaliação enfoca a troca de mensagens através de Multicast, Unicast e Serviços em Nuvem utilizando redes de computadores acadêmicas como principal caminho. Através destes serviços as mensagens foram organizadas como fluxos de pacotes caracterizados por diversos tamanhos e intervalos entre envios. A avaliação também inclui o desenvolvimento de diversas aplicações fazendo uso destas tecnologias para dispositivos Android e navegadores Web, que foram utilizados em performa música móvel, computação musical, redes de computadores, serviços de nuvens

This dissertation is comprised of three recent original compositions- Dis Un Il Im Ir, In sin fin bin din bin fin sin in, and Percussion+Guitar. Each work has a unique approach to integrating instrumental performance with humans and computers. The essay component details unique computer-performer interactions I’ve developed to overcome complications in the concert presentation of previous acousmatic and mixed media works. The three works discussed here are related in their instrumentation and compositional style. Dis Un Il Im Ir (2013), for flute, piano, and MIDI keyboard, experiments with the limit of human virtuosity and attempts to extend its affect via sound synthesis and digital samples. In sin fin bin din bin fin sin in (2104), for four computer-controlled pianos with electronic sounds, focuses on repeated melodic and harmonic patterns explored in previous works contrasted with unruly mechanical spasms. Percussion+Guitar (2015), for two computer-controlled flutes (contrary to the title), features a specially designed instrument built at Columbia University’s Computer Music Center. This composition is a duet with a structure defined by heightened rhythmic angularity and blazing fast speeds demonstrating the computer's special skills as a performer. The essay part of this dissertation includes an analysis of the pitches, rhythms, and gestures where appropriate. I provide details about the artistic uses of software and hardware for each project. I trace my artistic inspirations for composing with and for computers and robots to my experiences in acousmatic music, pop production, and hands-on music making. I describe my process of organizing contrasting sounds into form-bearing elements- an approach inspired by Pierre Schaeffer’s typomorphology of sound objects later revisited by Lasse Thoresen. The paper concludes with a brief discussion about future works.

Esse estudo examina criticamente uma série de práticas sonoras e musicais que tiram proveito das redes de informação para elaborar contextos de colaboração. Essas praticas dão lugar a um repertório de obras (composições, performances, sites, instalações entre outros), denominado durante o trabalho como Network Music. Os trabalhos podem ser localizados entre a segunda metade da década de 1990 e o final da década de 2000, no entanto uma série de antecedentes musicais são também discutidos. O repertório não se distingue por obedecer a um estilo ou linguagem musical particular, mas por fortalecer e reformular os vínculos tradicionais entre compositores, intérpretes, ouvintes através de conexões eletrônicas. O objeto de estudo é abordado de quatro perspectivas diferentes. O primeiro capítulo aborda aspectos teóricos confrontando conceitos vigentes na música do século XX com modalidades de comunicação em Internet. O imediatismo é proposto como elemento de coesão de conceitos como ao vivo e comunicação online. O segundo capítulo examina o repertório de trabalhos musicais em Internet, enfatizando aspectos incorporados da produção da Arte das Telecomunicações. São identificadas duas vertentes na produção de Network Music, segundo a acentuação de aspectos comunicacionais e composicionais. O levantamento apresentado discute estratégias e metodologias de criação musical dentro de configurações de interação remota enfatizando o tema da distância. O terceiro capítulo cobre aspectos de performance e se concentra no tema da colaboração. Conceitos, recursos e metodologias de trabalho musical com as redes digitais são sugeridos ao intérprete que pretende realizar performances com parceiros remotos através da Internet. No quarto capítulo é discutido o projeto NetConcert, realizado ao longo da pesquisa no seio do grupo Mobile da ECA/USP / This survey critically looks at a series of sound and musical practices that take advantage of information networks to create collaborative contexts. These practices give rise to a repertoire of works (compositions, performances, websites, installations among others) called Network Music. These works can be located between the late 1990s and the late 2000s; however, a number of musical antecedents are also discussed. The repertoire is distinguished by not following a particular style or musical language, but by strengthening and reshaping the traditional links among composers, performers and listeners through electronic connections. Network Music practices are covered in four different parts. The first chapter deals with theoretical aspects confronting current concepts in twentieth-century music with modes of communication on the Internet. Immediacy is proposed as a cohesive element that gathers concepts such as live and online. The second chapter part examines the repertoire of musical works on the Internet, highlighting some aspects incorporated from Art-Telecom productions. Two strands are identified in producing Network Music, according to the emphasis on communication or compositional aspects. The text discusses strategies and methods for music creation within remote interaction settings enphasizing the subject of distance. The third chapter covers musical performance aspects and focuses on the topic of collaboration. Concepts, resources and methodologies are suggested to the musician who intends to accomplish performances with remote partners via the Internet. The final chapter discusses the NetConcert project carried out during the research period as a member of the ECA/USP Mobile group.

Orientador: Florivaldo Menezes Filho / Banca: Maurício Funcia de Bonis / Banca: Jônatas Manzolli / Banca: Fernando Henrique de Oliveira Iazzetta / Banca: Marcus Alessi Bittencourt / Resumo: A música em tempo real tem se tornado um gênero da música eletroacústica cada vez mais explorado pelos compositores da atualidade. As formas de interação entre a dimensão instrumental e a eletroacústica são um dos principais aspectos investigados por todos que se dedicam ao gênero. Na relação de interação entre instrumentistas e a dimensão eletroacústica, devem-se considerar quais são as informações captadas no "mundo exterior", de que modo tais informação serão captadas e, de que forma serão utilizadas para interferir na dimensão eletroacústica. O fluxo de informações que circula entre as dimensões instrumentais e eletroacústicas tem sido utilizado a fim de propiciar a interação entre diversos aspectos do som como o timbre, o tempo e a dinâmica, por exemplo. Porém, o dado harmônico parece ser o mais complexo de manipular de forma interativa. Nesse sentido, esta investigação buscou uma forma de manipular o dado harmônico em meio a música eletroacústica em tempo real, considerando que as redes harmônicas de Pousseur poderiam ser uma instigante ferramenta composicional para tal finalidade. Para tal, apresentamos o processo de implementação das redes harmônicas de Pousseur como algoritmo computacional realizado na linguagem de programação para áudio digital SuperCollider, suportado por uma revisão teórica do assunto. Buscando um interação que extraísse ao máximo as potencialidades harmônico-relacionais das redes harmônicas de Pousseur com as informações captadas da dimensão instrumental, dedicamo-nos à discussão sobre os conceitos de consonância e dissonância cognitiva, e de como os cálculos de rugosidade de Helmholtz e Plomp & Levelt poderiam ser utilizados como uma ferramenta de classificação dos resultados harmônicos das redes de Pousseur, quanto ao seu nível de tensão harmônica. Por fim, apresentamos os resultados desse processo em exemplo... / Résumé: La musique en temps réel est devenu un genre de la musique électroacoustique le plus exploré par les compositeurs d'aujourd'hui. Les modes de interations entre la partie électronique e les instruments sont l'un des principaux aspects recherchés par tout ceux qui s'occupent du genre. Dans la relation d'interation entre l'instrumentistes e la partir electronique, il faut considérés quels sont les informations captés dans "le monde exterior", de quelle façon ces informations seront captés e, de quelle manière seront utilisés pour interférer dans la partie électronique. Le flux d'informations qui circule entre les parties instrumentales et électroniques est utilisé afin de fournir l'interation entre nombreux aspects du son como le timbre, le temps, et les nuances, par exemple. Cependant, l'aspect harmonique semble être le plus complexe pour manipuler de façon interative. En ce sens, cette recherche a trouvé une manière de manipuler le donné harmonique au milieu de la musique électronique en temps réel, en considerant que les reseux harmoniques de Pousseur pourrait étre une intéressant outil compositionel a telle fin. Pour cela, nous on prèsente le processus de la mise en place des réseaux harmoniques de Pousseur comme algorithme informatique realisé dans le language de programmation audio numérique SuperCollider, sutenu par une revision thèorique du sujet. En cherchant une interaction qui extrayait au maximun les potentialités harmoniques des réseaux harmoniques de Pousseur avec les informations captés de la partie instrumentale, on s'occupe a la discussion sur le concepts de consonance et dissonance cognitive e de comment les calcules de rugosité de Helmholtz et Plomp & Levelt pourraient être utilisé comme un outil de classification des resultats harmoniques des réseaux de Pousseur, quant à son niveau de tension harmonique. Bref, on present ... / Doutor

Orientador: Florivaldo Menezes Filho / Banca: Achille Guido Picchi / Banca: Helen Priscila Gallo Dias / Banca: Paulo Roberto Ferraz von Zuben / Banca: Marcos Fernandes Pupo Nogueira / Resumo: O presente trabalho aborda os aspectos cognitivos e os fundamentos composicionais da música eletroacústica para o audiovisual segundo Michel Chion, objetivando, assim, a realização de uma obra musical autoral de acordo com os princípios encontrados. Para tanto, foi realizada uma revisão bibliográfica crítica de sua obra, de modo a extrair ferramentas para a análise e para a composição dessa categoria de música. Com essas ferramentas, e sob o ponto de vista da interação do som com a imagem, foram analisadas obras "áudio-visuais" do próprio Michel Chion e a obra autoral na qual culminou este trabalho. De acordo com nossos estudos, o escopo desta pesquisa é algo inédito na produção acadêmica brasileira. / Abstract: This research approaches the cognitive aspects and the compositional basis of the electroacoustic music to the audiovisual, according to Michel Chion. With this, it was aimed to do an authorial musical composition supported on the researched basis. To do that, a critical bibliographical research of Chion's works was made in order to extract tools to the analysis and to the composition of this category of music. With this tools and focusing on the interaction of sound with image, it was analyzed selected audio-visual works by Michel Chion and the authorial one in which this work culminate. As far as we know, the scope of this research is something still undone in the Brazilian scientific academy. / Mestre

Mobile music applications are becoming commonplace around the world, and mobile devices are used as digital instruments everywhere. Controlling, performing, or composing music in real time with these devices encourages collaboration and interaction, as telecommunication improvements allow many people to cooperate through local networks or the Internet. In this context, the aim of this thesis is to evaluate mobile technologies that might be suitable for mobile musicians and their audiences while performing or composing. Specifically, the main goal is to explore technologies for collaborative mobile music and to obtain quantitative and qualitative data regarding these technologies and their settings, so that composers might take full advantage of the available options for mobile applications. This evaluation focuses on message exchange using Multicast, Unicast, and Cloud Services, using academic networks as the main pathway. With these services, messages are organized as packet streams, characterized by different sizes and time intervals. Evaluation also includes the development of several applications that make use of these technologies running on Android devices and web browsers. These applications were used in actual performances, serving as both evaluation tools and experimental music instruments. The results were analyzed in terms of round trip time and data loss under very different configuration scenarios, demonstrating that although some obvious impediments are unavoidable (e.g. significant delays in international settings), it is possible to choose the specific technology and achieve interesting results under most music application scenarios. I argue that although in theory Multicast appears to be the best technology to use by far, it is the most difficult to implement due to the burden of configuring every step of the network pathway. On the other hand, Cloud Services are certainly slower than direct connections, but are the most compatible and easiest technology to set up, and are definitely suitable for many collaborative music experiences. To conclude, there is a discussion of how mobile music practitioners can take advantage of these results for composition and performance by considering specific technological advantages or drawbacks that are inherent to each technology and setting. / Aplicações de Música Móvel estão se tornando populares ao redor do mundo e dispositivos móveis estão sendo utilizados como instrumentos musicais em diversos lugares. Controlar, apresentar ou compor música em tempo real com estes dispositivos estimula a colaboração e a interação, e os avanços nas telecomunicações permitem a um grande número de pessoas cooperar musicalmente através de redes locais ou da Internet. Neste contexto, o objetivo desta tese é avaliar as tecnologias móveis que podem ser úteis para músicos e público na performance ou na composição. De maneira mais específica, o objetivo principal é explorar as tecnologias para Música Móvel colaborativa e obter resultados quantitativos e qualitativos referentes a estas tecnologias e suas configurações, de modo que compositores possam usufruir de todas as vantagens das opções para aplicações móveis. Esta avaliação enfoca a troca de mensagens através de Multicast, Unicast e Serviços em Nuvem utilizando redes de computadores acadêmicas como principal caminho. Através destes serviços as mensagens foram organizadas como fluxos de pacotes caracterizados por diversos tamanhos e intervalos entre envios. A avaliação também inclui o desenvolvimento de diversas aplicações fazendo uso destas tecnologias para dispositivos Android e navegadores Web, que foram utilizados em performances reais, servindo tanto como ferramentas de avaliação quanto como instrumentos para música experimental. Os dados são analisados com relação ao tempo de ida-e-volta e perda de pacotes em diferentes configurações de cenário, demonstrando que apesar de alguns impedimentos óbvios serem incontornáveis (como o longo atraso em configurações internacionais, por exemplo), é possível escolher tecnologias adequadamente e alcançar resultados interessantes em muitos cenários de aplicações musicais. Argumento que apesar de em teoria o Multicast se apresentar de longe como a melhor tecnologia para estes cenários, ele é o mais difícil de ser implementado devido à grande complexidade na configuração de cada parte da rede para seu uso. Por outro lado, Serviços em Nuvem são certamente mais lentos, porém se apresentam como os mais compatíveis e fáceis de configurar, sendo definitivamente os mais adequados para muitas experiências de música colaborativa. Em conclusão, discuto como profissionais de Música Móvel podem se aproveitar dos resultados apresentados, considerando as vantagens e desvantagens tecnológicas específicas que são inerentes a cada tecnologia ou configuração quando utilizada em performances e composições musicais.

Creating and performing electroacoustic music utilising interactive systems is now a well-established paradigm. Sensing technology can map gestures to sound generating processes, capturing the nuances of a gesture and sculpting the sound accordingly. Interactive installations enable audiences to become part of the process of realising a creative work. Yet many of the models and frameworks for interactive systems, specifically music focused systems, are strongly oriented around a MIDI event based framework, with little or no provision to accommodate the potentials of more dynamic approaches to creative practice. This research seeks to address the lack of appropriate models currently available and come to a more contemporary understanding of interactive music making. My approach follows two trajectories. Firstly, I undertake a comprehensive review of interactive creative works, encompassing the live electronic music of the 1950s and 1960s, interactive installation, digital musical instruments and computer networked ensembles. Secondly, I explore and draw together proposed definitions, models and classifications of interactive systems, clarifying concepts such as mapping, processing, gesture and response. The concepts are tested in a folio of creative works that form the creative research. VIDEO AND AUDIO FILES CAN BE ACCESSED AT UWS LIBRARY / Doctor of Philosophy (PhD)

Thesis (M.M.)--University of North Texas, 2003. / Score of Tele (p. 50-54); in part graphic notation. Includes bibliographical references (p. 45-46).

Amongst the modern day abundance of audio-visual media, where sounds represent everything from the swooping of virtual cameras through 3D spaces to the pressing of buttons and receiving of emails, and conversely where VJs routinely accompany live musical performance with an increasingly sophisticated language of abstract computer animation, the notion of music as a necessarily exclusively aural medium seems somewhat out of place. Psychological theories relating to the cognition of sound, in particular physical schema, accounting for the ubiquity of vertical plane pitch metaphors in most musical cultures, provide evidence of a deep-rooted spatially informed understanding of sound thus providing a common ground for both sound and vision in music. Furthermore, Western Classical composition is rife with examples of visually conceived forms from Bach’s Crab Canon (1747) to Xenakis’ architecturally inspired Metastasis (1954). However, in practice the gap between the listener’s auditory experience and the composer’s visual concept is often insurmountable. Rising to Schaeffer’s call for “Primacy to the ear!” (Schaeffer, 1967, pp. 28-30), acousmatic composers have sought to derive music exclusively from experientially verifiable criteria. However, in its pervasiveness of other musical genres, no doubt aided by technologically and commercially driven domination of the pre-recorded over the live listening experience in the latter half of the twentieth century, such an approach has lead to the neglect of visual aspects in the live performance of much art-music. This research aims to begin to redress this balance through the composition of, largely computer realised, audio-visual works whose conception arises not from a superimposition of one medium upon another, but through the very relations between the media themselves. Utilising modern computers’ ability to synchronise physical and virtual visual events with synthesised sound in real time not only affords composers an invaluable tool for enhancing listener’s perception of formal structures but also implies causal relationships between the sonic and the visual which can provide a base of intuitive understanding on which more complex formal ideas can be built.

This thesis presents a method of algorithmic composition in which the music is seen as motion through a multidimensional musical space. An analogy is drawn between physical space and musical space, each direction of the physical space corresponding to a musical parameter. A computer program was developed using the MAX programming environment to simulate the goaldirected motion of a mobile robot through an environment containing obstacles. The potential field method of mobile robot path planning was used. The program maps the location of the robot to musical parameters in the musical space. Based on the instantaneous values of the musical parameters, the program generates melodic material and transmits the resulting MIDI data to a synthesizer. For this research, the program was limited to three spatial dimensions and one obstacle. The program successfully created simple compositions consisting of large musical gestures. A model composition was created. Suggestions were made for further development and more elaborate applications of the method. / School of Music