Abstract Affordance and choice: performing music in lower secondary school The purpose of this study is to elucidate affordances and meaning-making processes where students in Compulsory lower secondary education learn to play music together in music class. The data consists of a series of observed music lessons, performances and stimulated recall interviews in two 8th form classes, video recorded in the course of one term. The analysis focuses on students’ and their teacher’s musical interaction and sign making during music class. In order to explore multimodal aspects of sign making in teaching and learning, the study rests on a theoretical framework of social-semiotic multimodality and design theory of learning. Nine students, strategically selected, were observed more frequently than the rest. Excerpts of their singing and playing music on different occasions were transcribed into scores in which musical notation together with other graphic signs and written descriptions represent the events. The scores visualise mul- timodal aspects of musical interaction, which made a 'fine grained' analysis of meaning-making processes possible. Further, an analysis was made of how the students and their teacher expressed themselves about the playing and learning and how this related to their observed actions. The result reveals how the teacher’s physical and verbal communicative sign combinations and choice of repertoire conveyed several layers of mean- ing by means of instructions for playing and by references to different dis- courses and genres. During lessons the principle of recognition was present in all of the teacher's sign making but it might be expressed in different modes including expected actions that surprised, amused and helped students to link different musical parameters together. Through transmodal transla- tions of the teacher’s signs, students, linked short fragments of their parts together, and taking turns with the teacher, made longer musical lines. It was found that students’ activities and utterances indicated that a shared sense of meaning and acceptance took precedence over personal musical wishes and preferences. The study contributes to a close insight and understanding of how young people's meaning-making processes may be manifested in music 'teaching- and-learning' in heterogeneous classes, as well as of the significance of teachers’ sign-making in that process. The results of the study warrant a discussion of how musical learning is made possible and is restricted de- pending on how music teaching in schools is designed. Keywords: music teaching, musical interaction, meaning making, semiotic resources, re-design, transmodality, dialogue / <p>Disputationen äger rum på Kungl. Musikhögskolan i Stockholm men sker i samarbete med Lunds universitet.</p>

This study of James Joyce's transmodal techniques explores, first, Joyce's implementation of non-language based media into his works and, second, how digital technologies might assist in identifying and studying these implementations. The first chapter introduces the technique of re-rendering, the artistic practice of drawing out certain characteristics of one medium and, by then depicting those characteristics in a new medium, calling attention to both media and their limitations and potentials. Re-rendering can be content-based or form-based. Joyce employs content-based re-rendering when he alludes to a piece of art in another medium and form-based re-rendering when he superimposes the form of another medium onto his text. The second chapter explores Dubliners as a panoramic catalog of the various aspects involved in re-rendering media. The collection of stories, or the fragmented novel, shows synaesthetic characters, characters engaged in repetition and revision, and characters translating art across media by superimposing the forms, materials, and conventions of one medium onto another. Dubliners culminates in the use of coda, a musical structure that commonly finalizes a multi-movement work. The third chapter analyzes of A Portrait of the artist as a young man, focusing on its protagonist who exhibits synaesthetic qualities and a penchant for repeating phrases. With each repetition he also revises, a practice that foreshadows the form-based re-rendering Joyce employs in Ulysses and Finnegans Wake. The fourth chapter explores the "Sirens" episode of Ulysses. In this episode, Joyce isolates the structure of the musical medium and transfers it to a literary medium. This technique shows his advanced exploration of the effects of one artistic medium on another and exemplifies his innovative technique of re-rendering art forms. Finally, the fifth chapter explores how we might use digital technologies to visualize Joyce's techniques of re-rendering. Based on these visualizations, we might identify further connections Joyce makes across his works. / text

Dieser Dissertation liegt die Problematik des impliziten verkörperten Wissens im Erkennen und Entdecken mittels visueller Instrumente zu Grunde. Mit Entdeckung ist der Akt des allerersten Erkennens von etwas gemeint, über dessen Existenz oder Beschaffenheit dem Entdecker zuvor keine expliziten Kenntnisse zur Verfügung standen. Eine zentrale These dieser Arbeit besagt, dass dies durch den transmodalen Charakter der empirischen Begriffsbildung gesichert wird. Dieses erkenntnistheoretische Problem wird anhand des Entdeckens von emergenten Mustern urbaner Organisation ausgearbeitet, die aus der Vogelperspektive auf urbanen Echtzeitkarten erscheinen. In der Arbeit werden Trends interaktiver Kartierung aufgezeigt, bei denen unter anderem urbane Sensordaten, Daten aus der Verortung von Personen, Objekten und Information und anwendergenerierte Informationen visualisiert werden. Die Konklusion beinhaltet Ausblicke, an welchen Punkten die anhand der interaktiven Karten gewonnenen Erkenntnisse in Stadtentwicklungsprojekte und in die Entwicklung von ortssensitiven Technologien einfließen können. / This dissertation elaborates on the role of implicit embodied knowledge in recognition and discovery through the use of visual instruments. Discovery refers to the very first act of recognition of something, that''s existence or features were not explicitly known by the discovering person beforehand. According to a central thesis of this work discovery is enabled by the transmodal character of empirical concept formation. This epistemological question is elaborated based on the case of emergent patterns of urban organization that appear on urban real-time maps from the bird''s eye view. Trends of interactive mapping are shown where urban sensor-data, location data of persons, objects, and information, as well as user generated information is visualized. The conclusion contains outlooks how knowledge gained from interactive urban maps can be utilized in urban development projects and in the development of location sensitive technologies.