Learners' affective states correlate with learning outcomes. A key aspect of instructional design is the choice of modalities by which learners interact with instructional content. The existing literature focuses on quantifying learning outcomes without quantifying learners' affective states during instructional activities. An investigation of how learners feel during instructional activities will inform the instructional systems design methodology of a method for quantifying the effects of individually available modalities on learners' affect. The objective of this dissertation is to investigate the relationship between affective states and learning modalities of instructional computing. During an instructional activity, learners' enjoyment, excitement, and motivation are measured before and after a computing activity offered in three distinct modalities. The modalities concentrate on visual and musical computing for the practice of computational thinking. An affective model for the practice of computational thinking through musical expression was developed and validated. This dissertation begins with a literature review of relevant theories on embodied cognition, learning, and affective states. It continues with designing and fabricating a prototype instructional apparatus and its virtual simulation as a web service, both for the practice of computational thinking through musical expression, and concludes with a study investigating participants' affective states before and after four distinct online computing activities. This dissertation builds on and contributes to extant literature by validating an affective model for computational thinking practice through self-expression. It also proposes a nomological network for the construct of computational thinking for future exploration of the construct, and develops a method for the assessment of instructional activities based on predefined levels of skill and knowledge. / Doctor of Philosophy / This dissertation investigates the role of learners' affect during instructional activities of visual and musical computing. More specifically, learners' enjoyment, excitement, and motivation are measured before and after a computing activity offered in four distinct ways. The computing activities are based on a prototype instructional apparatus, which was designed and fabricated for the practice of computational thinking. A study was performed using a virtual simulation accessible via internet browser. The study suggests that maintaining enjoyment during instructional activities is a more direct path to academic motivation than excitement.

My studies consider the application of digital game theory to the instruction of writing in the first year composition classroom. I frame my argument through dialectic of representation and simulation and the cultural shift now in progress from the latter to the former. I first address the history of multimodal composition in the writing classroom, specifically noting the movement from analysis to design. In the third chapter, I examine several primary tenants of video game theory in relation to traditional academic writing, such as the concept of authorship and the importance of a rule system. My final chapter combines the multimodal and digital game theory to create what I term "digital game composition pedagogy." The last chapter offers new ways to discuss writing and composing through the theories of video games, and shows how video games extend the theories associated with writing to discussions that coincide with an interest that many of our students have outside of the classroom. / Master of Arts

Multimodal interfaces are becoming increasingly important with the advent of mobile devices, accessibility considerations, and novel software technologies that combine diverse interaction media. This thesis investigates systems support for web browsing in a multimodal interface. Specifically, we outline the design and implementation of a software framework that integrates hyperlink and voice interaction. This enables the user to engage in out-of-turn interactions to personalize access at an information site. For the developer, the framework enables the creation of sites that adapt to the needs of users, yet permits fine-grained control over what interactions to support. Design methodology, implementation details, and two case studies are presented. / Master of Science

Border Perversion: Physical, Bodily and Conceptual Borders and the Multimodal Essay Film is an interdisciplinary and multimodal media dissertation based on extensive research, interviews and field notes. This practice-led research investigates alternative border imaginaries through two multimodal essay films Blazing Worlds and Common Work, and a written thesis that examines the shifting nature of borders — conceptual, political and lived experiences — in the Arctic archipelago of Svalbard. It developed from the question as to why, in hyper globalized world, are so many borders being built? There were fewer than five border walls globally post World War II, and just 12 border walls at the end of the Cold War. Today, 74 border walls exist across the globe, most of them erected in the past two decades, with at least 16 more planned or in construction at the time of writing. Within all power relations, there is the potential for resistance, especially through changing the meaning and value of terms. In this dissertation, I reactivate the concept of perversion as an erring or straying as a source of subversive and creative potential, to unveil alternative border imaginaries within the distinctive legal terrain of the Svalbard archipelago. Through this exploration, I analyze and contribute to unconventional perspectives of borders. This involves not only navigating the complex legal intricacies of the Svalbard archipelago, but also pushing artistic boundaries to transcend the genre of the essay film. By appropriating perversion, I challenge existing conceptual frameworks but also pioneer an innovative approach to understanding artistic expression, proposing the emergence of a new type of essay film, a multimodal essay film, which continues the essay film’s trajectory of subverting dominant artistic structures. The multimodal essay film provides room to explore the complex issues of borders by blurring the boundaries of materialities and methods. I assert that this transgression reanimates the subversive and augments its heterogeneous form through the introduction of objects. I undertook field research in Svalbard as the Svalbard Treaty provides a compelling case study to illustrate alternative border imaginaries which transcends the traditional domestic-international divide. With its unique governance model, and diverse transnational players, the fluid coexistence among actors in Svalbard challenges the dichotomy between “them” and “us”, revealing a more intricate interplay of belonging. My exploration of how identity and belonging operate in Svalbard, in a context detached from conventional life markers, offers a fresh perspective on the evolving nature of borders. In parallel, this thesis has two multimodal essay film realizations, Blazing Worlds and Common Work, both of which were exhibited in Ireland, and a collection of interviews with artists and scholars exploring multimodal essay film. In addition, a symposium titled ‘Encounters with Boundaries’ was hosted by the Slought in Philadelphia in 2022 which explored issues raised in this dissertation. The central focus of this research is exploring the beyond of the essay film and of conventional border frameworks, fostering space for diverse narratives, practices, and imaginings. Through this exploration, it contributes to the decolonization of knowledge by transcending genre boundaries. / Documentary Arts

Den här uppsatsen undersökte hur medielogiken uttrycks i Rädda Barnens och Sverige för UNHCR:s videomaterial under flyktingkrisen september 2015. Då majoriteten av den medialiseringsrelaterade forskningen i Sverige har intresserat sig för partiledardebatter och politisk kommunikation finns det en kunskapslucka kring hur medielogiken formar andra sfärer i samhället. Denna studie avsåg att genom semiotisk analys och mulitmodal analys undersöka videomaterial i dessa två ideella organisationer, för att identifiera mediernas berättartekniker i dem. Sammanlagt analyserades fyra videoklipp i två ideella organisationers Facebook-sidor under september 2015 utifrån teorin om semiotik och medielogik. Två tydliga teman i videoklippen framträdde ur resultatet. Dessa benämnde vi som Flyktingkrisen som empati och Flyktingkrisen som verklighet. Ur dessa framkom fyra underteman. Dessa benämnde vi som dramatisering, dokumentering, reklamformat och nyhetsformat. Studiens resultat visade även att medielogiken personifiering förekommer starkt i samtliga av våra studieobjekt. Utifrån detta resultat kunde vi dra slutsatser kring genom vilka stereotyper personifieringen framkom i.   Vår studie bidrar därmed till forskningsfältet med kunskap om stereotyper av flyktingar. I tidigare forskning av Ylva Brune (1998) urskiljs två sorters stereotyper av flyktingar: offer eller hot. Vidare menar Urban Ericsson (2001) att stereotypen den duktige flyktingen tenderar att förekomma i media endast på individnivå. I vårt material fann vi att en flykting gestaltades annorlunda än de stereotyper vi fann i vår tidigare forskning. Vi valde att kalla den här kategorin flyktingen som målmedveten då denne är fast besluten att ta sig fram trots omständigheterna. Vi fann även en icke tidigare dokumenterad framställning av flyktingar som likartad publiken när det gäller välfärdsbakgrund. / The aim of this paper was to examine how media logic’s are expressed in Save the children’s and Sweden for UNHCR’s video material during the migrant crisis. Since the majority of the mediatization research in the Swedish context has focused on the party leaders and political communication, there is a lack of awareness regarding how media logic shapes other spheres in the community. This study’s objective was to examine video material through semiotic and multimodal analysis, to identify media logics. In total four videos from two nonprofit organizations, that were published in September 2015, were analyzed based on the understanding of media logics.  Two distinctive themes appeared in the results. These were titled migrant crisis as empathy and migrant crisis as reality.  From these, four subthemes appeared. These were titled dramatization, documentation, advertising formats and news format. The result shows that personalization occurs strongly in all of our study.  Our study contributes to the research field with knowledge about stereotypes of refugees. We found a new kind of stereotype that we have chosen to call the determined refugee. The choice of name for this category is based on our interpretation of a refugee as determined to survive. In addition to the study’s contribution of how the representation of refugees among nonprofit organizations now take a new form, we also found a not previously documented representation of refugees like the crowd when it comes to the welfare background.  Our study contributes to knowledge about how mediatization is expressed in strategic communication.

Med det socialkonstruktionistiska antagandet att verkligheten skapas genom språkanvändning, undersökte denna studie hur sex konstrueras diskursivt i vloggar på Youtube. Materialet som analyserades var fyra stycken vloggar av Youtube-profilerna Therese Lindgren, Tova Helgesson, Lakidoris och Aina & Thobias. Syftet var att blottlägga underliggande sexuella normer och hierarkier för att skapa en klarare bild av diskursen kring sex i vloggar. För att uppnå detta syfte applicerades den kritiskt granskande metoden multimodal diskursanalys med tillhörande analysbegrepp (MCDA) i kombination med Rubins (2006) modeller över sexuella normer och hierarkier på materialet. Studiens teoretiska ramverk utgjordes även av begreppen Infotainment och Edutainment som definierar medieinnehåll som befinner sig i gränslandet mellan information, utbildning och underhållning.     Analysen resulterade i tre teman som tillsammans bildade den övergripande diskursen. Det första temat var att vlogg-profilerna intog rollen som sexualupplysare. Med en ofta humoristisk ansats innehöll språket uppmaningar som bland annat handlade om sexuell integritet. Främst låg fokus på positiva aspekter av sex, snarare än negativa. Det andra temat var att vlogg-profilerna konstruerade bilden av sex utifrån ett subjektivt perspektiv där egna åsikter presenterades som objektiva sanningar. Det tredje temat var att det i vloggarnas till synes normbrytande diskurs förekom dolda sexuella normer och hierarkier. Det kan anses problematiskt att vloggarna utbildar och informerar sin publik när de har en humoristisk ansats, samtidigt som de utgår från ett subjektivt perspektiv och reproducerar sexuella normer och hierarkier. Detta eftersom den unga publiken, som ofta saknar egna sexuella referensramar, kan påverkas av de konstruktioner som de exponeras för. Vidare diskuteras fördelar och nackdelar med den undersökta sexdiskursen, vem som bär ansvar för den konstruktion av sex som unga människor exponeras för och hur normer utvecklas i takt med samhällsförändringar.

[pt] Esta dissertação propõe um modelo de gestão da cadeia de transporte multimodal. O modelo de gestão oferece uma solução para a coordenação e integração da cadeia de transporte, sendo aplicado no estudo de caso referente à empresa Transportes ABC. A empresa em questão estuda a possibilidade de atuar como Operador de Transporte Multimodal - OTM em uma operação visando o escoamento de etanol. O modelo proposto foi construído a partir dos fatores críticos de sucesso. Os fatores foram identificados a partir das características extraídas dos trabalhos sobre transporte multimodal, logística integrada e gestão da cadeia de suprimentos e dos eventos de risco que foram baseados nos mesmos trabalhos e no estudo de caso. É possível observar na estratégia de gestão de risco o foco no desempenho de forma a minimizar os riscos recorrentes da operação contribuindo para reduzir também os riscos de ruptura da operação. Alguns fatores críticos de sucesso devem ser atendidos diretamente pelo OTM, enquanto que outros devem ser atendidos pelos elos operacionais, com a devida coordenação do OTM. Na aplicação do modelo ao estudo de caso, foi confirmada a necessidade de coordenação e integração de toda cadeia pelo OTM no tocante ao caso estudado. Algumas lacunas foram identificadas no sentido sobre o que a empresa visualiza como operações integradas de transporte e como efetivamente deve atuar como OTM na cadeia de transporte multimodal. / [en] This thesis proposes a management model of multimodal transport chain. The management model offers a solution to the coordination and integration of the transport chain, being applied in the case study regarding the fictitious company Transportes ABC. The company in question studies the possibility of acting as Multimodal Transport Operator - OTM in an operation aiming the flow of ethanol. The proposed model was constructed based on the critical success factors. The factors were identified from the extracted features of the work on multimodal transport, integrated logistics and supply chain management and risk events that were based on the same work, and in the case study. It is possible to observe in the risk management strategy the focus on performance in order to minimize risks of recurring operation also contribute to reduce the risk of rupture of the operation. Some critical success factors must be met directly by OTM, while others must be met by operational links with the due coordination of the OTM. In applying the model to the case study, it was confirmed the need for coordination and integration of the entire chain by OTM regarding the case studied. Some gaps were identified in the sense of what the company sees as integrated transport operations and how to effectively must act as OTM in the multimodal transport chain.

Gustav Vasa-föreningen planerar att bygga en utställning för att främja kulturlivet och öka lärandet kring Gustav Vasas ledning på 1500-talet. Förhoppningen är att genom utställningen kunna agera som en förlängd arm till skolorna i Strängnäs kommun i form av studiebesök. I utställningen vill föreningen informera om Gustav Vasas utnämning till kung den 6 juni 1523 på ett intresseväckande och informativt sätt, för att kunna nå ut till en yngre målgrupp, lågstadieelever. Genom ett samarbete med föreningen har detta examensarbete undersökt hur sinnen som modaliteter kan tillämpas i en utställningsmiljö i lärande syfte. I rapporten har Selanders teorier om multimodalt lärande tillsammans med McKenna-cress & Kaminens och Velvets riktlinjer kring utställningsmiljöer tillämpats. Teorierna har tillsammans med en etnografisk undersökning i form av en observation lagt grund för det designförslag som fastställts. Designförslaget redogör för hur utnämnandet av Gustav Vasa som kung kan kommuniceras i utställningsmiljö, för att bidra till lärande med hjälp av sinnen som modaliteter. / The Gustav Vasa Association plans to build an exhibition to promote cultural life and increase learning about Gustav Vasa's leadership in the 16th century. The ambition is that through the exhibition will act as an extended arm for the schools in Strängnäs municipality in the form of study visits. In the exhibition, the association wants to inform about Gustav Vasa's coronation as king on June 6, 1523 in an interesting and informative way, in order to reach a younger target group in the form of primary school pupils. Through a collaboration with the association, this degree project has examined how the senses as modalities can be applied in an exhibition environment for learning purposes. In the report, Selander's theories on multimodal learning together with McKenna-cress & Kaminens and Velvet's guidelines on exhibition environments have been applied. Together with an ethnographic survey in the form of an observation, the theories have laid the foundation for the design proposal that has been established. The proposal describes how the appointment of Gustav Vasa as king can be communicated in an exhibition environment, in order to contribute to learning with the help of the senses as modalities.

Submitted by admin tede (tede@pucgoias.edu.br) on 2016-09-13T19:39:28Z No. of bitstreams: 1 TÉRCIO SATHLER GARCIA.pdf: 3076929 bytes, checksum: 6f00fac125d251710359902581d98128 (MD5) / Made available in DSpace on 2016-09-13T19:39:29Z (GMT). No. of bitstreams: 1 TÉRCIO SATHLER GARCIA.pdf: 3076929 bytes, checksum: 6f00fac125d251710359902581d98128 (MD5) Previous issue date: 2015-09-17 / This study aimed to present a settlement proposal PLMG (Multimodal Logistics Platform of Goias), considering the State of Goias production chains contribution in the regional economy. There was the use of economic and geographical data of the State, mainly raised in governmental agencies, which were evaluated to identify the relevance of productive chains in GDP in the State of Goias. Through studies and assumptions, we could map the grip and absorption of production chains economic activities in PLMG. In order to propose a demand with potential for absorption of PLMG, each chain was considered according to their economic activities, given the classification of the NCEA. After evaluating economic activities and relate them to the PLMG services, the influences and geographical handicaps were deemed, constituting a new reality in the participation of platform settlement. As a result of this work, a proposal for the PLMG settlement was presented, but not sticking to the platform deployment process in its layout details or storage mode. In conclusion, it was found that the chains that had higher grip with PLMG are the chains of trade, agriculture and processing industry. Individual absorption potential along with representation in Goias GDP was presented, thus justifying the proposed settlement. / Esta pesquisa teve como objetivo apresentar uma proposta de povoamento da PLMG (Plataforma Logística Multimodal de Goiás), considerando a contribuição das cadeias produtivas do Estado de Goiás na economia regional. Fez-se a utilização de dados econômicos e geográficos do Estado, levantados principalmente nos órgãos governamentais, os quais foram avaliados para identificar a relevância das cadeias produtivas na formação do PIB no Estado de Goiás. Por meio de estudos e pressupostos, pôde-se mapear a aderência e a absorção das atividades econômicas das cadeias produtivas na PLMG. Visando propor uma demanda com potencial de absorção da PLMG, cada cadeia foi ponderada de acordo com suas atividades econômicas, considerando a classificação do CNAE. Depois de avaliar as atividades econômicas e relacioná-las com os serviços da PLMG, julgou-se as influências e limitações geográficas, constituindo uma nova realidade de participação no povoamento da plataforma. Como resultado do trabalho foi apresentada uma proposta para o povoamento da PLMG, porém não se atendo ao processo de implantação da plataforma no detalhamento de seu layout ou modo de armazenagem. Como conclusões, constatou-se que as cadeias que apresentaram maior aderência com a PLMG são as do comércio, agropecuária e indústria da transformação. Os potenciais individuais de absorção juntamente com a representatividade no PIB Goiano foram apresentados justificando o povoamento proposto.

Les ports maritimes se confrontent à des exigences rigoureuses imposées par l'évolution de la taille de la flotte mondiale des porte-conteneurs et des zones de stockage qui arrivent à des niveaux de saturation élevés. Pour répondre à ces défis, plusieurs ports ont décidé de créer des terminaux multimodaux qui jouent le rôle de méga-hubs pour les terminaux maritimes, en vue de libérer les zones de stockage de ces terminaux, de développer la part du transport massifié de conteneurs et de réduire les émissions des gaz à effet de serre en utilisant des modes alternatifs à la route. Néanmoins, la gestion de ces nouveaux schémas logistiques est laborieuse. Cela s’explique par plusieurs facteurs, entre autres, la nature dynamique et distribuée de ces systèmes, la diversité des opérations et le manque des informations nécessaires au contrôle de flux. La finalité de cette thèse est de développer des approches capables de répondre aux besoins des opérateurs portuaires dans un terminal multimodal, avec prise en compte des différentes sources d’incertitudes. Deux problèmes d'optimisation sont principalement considérés dans cette thèse, à savoir : l'optimisation de tournées de navettes ferroviaires (The Rail Shuttle Routing Problem) et l'ordonnancement de grues de quai (The Quay Crane Scheduling Problem). En vue d'aborder la complexité et l’aspect incertain de ces problèmes, nous proposerons des modélisations mathématiques, ainsi que des approches de résolution basées sur l’optimisation par colonies de fourmis, l’optimisation robuste et le couplage Simulation-Optimisation. Les différents tests numériques effectués ont prouvé l’efficacité des algorithmes proposés et leur robustesse. / Today, seaports face increasingly stringent requirements imposed by the considerable growth of goods transited by sea. Indeed, the organization of the port sector has evolved rapidly and has caused several negative impacts, including pollution and congestion of terminals, which constitute today the major concerns of port operators. To address those challenges, several ports have decided to build multimodal terminals that act as mega-hubs for maritime terminals, in order to free the storage areas on the maritime terminals, to promote the use of consolidated container modes of transfer and to reduce greenhouse gas emissions by using alternative modes to the road. Nevertheless, the management of these new logistic systems is laborious. This is due to several factors, including the dynamic and distributed nature of these systems, the variety of operations, and the lack of information needed to control flow. The aim of this thesis is to develop approaches capable of meeting the needs of port operators in a multimodal terminal, taking into account the different sources of uncertainty. Two optimization problems are mainly considered in this thesis, namely : the Rail Shuttle Routing Problem(RSRP) and the Quay Crane Scheduling Problem(QCSP). To address the complexity and uncertainties of these problems, we propose new mathematical models, as well as some heuristics approaches based on ant colony optimization, robust optimization and Simulation-Optimization. The various numerical tests carried out proved the effectiveness and the robustness of the proposed algorithms.