Désigner un objet à l’attention d’un interlocuteur est l’un des processus fondamentaux de la communication langagière. Ce processus est généralement réalisé à travers l’usage combiné de productions vocales et manuelles. Le but de ce travail est de comprendre et de caractériser les interactions entre la parole et le geste manuel dans des tâches de deixis spatiale, afin de déterminerde quelle façon l’information communicative est portée par chacun de ces deux systèmes,et de tester les principaux modèles de traitement du geste et de la parole.La première partie de l’étude concerne la production du pointage vocal et manuel. L’originalité de ce travail consiste à rechercher des paramètres d’encodage de la distance dans les propriétés acoustiques, articulatoires et cinématiques du pointage multimodal, et à montrer que ces différentes caractéristiques sont corrélées les unes aux autres, et sous-tendues par un même comportement moteur de base : désigner un objet distant implique de produire des gestes plus larges, qu’ils soient vocaux ou manuels. Ce patron moteur peut alors être rapporté à l’encodage phonologique de la distance dans les langues du monde. Le paradigme expérimental utilisé dans cette étude contraste des pointages bimodaux vs unimodaux vocaux vs unimodaux manuels, et la comparaison de ces différentes conditions révèle par ailleurs une coopération bi directionnelle entre les modalités vocales et manuelles, qui se répartissent la charge informative lorsqu’elles sont utilisées ensemble.La deuxième partie de l’étude explore le développement du pointage multimodal. Les propriétés du pointage multimodal sont analysées chez des enfants de 6 à 12 ans, dans une tâche expérimentale comparable à celle des adultes. Cette deuxième expérience atteste d’un développement progressif du couplage geste/parole pour la deixis spatiale. Elle révèle que la distance est encodée préférentiellement dans les gestes manuels des enfants, par rapport à leurs gestes vocaux(surtout chez les jeunes enfants). Elle montre également que l’usage coopératif des gestes manuels et de la parole est déjà à l’oeuvre chez les enfants, avec cependant plus d’influence du geste sur la parole que le patron inverse.Le troisième volet de ce travail considère les interactions sensorimotrices dans la perception de la deixis spatiale. Une étude expérimentale basée sur un principe d’amorçage intermodal montre que le geste manuel joue un rôle dans le mécanisme de perception/production des unités sémantiques du langage. Ces données sont mises en parallèle avec les études sur la naturesensorimotrice des représentations dans le traitement des unités sonores du langage.L’ensemble de ces résultats plaide pour une représentation fortement intégrée des gestes manuels et de la parole dans le cerveau langagier humain, et ce même à un stade relativement précoce du développement. Ils montrent également que l’encodage de la distance est un indice robuste,présent dans tous les aspects du pointage multimodal. / Designating an object for the benefit of another person is one of the most basic processes inlinguistic communication. It is most of the time performed through the combined use of vocaland manual productions. The goal of this work is to understand and characterize the interactionsbetween speech and manual gesture during pointing tasks, in order to determine howmuch linguistic information is carried by each of these two systems, and eventually to test themain models of speech and gesture production.The first part of the study is about the production of vocal and manual pointing. The originalaspect of this work is to look for distance encoding parameters in the lexical, acoustic,articulatory and kinematic properties of multimodal pointing, and to show that these differentcharacteristics can be related with each other, and underlain by a similar basic motor behaviour: designating a distant object induces larger gestures, be they vocal or manual. This motorpattern can be related with the phonological pattern that is used for distance encoding in theworld’s languages. The experimental design that is used in this study contrasts bimodal vs. vocalmonomodal vs. monomodal manual pointings, and a comparison between these conditionsreveals that the vocal and manual modalities act in bidirectional cooperation for deixis, sharingthe informational load when used together.The second part of the study explores the development of multimodal pointing. The propertiesof multimodal pointing are assessed in 6-12 year-old children, in an experimental task similarto that of the adults. This second experiment attests a progressive evolution of speech/gestureinteractions in the development of spatial deixis. It reveals that distance is preferentially encodedin manual gestures in children, rather than in vocal gestures (and especially so in youngerchildren). It also shows that the cooperative use of speech and manual gesture in deixis is alreadyat play in children, though with more influence of gesture on speech than the reversedpattern.The third part of the study looks at sensorimotor interactions in the perception of spatial deixis.This experimental study, based on an intermodal priming paradigm, reveals that manual gestureplays a role in the production/perception mechanism associated with the semantic processingof language. These results can be related with those of studies on the sensorimotor nature ofrepresentations in the processing of linguistic sound units.Altogether, these studies provide strong evidence for an integrated representation of speech andmanual gestures in the human linguistic brain, even at a relatively early age in its development.They also show that distance encoding is a robust feature, which is also present in all aspectsof multimodal pointing.

[pt] Este trabalho analisa o uso da tecnologia de representação visual Power Point por aspirantes de Marinha da Escola Naval do Rio de Janeiro, ao produzir e conduzir apresentações durante as aulas de inglês como língua estrangeira, com o duplo objetivo de investigar como os princípios semióticos operam nos slides e como a experiência contribui para a vivência em sala de aula. Para tanto, o estudo leva em consideração os slides produzidos e a percepção dos aspirantes envolvidos. Três áreas de pesquisa fornecem embasamento teórico para este estudo: multimodalidade, comunidade de prática e qualidade de vida em sala de aula. Estudos sobre os elementos visuais na comunicação (ROSE, 2001; KRESS E VAN LEEUWEN, 1996, 2001; ROYCE, 2002), aliados ao estudo das funções da linguagem propostas pela Linguística Sistêmico-Funcional (HALLIDAY, 1985, 1994) dão subsídio para a análise dos slides. Estudos sobre tipos de comunidade que partilham objetivos, hábitos e atitudes (LAVE E WENGER, 1991; ECKERT E MC CONNELL-GINNET, 1992), associados ao estudo de gêneros híbridos que refletem ideologias e valores e desempenham uma funcionalidade retórica e social (ANSON, DANNELS E ST CLAIR, 2005) direcionam a interpretação das opiniões dos aspirantes. Estudos sobre a complexidade da sala de aula e das relações que aí se estabelecem (ALLWRIGHT, 1991, 2005, 2006; GIEVE E MILLER, 2006) dão suporte para as conclusões quanto ao possível efeito das apresentações nessas relações. Esta pesquisa caracteriza-se como qualitativa, pois a coleta de dados compreende uma série de práticas e atividades interpretativas relacionadas à análise de (1 ) slides em Power Point, (2) textos escritos pelos aspirantes durante discussões em grupo, (3) seus relatos individuais e (4) notas de campo da pesquisadora. Com base nos resultados do estudo, este trabalho (1) propõe um modelo de análise que dá contados diversos elementos existentes nos slides digitais – a Esfera Multimodal; e (2) sugere que a experiência de produzir e conduzir apresentações com o recurso digital possibilita a expressão de idéias e favorece a integração com o grupo. O maior conhecimento sobre a competência genérica multimodal propiciada pelo uso de Power Point em um ambiente educacional pode contribuir para estimular a autonomia dos aprendizes e influenciar positivamente sua participação no processo de ensino-aprendizagem. / [en] This work analyses the use of Power Point as a technology of visual representation by the midshipmen of the Naval Academy of Rio de Janeiro while producing and conducting presentations during the classes of English as a Foreign Language, with the double aim of investigating how semiotic principles operate on the slides and how the experience contributes to life in the classroom. To that effect, the study takes into account the slides produced as well as the perceptions of the midshipmen involved. Three areas of research provide theoretical support for this study: multimodality, community of practice and quality of classroom life. Studies about the visual elements in communication (ROSE, 2001; KRESS AND VAN LEEUWEN, 1996, 2001; ROYCE, 2002), together with the studies of language functions proposed by Systemic-Functional Linguistics (HALLIDAY, 1985, 1994), enable the analysis of the slides. Studies about types of communities whose objectives, habits and attitudes are shared (LAVE AND WENGER, 1991; ECKERT AND MC CONNELL-GINNET, 1992), associated with studies of hybrid genres which reflect ideology and values and accomplish rhetorical and social functionality (ANSON, DANNELS AND ST CLAIR, 2005) direct the interpretation of the midshipmen’s perceptions. Studies about the complexity of classroom life and the relationships which are established in it (ALLWRIGHT, 1991, 2005, 2006; GIEVE AND MILLER, 2006) back up conclusions as to the possible repercussion of the presentations on those relationships. This research is characterized as qualitative, as data collection involves a series of interpretive practices and activities regarding the analysis of (1) Power Point slides, (2) texts produced by the midshipmen while engaged in group discussions, (3) their individual statements and (4) the field notes taken by the researcher. On the basis of the results of the study, this work (1) proposes a model of analysis which encompasses the variety of elements existing in digital slides - the Multimodal Sphere, and (2) suggests that the experience of producing and conducting presentations with the aid of the digital resource makes it possible to express ideas and easier to integrate with the group. A deeper understanding of the multimodal generic competence afforded by the use of Power Point in an educational setting can contribute to encouraging learners’ autonomy and enhancing their participation in the teaching-learning process.

Magister Artium - MA (Linguistics, Language and Communication) / Despite the spread of digital communication technologies and the integration of mobile phones into everyday life, young children's literacy practices are changing rapidly, and schools are struggling to address the potential of these digital communication technologies for learning. Mobile phones are currently a key consumer item, an image of social capital, and they initiate their users into a portable web of numerous applications including those literacy related. Much research has been done on children's relationship with digital technologies and the implications of this for their literacy learning and education in general, but there is almost no research on this in the global south, and almost none in South Africa. Filling this gap is crucial given the crisis in South Africa in basic education. The main aim for this research is to establish the kinds of digital technology and information systems affordances (internet facilities, tablets, books, magazines, newspapers, radios, TVs, video and computer games, etc.) in the homes of the selected children to explore how these digital technologies and information system affordances could be used to enhance the academic literacy development of 12- to 15-year-old children in informal settlements or townships in Cape Town.

Magister Artium - MA / Technical documentation comes in a variety of forms such as installation or operation manuals, quick reference guides, maintenance manuals, user manuals, policy and procedure manuals or marketing brochures and flyers (Walsh, 2012). What all these sub-genres have in common is that the texts that correspond to them seek to inform and give instruction about procedures, behaviour and actions related to products (Schäffner & Wiesemann, 2001: 49). Manuals have been described as “the complete reference source for a product’s operation, maintenance and safety” (Cowley & Wogalter, 2011: 1773). For the purpose of this study, we will focus on one form of technical documentation, namely user manuals. The terms “documentation” and “manuals” will be used interchangeably. Although there are probably as many manuals as there are products in our homes, these user manuals have not frequently been the subject of academic study in the South African context. The relative lack of research into user manuals is especially regrettable at a time when new product liability legislation and trade regulations (e.g. the Consumer Protect Act of South Africa, 2008) have enhanced the profile of product manuals in public and regulatory discourse. As a result of this relative neglect, it is not known how understandable, relevant and therefore empowering users of products find these manuals. There is also not much knowledge concerning the level of compliance in manuals to the provisions of product liability legislation. This study therefore proposes to investigate the comprehensibility and usability of user manuals associated with two products (blenders) marketed in South Africa. It will draw on theories and methods of analysis associated with technical writing, analysis of terminological consistency, genre and multimodality, to evaluate the selected manuals from the standpoint of a subset of the criteria listed in Section 22(2) of the Consumer Protection Act of South Africa, No. 68 of 2008, which was later amended in 2011. The methodology for the proposed study will combine text analysis (by the researcher) with comprehension and usability tasks performed by selected participants. Data from these sources will be collated and analysed to determine the conformity of the manuals to criteria in the Consumer Protection Act of South Africa, and the effect the manuals have on product users. Areas for optimising (improving) the manuals will also be identified.

Magister Artium - MA / Advertising and media imagery shape attitudes about race and ethnicity, which means that advertising media play an influential part in constructing the frame through which individuals perceive racial differences and negotiate norms and ideas around ethnicity. Physical signifiers such as skin colour and hair are not only considered to be the most important facets in global beauty culture but are also seen as two principal phenotypes for racial classification (Mercer, 1987). These two attributes are also deeply situated within Black Feminist Discourse Studies and are therefore, culturally and socially significant (Erasmus, 1997; Hunter, 2002). As Dyer (1997:539) states: “every decision about a person’s worth is based on what they look like, what they speak, and where they came from.” Hence, body and hair politics point to power struggles which stem from historical discourses. As part of a capitalist environment, magazines such as True Love are also perceived as cultural commodities which occupy an important role in creating, transmitting and disseminating cultural meaning and in this regard, advertised texts are rich in cultural meaning and embedded with hidden ideologies. As a vehicle of social communication, True Love professes to be a mouth piece and a representative of the liberal, modern Black South African woman and portrays itself as a guiding companion and expert on womanhood (Laden, 2001). In this capacity, the magazine also creates and transmits messages about ideal feminine beauty. Following a multi-semiotic approach, by incorporating multimodality and social semiotics as proposed by Kress and Van Leeuwen (2006), Van Leeuwen (2006; 2008) and O’Halloran (2011, in press), beauty advertisements are scrutinized in terms of the different semiotic principles which afford for different meaning-making opportunities and interpretation. Critical discourse analysis suggested by Fairclough (1992) and Wodak (1995) renders a supportive function to this social semiotic multimodal framework, in order to critically explore how the notion of ideal feminine beauty is constructed in True Love and to establish how inter-semiotic relations are created, reinforced and function to sustain hegemonic ideas in present-day beauty advertisements. The findings suggest that socio-cultural meanings attached to phenotypic traits such as skin and hair remain significant in contemporary society as a result of the repeated themes in media, especially advertising. Moreover, the consequential emphasis on beauty culture and the omnipresence of idealised imagery in mainstream media are responsible for composing and sustaining the belief that Whiteness is the only valid prototype of beauty. The whitewashing of Black models show how idealised preferences in media prevail. Advertisements display how the message of White superiority and supremacy is constructed visually and verbally, ultimately producing an overall ‘visual language of Whiteness’ which leads to devaluing and erasing forms of Black identity, while enhancing forms of White representation. This paper exposes existing dominant cultural narratives in the True Love advertising discourse that simultaneously produce and inflate an idealised Eurocentric version of feminine beauty. The hegemonic standard of feminine beauty dictates that women conform to a specific ideal which involves engaging in practices such as skin lightening, hair straightening or wearing weaves. This dissertation concludes that digital alteration techniques and photographic manipulation are predominantly used in mass media to portray advertised images resembling ideals closer, which means that it effectively enhances rather than detracts from the norm. Thus, White women look Whiter, thinner, richer and blonder. Caucasian models in advertised texts all have light hair and are seldom portrayed with dark hair. Light-skinned Black women portray Western mediated standards through physical appearances which seem to emulate those of their White counterparts, which Hunter (2011) describes as the ‘illusion of inclusion’. Although this marketing strategy operates under the premise of fostering ethnic diversity and to include women from all racial backgrounds, it reinforces the belief that Anglo-Saxon beauty norms are the only valorised signifiers of idealised beauty. Essentially, having a light skin colour is associated with sophistication, social mobility, success and the resulting financial and economic well-being. Based on this, the magazine appears to promote and celebrate feminine beauty based on a Eurocentric ideal.

VIANA, Elisângela Oliveira. Estratégias de construção do ethos gay masculino no blog Katylene.com: um estudo da multimodalidade e das gírias gay. 2012. 99f. – Tese (Doutorado) – Universidade Federal do Ceará, Departamento de Letras Vernáculas, Programa de Pós-graduação em Linguística, Fortaleza (CE), 2012. / Submitted by Márcia Araújo (marcia_m_bezerra@yahoo.com.br) on 2016-08-04T16:56:28Z No. of bitstreams: 1 2012_dis_eoviana.pdf: 2295631 bytes, checksum: 6b6ff2ba2339d5fa9b705e9956691b8a (MD5) / Approved for entry into archive by Márcia Araújo (marcia_m_bezerra@yahoo.com.br) on 2016-08-04T16:57:25Z (GMT) No. of bitstreams: 1 2012_dis_eoviana.pdf: 2295631 bytes, checksum: 6b6ff2ba2339d5fa9b705e9956691b8a (MD5) / Made available in DSpace on 2016-08-04T16:57:25Z (GMT). No. of bitstreams: 1 2012_dis_eoviana.pdf: 2295631 bytes, checksum: 6b6ff2ba2339d5fa9b705e9956691b8a (MD5) Previous issue date: 2012 / In this research, we analyze the construction of the male gay ethos in the blog katylene.com, considering the multimodal resources used by the blog user and the manifestations of gay slangs, which show elements of orality from male gays. To achieve our objective, we develop a discussion based on the concept of Discursive Ethos, grounded on studies as Maingueneau (1993; 1998; 2005; 2008) and Amossy (2005). In the sequence, we discuss Kress and van Leeuwen’s (2006) multimodal theory about the concept of slang, used by Castro (1938), Guérios (1979), Preti (1982; 1983; 1984; 2000; 2001) and Araújo (2008). Concerning the corpus collection, we selected 22 posts collected in the eleven post categories from the blog homepage katylene.com. In the data analysis, we make use of the triptych model of visual space dimensions, proposed by Kress and van Leeuwen (2006). Based on this model, it was possible to verify that data extracted from the blog show an salience interchange of the multimodal elements that characterize each one of the ethé that compose the male gay ethos. Besides that, due to the compositional characteristics of the blog, the data pointed out that the triptych model proposed by Kress and van Leeuwen (2006) should be redesigned. When we proceed to the analysis of gay slangs composition presented in the blog, we verified that the strategies of phonetic writing are not an evidence of an opposition between the ethé / Nesta pesquisa, analisamos a construção do ethos gay masculino no blog katylene.com, considerando os recursos multimodais mobilizados pelos usuários do blog e a manifestação de gírias gays que revelam traços orais da fala dos gays masculinos. Para alcançar nosso objetivo, desenvolvemos uma discussão alicerçada no conceito de Ethos Discursivo, tomando-se como base os estudos de Maingueneau (1993; 1998; 2005; 2008) e Amossy (2005). Em seguida, discutimos sobre a teoria multimodal desenvolvida por Kress e Van Leeuwen (2006) e sobre o conceito de gíria, realizado por Castro (1938), Guérios (1979), Preti (1982; 1983; 1984; 2000; 2001) e Araújo (2008). Quanto à elaboração do corpus, partimos para a seleção de 22 posts coletados nas onze categorias de postagens presentes na primeira página do blog katylene.com. Na análise dos dados, utilizamos o modelo tríptico de dimensões do espaço visual, proposto por Kress e van Leeuwen (2006). Com base nesse modelo, foi possível verificar que os dados extraídos do blog revelam uma alternância de saliência dos elementos multimodais que caracterizam cada um dos ethé formadores do ethos gay masculino. Além disso, devido às características composicionais do blog, os dados apontaram para a necessidade da reconfiguração do modelo tríptico proposto por Kress e van Leuween (2006). Por sua vez, ao direcionarmos nossa lupa para composição das gírias gays apresentadas no blog, verificamos que as estratégias de escrita fonética não evidenciam uma oposição entre os ethé formadores do ethos gay masculino, visto que figuram em cada um dos ethé, conspirando a favor da construção desse ethos.

DUARTE, Luciana Costa Rodrigues de Paula. O gênero anúncio: uma análise multimodal e semiolinguística da construção argumentativa. 2011. 117f. – Dissertação (Mestrado) – Universidade Federal do Ceará, Departamento de Letras Vernáculas, Programa de Pós-graduação em Linguística, Fortaleza (CE), 2011. / Submitted by Márcia Araújo (marcia_m_bezerra@yahoo.com.br) on 2014-06-13T15:02:45Z No. of bitstreams: 1 2011_dis_lcrpduarte.pdf: 7175423 bytes, checksum: 5be188d23cc918883a14a35b0114a544 (MD5) / Approved for entry into archive by Márcia Araújo(marcia_m_bezerra@yahoo.com.br) on 2014-06-13T15:19:39Z (GMT) No. of bitstreams: 1 2011_dis_lcrpduarte.pdf: 7175423 bytes, checksum: 5be188d23cc918883a14a35b0114a544 (MD5) / Made available in DSpace on 2014-06-13T15:19:39Z (GMT). No. of bitstreams: 1 2011_dis_lcrpduarte.pdf: 7175423 bytes, checksum: 5be188d23cc918883a14a35b0114a544 (MD5) Previous issue date: 2011 / This research examines the relation between verbal and nonverbal argumentation in the construction of the advertisement. To verify the entanglement between the verbal and visual semiosis, we used two theories that conceive the act of language as a testimony of the social and cultural practices of a group: the social semiotics (Kress, Van Leeuwen, 2006; KRESS, 2010) along with multimodality and semiolinguistics (Charaudeau, 2008). The present research had the following steps: analysis of argumentative device (Charaudeau, 2008) to investigate the performance of verbal and/or visual at each stage of the device; verification of the interactive meanings of visual composition (KRESS, van Leeuwen, 2006) and its relation to the purpose of convincing and seducing the reader; and finally, the meaning of composition analysis (Kress, Van Leeuwen, 2006) of the advertising text to see how the text is structured in order to build the argument of the advertisement. For the analysis of the study subject, we formed a sample of 20 ads of tourism in Ceará extracted from printed magazines specialized in tourism and chose the methodological procedures advocated by the theories mentioned (we united the two theories) and by the methodology of scientific research. The survey results showed greater presence of verbal language in the proposition of the device argumentative (Charaudeau, 2008) and the importance of image in the persuasion stage of the same device. The analysis of the interactive meaning of the visual elements, we found a regularity of images offered as objects of contemplation from a social distance social and an attitude of engagement with the reader. In the meaning of the composition of the ads, we noticed a predominance of the composition Ideal/Real working the promise of the product in terms of ideal and the possibility of its realization in the Real. About salience, we found the pictures as the most evident items in the sample and in the frame, we observed that the elements of the ad are connected and integrated by weak dividing lines and the repetition of colors and shapes. Finally, the data shows that entanglement between the verbal and visual languages for the construction of argumentation in the text occurs in a strategically planned around the advertisement, in order to take advantage of the significant benefits of each semiosis and the junction between the language for persuasion and seduction of the audience. / Esta pesquisa analisa a inter-relação entre a linguagem verbal e a não-verbal na construção da argumentação do anúncio. Para verificar esse entrelaçamento entre as semioses verbal e visual, utilizamos duas teorias que concebem o ato de linguagem como um testemunho das práticas sociais e culturais de um grupo: a semiótica social (KRESS; VAN LEEUWEN, 2006; KRESS, 2010) com a multimodalidade e a semiolinguística (CHARAUDEAU, 2008). Durante a pesquisa, executamos as seguintes etapas: análise do dispositivo argumentativo (CHARAUDEAU, 2008) para investigar a realização da linguagem verbal e/ou visual em cada etapa do dispositivo; verificação do significado interativo da composição visual (KRESS; VAN LEEUWEN, 2006) e sua relação com o propósito de convencer e seduzir o leitor; e, por último, análise do significado composicional (KRESS; VAN LEEUWEN, 2006) do texto publicitário para verificar como o texto é estruturado, com o objetivo de construir a argumentação do anúncio. Para a análise do objeto de estudo, constituímos uma amostra de 20 anúncios de turismo do Ceará extraídos de revistas impressas especializadas em turismo e adotamos os procedimentos metodológicos preconizados pelas teorias de base mencionadas (unimos as duas teorias) e pela metodologia da pesquisa científica. Os resultados da pesquisa comprovaram uma maior presença da linguagem verbal na proposta do dispositivo argumentativo (CHARAUDEAU, 2008) e a importância da imagem na etapa da persuasão do mesmo dispositivo. Na análise do significado interativo dos elementos visuais, constatamos uma regularidade de imagens oferecidas como objetos de contemplação a uma distância social mediana e uma atitude de envolvimento com o leitor. No significado composicional dos anúncios, notamos uma predominância da composição Ideal/Real trabalhando a promessa do produto no plano do Ideal e a possibilidade de sua realização no Real. Já na saliência, encontramos as imagens como os itens mais evidentes na amostra e no enquadre, observamos que os elementos do anúncio estão conectados e integrados pelas linhas divisórias fracas e pela repetição de cores e formas. Por fim, os dados revelam que o entrelaçamento entre as linguagens verbal e visual para a construção da argumentação do texto ocorre de forma estrategicamente planejada em todo o anúncio, com o propósito de valer-se dos benefícios significativos de cada semiose e da junção entre as linguagens para o convencimento e sedução do público-alvo.

RODRIGUES, Maria Coeli Saraiva. Multimodalidade e tradição discursiva: um estudo sobre gênero anúncio publicitário. 2011. 163f. – Dissertação (Mestrado) – Universidade Federal do Ceará, Departamento de Letras Vernáculas, Programa de Pós-graduação em Linguística, Fortaleza (CE), 2011. / Submitted by Márcia Araújo (marcia_m_bezerra@yahoo.com.br) on 2014-08-18T14:08:33Z No. of bitstreams: 1 2011_dis_mcsrodrigues.pdf: 4507942 bytes, checksum: fbe25bc85d25ea632c6d407948072561 (MD5) / Approved for entry into archive by Márcia Araújo(marcia_m_bezerra@yahoo.com.br) on 2014-08-18T16:48:05Z (GMT) No. of bitstreams: 1 2011_dis_mcsrodrigues.pdf: 4507942 bytes, checksum: fbe25bc85d25ea632c6d407948072561 (MD5) / Made available in DSpace on 2014-08-18T16:48:05Z (GMT). No. of bitstreams: 1 2011_dis_mcsrodrigues.pdf: 4507942 bytes, checksum: fbe25bc85d25ea632c6d407948072561 (MD5) Previous issue date: 2011 / This research aimed at perceiving how the verbal language was gradually associated with other semiosis in the construction of the genre advertisement. Our hypothesis was that, through the insertion of semiotic resources in this genre, multimodality would become a genuine discursive tradition in advertisements construction. To reach this objective, we developed, initially, a discussion drawn on the concept of Discursive Tradition, proposed by Kabatek (2004), and in the multimodal theory developed by Kress and Van Leeuwen (1996). Concerning to the corpus, we selected 54 printed advertisements of cars, spread since the early 1920s until the first decade of the XXI century, which are the basis for our analysis. To analyze the corpus, we made use of Zavam’s (2009) theoretical and methodological analysis and Kress and Van Leeuween’s (1996) methodology for a multimodal analysis. The results of our analysis showed that the multiple semiosis in advertisements are important elements for the construction of the intended meaning in the message. Moreover, we verified that they are a genuine discursive tradition because their visual arrangement contributes for the construction of meaning and because multimodality is constantly verified in the genre advertisement. / Esta pesquisa teve como objetivo perceber de que maneira a linguagem verbal foi se associando a outras semioses, na constituição do gênero anúncio publicitário. Nossa hipótese foi que, com a inserção dos recursos semióticos nesse gênero, a multimodalidade passaria a ser uma genuína tradição discursiva na constituição dos anúncios. Para alcançarmos esse objetivo, desenvolvemos, inicialmente, uma discussão alicerçada no conceito de Tradição Discursiva, proposto por Kabatek (2004), e na teoria multimodal desenvolvida por Kress e Van Leeuwen (1996). Quanto à elaboração do corpus, partimos para a seleção de 54 anúncios impressos de carros, veiculados no início da década de 1920 até a primeira década do século XXI, os quais formaram a base de nossa análise. Para analisarmos o corpus, utilizamos o modelo teórico-metodológico proposto por Zavam (2009), em conjunto com a metodologia para análise multimodal proposta por Kress e Van Leeuwen (1996). A partir da análise, foi possível verificar que as múltiplas semioses, dentro do gênero anúncio publicitário, apresentaram-se como elementos que auxiliam na construção do sentido da mensagem pretendida pelo enunciador, bem como se mostram como uma genuína tradição discursiva, uma vez que, além da utilização do arranjo visual conspirar em favor da construção do sentido, a multimodalidade se mostra constante dentro gênero anúncio.

NASCIMENTO, Suelene Silva Oliveira. A construção multimodal dos referentes em textos verbo-audiovisuais. 2014. 150f. – Dissertação (Mestrado) – Universidade Federal do Ceará, Departamento de Letras Vernáculas, Programa de Pós-graduação em Linguística, Fortaleza (CE), 2014. / Submitted by Márcia Araújo (marcia_m_bezerra@yahoo.com.br) on 2014-10-20T13:47:20Z No. of bitstreams: 1 2014_dis_ssonascimento.pdf: 5865487 bytes, checksum: 5b3416975b4c5c32b27afe3e70f7e010 (MD5) / Approved for entry into archive by Márcia Araújo(marcia_m_bezerra@yahoo.com.br) on 2014-10-20T15:46:27Z (GMT) No. of bitstreams: 1 2014_dis_ssonascimento.pdf: 5865487 bytes, checksum: 5b3416975b4c5c32b27afe3e70f7e010 (MD5) / Made available in DSpace on 2014-10-20T15:46:27Z (GMT). No. of bitstreams: 1 2014_dis_ssonascimento.pdf: 5865487 bytes, checksum: 5b3416975b4c5c32b27afe3e70f7e010 (MD5) Previous issue date: 2014 / This work has as main objective to analyze the referential construction of an verb audiovisual text based on verb categories of compositional metafunction in the Grammar of Visual Design (KRESS and VAN LEEUWEN, 2006). We assume that the meaning of things is not completely pre - set before being part of an utterance. The objects of the world, to be referred to by the speaker, are perceived by the individual, who, like each of the other speakers of the language, has a particular life experience and carries their knowledge, shaped by cultural and ideological constraints of their society and their times. We assume the fundamental assumptions of the Grammar of Visual Design (GDV), derived from the Systemic Functional Grammar. In order to verify this entanglement between the verbal and visual semiosis, we elected sociocognitivism, from which we propose a scaling effect in Linguistics Textual analysis (LT). At first, some studies verticalizes multissemioses who have already had a tonic in the field of LT. In a second step, we articulated the theory of multimodality and referral to other theoretical fields such as reading comprehension, in order to strengthen the scope of our research, establishing the studies already conducted and, in particular, exceeding the plan exclusively verbal. To carry out this study, we analyzed a short film, Vida Maria, Márcio Ramos, produced in computer graphics. The choice of this genre was due to the nature of our research tool – interview guidelines or semioriented, since we intend to analyze how is it related to the construction of the film at the time of display of short scenes, and as such reconstruction referents in a verbal-visual text mobilizes certain reading strategies. / Este trabalho tem como objetivo geral analisar a construção referencial de um texto verbo-audiovisual com base em categorias da metafunção composicional na Gramática do Design Visual (KRESS & VAN LEEUWEN, 2006). Partimos do princípio de que o sentido dos signos não está completamente pré-definido antes de fazer parte de um enunciado. Os objetos do mundo, ao serem referidos pelo falante, passam pela percepção do indivíduo, que, como cada um dos outros falantes da língua, tem uma experiência particular de vida e carrega sua bagagem de conhecimento, moldada pelas imposições culturais e ideológicas de sua sociedade e de sua época. Assumimos os pressupostos fundamentais da Gramática do Design Visual (GDV), oriundos da Gramática Sistêmico-Funcional. Para verificar esse entrelaçamento entre as semioses verbal e visual, elegemos o sociocognitivismo, a partir do qual propomos um redimensionamento das análises efetivadas em Linguística Textual (LT). Em um primeiro momento, verticalizamos alguns estudos sobre a multissemiose que já têm tido uma tônica no campo da LT. Em um segundo momento, articulamos a teoria da referenciação e a da multimodalidade com outros campos teóricos, como o da compreensão leitora, com o intuito de fortalecer o nosso escopo de investigação, elastecendo as pesquisas já realizadas e, em especial, ultrapassando o plano exclusivamente verbal. Para a realização do presente estudo, analisamos um curta-metragem, Vida Maria, de Márcio Ramos, produzido em computação gráfica. A opção por esse gênero se deu em virtude da natureza do nosso instrumento de investigação – entrevista por pautas ou semiorientada, uma vez que tencionamos analisar como se explica a construção dos referentes do filme no momento da exibição das cenas do curta, e como tal reconstrução dos referentes em um texto verbo-audiovisual mobiliza certas estratégias de leitura.

A Multimodalidade em narrativas orais é objeto de estudo desta pesquisa, sendo relevante no sentido de que os recursos multimodais são propiciadores da produção de sentidos em narrativas orais infantis. Desse modo, este trabalho propõe investigar os recursos multimodais que favorecem a produção de sentidos em narrativas orais infantis. Fundamentamos nossa pesquisa na perspectiva do funcionamento multimodal da linguagem, respaldados em McNeill (2000), Kendon (1982, 2000), Cavalcante (1999, 2009), Fonte (2011) e Fonte et al (2014), e nos estudos sobre narrativas orais e literatura infantil, com as contribuições de Marcuschi (2003), Bettelheim (1979), Matos (2009), Franz (1981), Sisto (2012), Abramovich (2000), Gillig (1999). A metodologia foi de caráter qualitativo, natureza observacional do tipo estudo de caso. Para a coleta de dados, participaram sete crianças de uma escola da rede de ensino municipal da cidade do Recife, matriculadas no segundo ano do ensino fundamental. Um conto clássico adaptado da literatura infantil e um conto inédito foram gravados em áudio e, posteriormente, apresentados para as crianças em dois momentos distintos. Após ouvir os contos pela segunda vez, as crianças recontaram cada um deles. Os recontos foram filmados para serem transcritos através do software ELAN (Eudico Linguistic Annotator), que possibilita registrar fala e gestos simultâneos. Selecionamos como categoria de análise o plano verbal e plano gestual, que compõem o envelope multimodal, adotado por Ávila Nóbrega (2010) e Fonte (2011). Sabemos que o primeiro contato da criança com o texto é o falar, o ouvir, o sentir, o enxergar com os olhos do imaginário. Com a análise dos dados, concluímos que, nas narrativas dos contos, houve a predominância da produção verbal associada às gesticulações. Porém, no conto clássico, observamos maior variedade de gesticulações e mais detalhes na narrativa em virtude da sedimentação dos recursos multimodais na história mais conhecida. No conto contemporâneo, constatamos limitações das informações nas narrativas e maior escassez gestual, talvez por não ser conhecido pelas crianças.