Dans le contexte de la génération synthétique et le décodage d'informations linguistiques, non seulement le composant auditif mais aussi le composant visuel de la parole transmettent de l'information précieuse. Nous étudions le regard en tant qu´élément crucial pour enrichir la parole et fournir des informations supplémentaires. Le regard est un geste déictique très important, ainsi il influence de manières variées l'organisation du dialogue et de l'interaction sociale. Dans une première expérience nous étudions comment le regard d'une tête parlante peut être employé comme geste déictique dans un jeu de recherche et sélection sur un écran d'ordinateur. Nous avons trouvé que ces gestes sont capables de réduire le temps de réaction ainsi que la charge cognitive. Cet effet est accentué quand le geste est de caractère multimodal, utilisant la parole de manière adaptée. Dans une deuxième expérience nous avons étudié le rapport entre le regard d'un sujet cible et les différents éléments d'une interaction dialogique. Nous avons défini différents segments dans l'échange d'information dialogique et avons trouvé qu´ils sont liés aux variations du comportement du regard mesuré. Basé sur ces résultats nous proposons un modèle pour le contrôle du regard d'un agent conversationnel animé dans l'interaction face-à-face.

<p>The dialogical plait in individual vocal education</p><p>Thesis in Music Education by Jannike Huss. Part of the work for the master´s degree. Studies from School of Music, Theatre, and Art, University of Örebro, 2010. Available from Örebro University, SE-701 82 Örebro, Sweden. Original in Swedish.</p><p>This thesis treats the value of communication for individual vocal education on a higher level. The purpose is to examine and illuminate what is happening in the interaction between teacher and student in individual vocal education, and how it in turn can affect learning. To get deeper knowledge and understanding of the subject, observations of singing lessons and openhearted interviews have been conducted with one teacher and two of her students. During the discussions the participants gave their own views on how an effective communication can occur in the interaction between teacher and student. In this study, only individual lessons in singing on tertiary music education have been studied. The students participating in the study are both prospective teachers with a major in vocals, and it turned out that they already were obvious carriers of two different roles, namely their student role and also their future occupational role. Due to this fact they could experience the interaction from both sides. The interviews with both students were directly connected to their lessons, and after the lessons the teacher was interviewed. All the interviews took shape as open conversations, and have since been transformed into a coherent narrative with a narrative approach in order to create meaning and context (Kvale, 2008; Georgii-Hemming, 2005). Data from the empirical material has been processed, and recounted to a theoretical conceptual framework (von Wright, 2003; Buber, 2004).</p><p>Keywords:</p><p>Vocal education, dialogue, interaction face-to-face, intersubjectivity, relationship, teacher training.</p>

The dialogical plait in individual vocal education Thesis in Music Education by Jannike Huss. Part of the work for the master´s degree. Studies from School of Music, Theatre, and Art, University of Örebro, 2010. Available from Örebro University, SE-701 82 Örebro, Sweden. Original in Swedish. This thesis treats the value of communication for individual vocal education on a higher level. The purpose is to examine and illuminate what is happening in the interaction between teacher and student in individual vocal education, and how it in turn can affect learning. To get deeper knowledge and understanding of the subject, observations of singing lessons and openhearted interviews have been conducted with one teacher and two of her students. During the discussions the participants gave their own views on how an effective communication can occur in the interaction between teacher and student. In this study, only individual lessons in singing on tertiary music education have been studied. The students participating in the study are both prospective teachers with a major in vocals, and it turned out that they already were obvious carriers of two different roles, namely their student role and also their future occupational role. Due to this fact they could experience the interaction from both sides. The interviews with both students were directly connected to their lessons, and after the lessons the teacher was interviewed. All the interviews took shape as open conversations, and have since been transformed into a coherent narrative with a narrative approach in order to create meaning and context (Kvale, 2008; Georgii-Hemming, 2005). Data from the empirical material has been processed, and recounted to a theoretical conceptual framework (von Wright, 2003; Buber, 2004). Keywords: Vocal education, dialogue, interaction face-to-face, intersubjectivity, relationship, teacher training.

Submitted by Maike Costa (maiksebas@gmail.com) on 2017-03-24T13:02:51Z No. of bitstreams: 1 arquivototal.pdf: 3351670 bytes, checksum: d7ffdd58b6eb19c7d97b4c7a15558b59 (MD5) / Made available in DSpace on 2017-03-24T13:02:51Z (GMT). No. of bitstreams: 1 arquivototal.pdf: 3351670 bytes, checksum: d7ffdd58b6eb19c7d97b4c7a15558b59 (MD5) Previous issue date: 2016-08-08 / Cette thèse a pour but analyser les situations sociales produites dans l'enseignement de la Langue Maternelle comme un contexte pour la formation citoyenne des apprentis. Ainsi, cette recherche vise à comprendre comment les interactions entre professeur et étudiants contribuent à la capacité d'adapter les discours de ces élèves citoyens aux conditions de production et réception de différents évènements communicatifs. Cette recherche a comme base les axes théoriques de la Sociolinguistique Interactionnelle (GOFFMAN 2011, 2012, 2013 a, b c; GUMPERZ 1982, 2013) dirigée à l'Analyse de la Conversation (KERBRAT-ORECCHIONI 2010, MARCUSCHI 2004, 2005, 2008 a, b), en particulier, l'interaction face à face dans le processus d'enseignement-apprentissage. Ces approches considèrent le langage un phénomène social, en autre, celui du langage humain qui correspond à l'utilisation langagère diverse, selon les situations sociales où elles s'insèrent (BAKHTIN, 2006, e 2010; LABOV, 2011). Ainsi, l'analyse des cours de Langue Maternelle est une ocasion d'étudier la pratique pédagogique, car il est entendu qu'elle doit favoriser l'analyse critique des réalités et des contextes qui sont historiquement et socialement construits. Il est nécessaire encore, produire des discours sensibles au pouvoir et que leur permette d'interagir avec les autres discours et formes d'interpréter et de s'assurer dans le monde, de manière à vivre des expériences multiples et participer avec des différentes positions d'interaction, favorisant donc l'expression de voix plusieurs, complexes et différentes. Il est clair que le cours est une ambiance communicative dont l'interaction face à face est faite par l'interaction verbale et aussi par les signes non-verbaux, à travers les indices de contextualisation et d'autres ressources. Dans ce contexte, quand les intentions du parlant sont reconnues par les interlocuteurs et vice versa, le succès du procès communicatif et de l'enseignement-apprentissage est assuré. Cette recherche aura une approche ethnographique, de manière prédominante, qualitative et dont l'origine est situé dans les études d'Anthropologie Culturelle et correspond à une analyse descriptive des cours dans une Escola de Referência (Grande École) situé à la ville de Recife – PE. La méthode interprétative a été utilisée, fondé en concepts de la Sociolinguistique Interactionnelle et de l'Analyse de la Conversation et à partir la collecte de données originaires d'observations, entretiens, conversations informelles, journal de terrain et analyse des documents. Par rapport aux résultats obtenus, il est considéré que la relation enseignement-apprentissage en cours n'est pas toujours favorable pour l'autonomie des étudiants, car le ce rôle social établit une relation trop spécifique avec le savoir. Cela se passe car les cours n'ont pas toujours représenté un lieu où les interactions sociales et échanges conversationnelles étaient ouvertes, ce qui donnerait force aux relations des étudiants à travers la confrontation de l'autre et en conséquent, il n'y a pas toujours de conditions de former une perception de soi-même et de sa citoyenneté. / The aim of this thesis is to analyze social situations produced in a context of mother tongue teaching as opportunities of citizenship education. The purpose of this study was to understand how does the interaction between teachers and learners help pupils to become citizens capable to adapt their discourse to different communicative events, both as a producer and receptor. This research is based on the theory of Interactional Sociolinguistics (GOFFMAN 2011, 2012, 2013 a, b c; GUMPERZ 1982, 2013), with the contribution of Conversational Analysis (KERBRAT-ORECCHIONI 2010, MARCUSCHI 2004, 2005, 2008 a, b), particularly face-to-face interaction in teaching-learning process. These views rest on the assumption that the language is a social phenomenon, i.e. a human language phenomenon related to diverse discursive practices, according to social situations (BAKHTIN, 2006 and 2010; LABOV, 2011). From this perspective, analyzing lessons is an opportunity of deliberating on teaching, assuming that the educational practices need to facilitate the critical thinking of reality and historical context socially and historically built. Furthermore, it is necessary to create sensible discourses enabled to interact with other discourses and ways of seeing and being in the world. Consequently, it will be possible to live multiple experiences and interact with people from different hierarchical positions, supporting many complex and diverse voices. For one, the classroom is a surrounding communicative place where face-to-face interaction occurs verbally and not verbally as well, through contextualization cues and other means. In this atmosphere, when the speaker‘s intentions are recognized by the listener, and vice versa, communication process and teaching-learning process are successful. This work has, mostly, an ethnographic and qualitative approach, originally from Cultural Anthropology, related to a descriptive analysis of classrooms in a Reference School located in Recife-PE-Brazil. It was used an interpretive method based on concepts in Interactional Sociolinguistics concept and Conversational Analysis, using data collected during lesson observations, interviews, informal conversation, research journal and document analysis. The results showed that teaching-learning process in the classroom not always contribute to emancipate the learners, because pupil‘s role established a very specific relation with the knowledge. Moreover, the classroom was not always a place where occurred social interactions and conversation exchanges able to consolidate learner‘s relations in a viewpoint of encountering with the other. As a result, the students are not able to foster a sense of self and their citizenship. / Esta tese tem por objetivo analisar as situações sociais produzidas no ensino de Língua Materna como espaços para a formação da cidadania dos aprendizes. Buscou-se entender como as interações entre professor e estudantes contribuem para tornar os estudantes cidadãos capazes de adequar seu discurso às condições de produção e recepção dos diferentes eventos comunicativos. Esta investigação insere-se nas bases teóricas da Sociolinguística Interacional (GOFFMAN 2011, 2012, 2013 a, b c; GUMPERZ 1982, 2013) direcionada à Análise da Conversação (KERBRAT-ORECCHIONI 2010, MARCUSCHI 2004, 2005, 2008 a, b), particularmente, a interação face a face em processo de ensino-aprendizagem. Essas linhas trabalham a linguagem enquanto um fenômeno social, ou seja, o fenômeno da linguagem humana corresponde ao exercício de práticas discursivas diversas, conforme as situações sociais em que essas práticas se inserem (BAKHTIN, 2003 e 2006; LABOV, 2008 e 2009). Nessa perspectiva, a análise de aulas é uma oportunidade para reflexão sobre o fazer pedagógico, pois se pressupõe que a prática pedagógica precisa favorecer o exame crítico das realidades e dos contextos históricos e socialmente construídos. Necessita, ainda, produzir discursos sensíveis ao poder que lhes permita interagir com outros discursos e formas de ver e estar no mundo, de modo a vivenciar múltiplas experiências e interagir com posições diferentes, favorecendo, dessa forma, a expressão de muitas, complexas e diferentes vozes. A justificativa pela temática e pelo desenvolvimento desta pesquisa parte da ideia de que as aulas em língua materna devem favorecer uma tomada de consciência da cidadania, isto é, auxiliar o estudante a saber praticá-la e compreendê-la. O domínio do uso da língua materna possibilita ao estudante uma segurança para expressar suas ideias e se posicionar quando inserido em um grupo. Nessa troca ele amplia não só o conhecimento sobre si mesmo e o outro, mas também avança em sua competência comunicativa, que é essencial para sua inserção social. Além disso, a compreensão da rotina interacional estabelecida em sala de aula viabiliza o entendimento das razões pelas quais as aulas de língua materna parecem não potencializar a apreensão de conhecimentos práticos e úteis não só à vida acadêmica dos estudantes de ensino médio, mas também às exigências de sua cultura. Nessa perspectiva, investigar as interações no processo de ensino-aprendizagem em uma sala de aula é relevante, porque a sala de aula é um espaço onde ocorrem as interações sociais e trocas conversacionais que fortalecem as relações do estudante por um viés de confrontação com o outro, construindo, assim, uma percepção de si mesmo e de sua cidadania. O presente trabalho terá uma abordagem etnográfica, predominantemente, qualitativa e corresponde a uma análise descritiva de sala de aula de uma Escola de Referência localizada na cidade de Recife – PE. Utilizou-se o método interpretativo baseado em conceitos da Sociolinguística Interacional e da Análise da Conversação, a partir da coleta de dados oriundos de observações, entrevistas, conversas informais, diário de campo e análise documental. Quanto aos resultados obtidos, considera-se que a relação ensino-aprendizagem em sala de aula nem sempre contribui para a emancipação dos estudantes, pois a responsabilidade de estudante estabelece uma relação muito específica com o saber e nem sempre a sala de aula representa um espaço onde ocorrem interações sociais e trocas conversacionais que fortalecem as relações do estudante por um viés de confrontação com o outro, não havendo, consequentemente, para ele condições de fomentar uma percepção de si mesmo e de sua cidadania.

L'interaction face-à-face représente une des formes les plus fondamentales de la communication humaine. C'est un système dynamique multimodal et couplé – impliquant non seulement la parole mais de nombreux segments du corps dont le regard, l'orientation de la tête, du buste et du corps, les gestes faciaux et brachio-manuels, etc – d'une grande complexité. La compréhension et la modélisation de ce type de communication est une étape cruciale dans le processus de la conception des agents interactifs capables d'engager des conversations crédibles avec des partenaires humains. Concrètement, un modèle de comportement multimodal destiné aux agents sociaux interactifs fait face à la tâche complexe de générer un comportement multimodal étant donné une analyse de la scène et une estimation incrémentale des objectifs conjoints visés au cours de la conversation. L'objectif de cette thèse est de développer des modèles de comportement multimodal pour permettre aux agents artificiels de mener une communication co-verbale pertinente avec un partenaire humain. Alors que l'immense majorité des travaux dans le domaine de l'interaction humain-agent repose essentiellement sur des modèles à base de règles, notre approche se base sur la modélisation statistique des interactions sociales à partir de traces collectées lors d'interactions exemplaires, démontrées par des tuteurs humains. Dans ce cadre, nous introduisons des modèles de comportement dits "sensori-moteurs", qui permettent à la fois la reconnaissance des états cognitifs conjoints et la génération des signaux sociaux d'une manière incrémentale. En particulier, les modèles de comportement proposés ont pour objectif d'estimer l'unité d'interaction (IU) dans laquelle sont engagés de manière conjointe les interlocuteurs et de générer le comportement co-verbal du tuteur humain étant donné le comportement observé de son/ses interlocuteur(s). Les modèles proposés sont principalement des modèles probabilistes graphiques qui se basent sur les chaînes de markov cachés (HMM) et les réseaux bayésiens dynamiques (DBN). Les modèles ont été appris et évalués – notamment comparés à des classifieurs classiques – sur des jeux de données collectés lors de deux différentes interactions face-à-face. Les deux interactions ont été soigneusement conçues de manière à collecter, en un minimum de temps, un nombre suffisant d'exemplaires de gestion de l'attention mutuelle et de deixis multimodale d'objets et de lieux. Nos contributions sont complétées par des méthodes originales d'interprétation et d'évaluation des propriétés des modèles proposés. En comparant tous les modèles avec les vraies traces d'interactions, les résultats montrent que le modèle HMM, grâce à ses propriétés de modélisation séquentielle, dépasse les simples classifieurs en terme de performances. Les modèles semi-markoviens (HSMM) ont été également testé et ont abouti à un meilleur bouclage sensori-moteur grâce à leurs propriétés de modélisation des durées des états. Enfin, grâce à une structure de dépendances riche apprise à partir des données, le modèle DBN a les performances les plus probantes et démontre en outre la coordination multimodale la plus fidèle aux évènements multimodaux originaux. / Face to face interaction is one of the most fundamental forms of human communication. It is a complex multimodal and coupled dynamic system involving not only speech but of numerous segments of the body among which gaze, the orientation of the head, the chest and the body, the facial and brachiomanual movements, etc. The understanding and the modeling of this type of communication is a crucial stage for designing interactive agents capable of committing (hiring) credible conversations with human partners. Concretely, a model of multimodal behavior for interactive social agents faces with the complex task of generating gestural scores given an analysis of the scene and an incremental estimation of the joint objectives aimed during the conversation. The objective of this thesis is to develop models of multimodal behavior that allow artificial agents to engage into a relevant co-verbal communication with a human partner. While the immense majority of the works in the field of human-agent interaction (HAI) is scripted using ruled-based models, our approach relies on the training of statistical models from tracks collected during exemplary interactions, demonstrated by human trainers. In this context, we introduce "sensorimotor" models of behavior, which perform at the same time the recognition of joint cognitive states and the generation of the social signals in an incremental way. In particular, the proposed models of behavior have to estimate the current unit of interaction ( IU) in which the interlocutors are jointly committed and to predict the co-verbal behavior of its human trainer given the behavior of the interlocutor(s). The proposed models are all graphical models, i.e. Hidden Markov Models (HMM) and Dynamic Bayesian Networks (DBN). The models were trained and evaluated - in particular compared with classic classifiers - using datasets collected during two different interactions. Both interactions were carefully designed so as to collect, in a minimum amount of time, a sufficient number of exemplars of mutual attention and multimodal deixis of objects and places. Our contributions are completed by original methods for the interpretation and comparative evaluation of the properties of the proposed models. By comparing the output of the models with the original scores, we show that the HMM, thanks to its properties of sequential modeling, outperforms the simple classifiers in term of performances. The semi-Markovian models (HSMM) further improves the estimation of sensorimotor states thanks to duration modeling. Finally, thanks to a rich structure of dependency between variables learnt from the data, the DBN has the most convincing performances and demonstrates both the best performance and the most faithful multimodal coordination to the original multimodal events.