Sistemas de análise de gestos têm se destacado por suas contribuições para a interação entre humanos, humanos e máquinas, e humanos e ambiente. Nessa interação, a gesticulação natural é vista como parte do sistema linguístico que suporta a comunicação, e qualquer sistema de informação que objetiva usar interação para suporte à decisão deveria ser capaz de interpretá-la. Essa interpretação pode ser realizada por meio da segmentação das fases do gesto. Para resolver essa tarefa, o estabelecimento de uma representação de dados eficiente para os gestos é um ponto crítico. A representação escolhida e sua associação a técnicas de análise podem ou não favorecer a solução sob implementação. Neste trabalho, formas de representação de gestos são submetidas aos algoritmos de reconhecimento de padrões MLP e SOM para elaborar um ambiente propício à identificação das representações mais discriminantes, quais aspectos as diferentes representações descrevem com eficiência, e como elas podem ser combinadas para melhorar a segmentação das fases do gesto. Para construção das representações multidimensionais são usados aspectos espaciais e temporais combinados com a normalização dos dados e a aplicação do filtro wavelet na busca pela representação mais discriminante para o reconhecimento das fases do gesto. Ambos os algoritmos alcançaram bons resultados com o uso dos aspectos temporais. O MLP conseguiu classificar todas as fases do gesto em configurações de representação contendo dados sobre todos os membros monitorados. O SOM apresentou boa capacidade para formar grupos contendo dados de uma mesma fase do gesto mesmo com o uso de poucas características na construção da representação, porém não foi possível identificar a proposta de uma nova fase do gesto com o aprendizado não supervisionado / Gestures analysis systems have stood out for their contributions to the interaction between humans, humans and machines, and humans and environments. In this interaction, natural gesticulation is seen as part of a linguistic system that supports the communication, and all information systems aiming at the use of such an interaction in making decisions should be able to interpret it. Such an interpretation can be carried out through the gesture phases segmentation. In order to solve this task, the establishment of an efficient data representation for gestures is a critical issue. The chosen representation as well as its combination with techniques for analysis can or can not favor the solution being developed. In this work, different forms representation for gestures are applied to pattern recognition algorithms MLP and SOM to create an adequate environment to identify the more discriminative representations, which aspect the different representations describe with more efficiency, and how they can be combined in order to improve gesture phases segmentation. To construct the multidimensional representations we use spatial and temporal aspects combined with the normalization of the data and the application of the wavelet filter in the search for the most discriminating representation for the recognition of the gesture phases. Both algorithms achieved good results with the use of temporal aspects. MLP was able to classify all gesture phases using representation settings containing data about all monitored members. SOM presented good ability to form groups containing data of the same gesture phase even with the use of few characteristics in the construction of the representation, but it was not possible to identify the proposal of a new gesture phase with unsupervised learning

This diploma thesis aims at presenting principles and techniques of giving instructions during English lessons and their practical use. It stresses the awareness of the importance of delivering clear and understandable instructions and of their influence on students' comprehension. Theoretical part of this thesis describes general rules of giving instructions and focuses on instruction techniques suitable for students' learning styles. It also deals with the language of instruction appropriate for A1 - A2 level students. Practical part consists of applying the theoretical principals in practice through an action research. The aim of the practical part is the improvement of the author's instructions. The findings have shown that modifying the language of instruction as well as using various verbal and non- verbal instruction techniques promotes the students' comprehension of instructions. Key words: Language acquisition, comprehensible input, language of instruction, students' comprehension, learning styles, gestures, action research, instructions

Sistemas de análise de gestos têm se destacado por suas contribuições para a interação entre humanos, humanos e máquinas, e humanos e ambiente. Nessa interação, a gesticulação natural é vista como parte do sistema linguístico que suporta a comunicação, e qualquer sistema de informação que objetiva usar interação para suporte à decisão deveria ser capaz de interpretá-la. Essa interpretação pode ser realizada por meio da segmentação das fases do gesto. Para resolver essa tarefa, o estabelecimento de uma representação de dados eficiente para os gestos é um ponto crítico. A representação escolhida e sua associação a técnicas de análise podem ou não favorecer a solução sob implementação. Neste trabalho, formas de representação de gestos são submetidas aos algoritmos de reconhecimento de padrões MLP e SOM para elaborar um ambiente propício à identificação das representações mais discriminantes, quais aspectos as diferentes representações descrevem com eficiência, e como elas podem ser combinadas para melhorar a segmentação das fases do gesto. Para construção das representações multidimensionais são usados aspectos espaciais e temporais combinados com a normalização dos dados e a aplicação do filtro wavelet na busca pela representação mais discriminante para o reconhecimento das fases do gesto. Ambos os algoritmos alcançaram bons resultados com o uso dos aspectos temporais. O MLP conseguiu classificar todas as fases do gesto em configurações de representação contendo dados sobre todos os membros monitorados. O SOM apresentou boa capacidade para formar grupos contendo dados de uma mesma fase do gesto mesmo com o uso de poucas características na construção da representação, porém não foi possível identificar a proposta de uma nova fase do gesto com o aprendizado não supervisionado / Gestures analysis systems have stood out for their contributions to the interaction between humans, humans and machines, and humans and environments. In this interaction, natural gesticulation is seen as part of a linguistic system that supports the communication, and all information systems aiming at the use of such an interaction in making decisions should be able to interpret it. Such an interpretation can be carried out through the gesture phases segmentation. In order to solve this task, the establishment of an efficient data representation for gestures is a critical issue. The chosen representation as well as its combination with techniques for analysis can or can not favor the solution being developed. In this work, different forms representation for gestures are applied to pattern recognition algorithms MLP and SOM to create an adequate environment to identify the more discriminative representations, which aspect the different representations describe with more efficiency, and how they can be combined in order to improve gesture phases segmentation. To construct the multidimensional representations we use spatial and temporal aspects combined with the normalization of the data and the application of the wavelet filter in the search for the most discriminating representation for the recognition of the gesture phases. Both algorithms achieved good results with the use of temporal aspects. MLP was able to classify all gesture phases using representation settings containing data about all monitored members. SOM presented good ability to form groups containing data of the same gesture phase even with the use of few characteristics in the construction of the representation, but it was not possible to identify the proposal of a new gesture phase with unsupervised learning

Die Mensch-Computer-Interaktion wird dank neuer Eingabemöglichkeiten jenseits von Tastatur und Maus reicher, vielseitiger und intuitiver. Durch den Verzicht auf zusätzliche Geräte beim Umgang mit Computern geht seitens der Eingabeverarbeitung jedoch eine erhöhte Komplexität einher: Die Programmierung gestischer Eingabe für Multitouch-Systeme ist in derzeitigen Frameworks abgesehen von den verfügbaren Standard-Gesten mit hohem Aufwand verbunden. Die entwickelte Gestenformalisierung für Multitouch (GeForMT) definiert eine domänenspezifische Sprache zur Beschreibung von Multitouch-Gesten. Statt wie verwandte Formalisierungsansätze detaillierte Filter für die Rohdaten zu definieren, bedient sich GeForMT eines bildhaften Ansatzes, um Gesten zu beschreiben. Die Konzeption von Gesten wird unterstützt, indem beispielsweise in einem frühen Stadium der Entwicklung Konflikte zwischen ähnlichen Gesten aufgedeckt werden. Die formalisierten Gesten lassen sich direkt in den Code einbetten und vereinfachen damit die Programmierung. Das zugrundeliegende Framework sorgt für die Verbindung zu den Algorithmen der Gestenerkennung. Die Übertragung des semiotischen Ansatzes zur Formalisierung auf andere Formen gestischer Eingabe wird abschließend diskutiert.

Rheumatoid Arthritis (RA) is a disease in which the body has "turned on itself", with its immune system attacking mobility. In RA, an immune mechanism attacks and destroys the joints and limits mobility, in some circumstances to the point of needing replacement of joints. The aim of this research is the development of a less costly, widely accessible, passive sensing technology that provides a quantitative assessment of RA and that monitors the therapeutic effectiveness on joint-debilitating diseases. The proposed solution relies on a quantitative evaluation of human gestures. Such a quantitative assessment supports the comparison between the motion capabilities of a patient and that of a healthy person, using a kinematic model of the human skeleton. Criteria for the classification of severity were established, and tables were generated to classify the levels of severity as a function of the measurements extracted from processed videos of a subject performing predefined movements. This research project, while contributing a new tool to the process of classification of RA level of severity, opens the way for using widely accessible digital imaging for diagnosing and monitoring the evolution of the illness. Replacing MRI or HRUS with a cheaper and more accessible technology would have a major impact on health care services. From the clinical point of view, the proposed techniques based on digital images processing combined with a monitoring approach based on infrared images that was previously developed may provide a utility of care for patients with RA, as well as an alternative and automated approach for early detection of RA and active inflammation at a critical time.

When people first started to use digital technology to generate music, they were thrilled with their new ability to create novel and different sounds; accordingly, much research effort has been directed towards rich and complex methods of sound synthesis. Unfortunately the deep physical connection that exists between a musician and an instrument has not received as much attention, and so although we have machines capable of synthesizing fantastic new sounds, we don’t have the ability to use these sounds with any immediate finesse, of developing virtuosity with our new instruments. The work presented in this thesis is an exciting step towards a more dynamic future for computer-based musical performance. The Radio Drum was designed in 1987 at AT&T labs as a prototype of a three-dimensional mouse. Max Mathews later repurposed the apparatus as a musical instrument known as the Radio Baton, which in its most modern form outputs data using the MIDI protocol. The result of this work, a new system called the Audio-Input Drum, provides high-resolution gesture capture, a simplified apparatus, and access to the extremely flexible Max/MSP/Jitter real-time software signal processing environment.

The effects from prenatal alcohol exposure have been found to cause a range of congenital physical and cognitive abnormalities (Chasnoff, Wells, Telford, Schmidt, & Messer, 2010; Kable & Coles, 2004a). The neurological impairments associated with the effects from prenatal alcohol exposure often cause learning problems, most notably in mathematics (Kable & Coles, 2004a; Howell et al., 2006). Studies have indicated that when provided instructional interventions in mathematics, children affected by prenatal alcohol exposure made gains in learning. However, the studies did not provide specifics as to how children with FAS construct the understanding of a skill or concept (Kable, Coles, & Taddeo, 2007; Coles, Kable, & Taddeo, 2009). This study contributes to the literature by examining how children affected by prenatal alcohol exposure learn the concept of equivalence through their use of gestures in contrast to their learning outcomes. Previous studies have shown that children’s use of gestures while learning mathematics assist with the integration of verbal and visual stimuli, support concept formation, and facilitate flexible encoding of problems (Goldin-Meadow, Cook, & Mitchell, 2009; McNeil & Alibali, 2004). The results from this study indicated that children in the Alcohol Exposed group showed little to no learning after the intervention as compared to a control group matched by age and IQ. The study showed that children affected by prenatal alcohol exposure used fewer conceptual gestures while learning equivalence as compared to a control group. According to the gesture analysis, the children in the Alcohol Exposed group mentally represented the concept of equivalence as a series of isolated steps or procedures. The procedural representation was not transitioned into a flexible conceptual format and applied to solve different problem types accurately (McNeil & Alibali, 2004). Future studies need to investigate whether teaching children affected by prenatal alcohol exposure to gesture during mathematics instruction would be effective to increase concept formation, accurate encoding, and learning mathematics / Inclusive Education / D. Ed. (Inclusive Education)

The dissertation examines mainly segmental assimilatory processes of Xhosa phonology within the dependency framework. This model is a multi-faceted approach which involves hierarchical organisation of features into larger constituents known as gestures. The analysis includes an elementary historical background to the development of phonological theory with emphasis on the shift from traditional linear approaches to modern non-linear models, as well as a shift from derivational theories to representational frameworks. An exploration of the phonetics/phonology interface through the application of gestures is considered an advantage of using the dependency framework over other theories of phonology. The focus of the dissertation is the description of phonetically-motivated and morphologically-motivated Xhosa phonological processes. A brief exposition of the use of the dependency framework in non-assimilatory Xhosa phonological processes is given as a possible recommendation in the conclusion of the dissertation. / Language Education, Arts and Culture / M.A. (African Languages)

Studiens syfte är att studera lärares högläsningspraktik i årskurs 1–3 med fokus på användningen av bilder och andra modaliteter. Genom att observera sex lärare under deras högläsningstillfällen studeras hur de ger elever förutsättningar att utveckla olika kunskaper och förmågor. Den teoretiska ramen för studien är det sociokulturella perspektivet på lärande som menar att vi lär oss i en social kontext, av varandra och vår omgivning. Studien utgår även från det multimodala perspektivet på texter som innebär att själva förmedlingen av en text innehåller olika aspekter som påverkar hur budskapet tolkas. Studien visar att samtliga lärare undviker att använda sig av bilder annat än i undantagsfall. Lärarna har huvudsakligen två högläsningspraktiker möjligen beroende på två skilda syften med högläsningen. Några lärare använder inte röstregister och kroppsspråk för inlevelsefull läsning utan talar mer sakligt och bjuder ofta in eleverna till samtal. Syftet med denna högläsningspraktik kan vara att skapa förståelse, utveckla kunskaper och göra eleverna delaktiga i undervisningen. Andra lärare väljer att läsa relativt sammanhängande och använda sig av röst och kroppsspråk mer inlevelsefullt. Syftet med denna högläsningspraktik kan vara att främst ge eleverna en gemensam stund för inlevelsefull och känslomässig upplevelse.

This thesis investigates emblem use exploratory in parent-child interaction. Emblems are conventional gestures with a verbal equivalent. The aim of this study was to answer if emblem use facilitates language acquisition. Formulaic gestures – fixed gestures accompanying songs – were examined as a subgesture of emblems. 20 children and their parents’ emblem use were recorded when interacting freely at seven age points: 6, 9, 12, 15, 18, 21 and 24 months. Emblem use was correlated to the children’s productive vocabulary at 30 months. The results showed that parental emblem use at 24 months and child emblem use at 15 months predicted child productive vocabulary at 30 months. T-tests showed how emblem production of children in a lower productive vocabulary group differed from children in a higher productive vocabulary group. A difference between the children of the lower productive vocabulary group and the children of the higher productive vocabulary group emblem use was also found at 15 months, indicating emblem use being important in language acquisition. Formulaic gestures did not correlate to child productive vocabulary. Emblem use developed along with child age and probably inherently with word production. Parents adjust their emblem use to the child’s age and/or possibly language skills, suggesting that child-directed gesturing occurs in parent-child interaction. / Den här studien undersöker emblemanvändning explorativt i förälder-barninteraktion. Emblem definieras som konventionella gester med en verbal motsvarighet. Målet i denna studie var att undersöka om emblemanvändning underlättar språktillägnande. Fasta gester – gester tillhörande sånger – undersöktes som en underkategori till emblem. 20 barn och deras föräldrar spelades in när de interagerade fritt vid sju ålderspunkter: 6, 9, 12, 15, 18, 21 och 24 månader vilket också korrelerades med barnets produktiva ordförråd vid 30 månader. Resultaten visade att föräldrars emblemanvändning vid 24 månader och barns emblemanvändning vid 15 månader korrelerade med barnens ordförråd vid 30 månader, vilket indikerar att emblemanvändning vid dessa ålderspunkter förutsäger ordförrådets storlek några månader senare. T-tester visade att emblemproducering hos barn skiljde sig åt mellan gruppen med barn med lägre produktivt ordförråd och gruppen med barn med högre produktivt ordförråd. Vid 15 månader fanns också en signifikant skillnad mellan grupperna vilket indikerar att emblem spelar en viktig roll vid språktillägnandet. Fasta gester visade ingen korrelation med barnets språkutveckling. Barnens emblemproduktion utvecklades med åldern och troligtvis tillsammans med ordproduktion. Föräldrar verkar justera sitt emblemanvändande till barnets ålder och/eller språkkunskaper, vilket indikerar att ett barnriktat gestikulerande finns vid förälder-barn interaktion. / Modelling child language acquisition from parent-child interaction (MINT: MAW 2011:007)