[pt] Esta tese possui como objetivo investigar o mapeamento entre o conteúdo de sentenças e aquele apresentado em gráficos no processo de compreensão multimodal. Assume-se uma abordagem experimental, baseada nos aportes teórico-metodológicos da Psicologia Cognitiva e da Psicolinguística, aliada a discussões pertinentes à área de Educação Matemática e aos estudos sobre multimodalidade e letramento. Consideram-se duas propostas acerca da integração entre informação linguística e visual: uma vinculada à hipótese de modularidade representacional de Jackendoff (1996), em que se defende a ideia de módulos de interface, de natureza híbrida, e uma proposta alternativa, assumida no presente trabalho, segundo a qual tanto o processamento linguístico como o visual gerariam representações de natureza abstrata/proposicional, que seriam integradas em uma interface conceitual. Buscou-se verificar (i) se fatores top-down como conhecimento prévio do assunto afetam essa integração e (ii) em que medida informação linguística instaura expectativas acerca da informação expressa no gráfico. Foram conduzidos dois experimentos de comparação sentença-figura com gráficos de coluna e de linha, utilizando o programa psyscope, e um envolvendo gráficos de linha com a técnica de rastreamento ocular. Não foram encontradas evidências de efeitos top-down no experimento com gráfico de colunas. Foram obtidos, contudo, efeitos significativos para tempo de resposta associados a outros fatores, quais sejam correção do gráfico, expressão lexical usada para comparar itens do gráfico (maior vs menor, p. ex.) e número de itens referidos na sentença a serem localizados no gráfico. Nos dois experimentos com gráficos de linha, as variáveis independentes foram (i) congruência (linha congruente/incongruente em relação ao verbo – exemplo: linha inclinada para cima ou para baixo vs. verbo subir) e (ii) correção do gráfico em expressar o conteúdo da frase, manipulada com alterações na linha e na ordenação (ascendente/descendente) de informação temporal no eixo x. No experimento com psyscope, os resultados indicaram não haver dificuldade de julgar a compatibilidade frase/gráfico quando congruência e correção não divergiam. Para tempo de resposta, houve efeito principal de congruência e correção, com menores tempos associados, respectivamente, às condições em que a linha era congruente com o verbo e o gráfico correto. Também houve efeito de interação entre as variáveis. No experimento com rastreador ocular, foram analisados índice de acertos, número e tempo total de duração das fixações e trajetória do olhar nas áreas de interesse demarcadas. Em relação a índice de acerto, assim como no experimento com psycope, maior dificuldade de processamento estava associada à condição incongruente correta, em que há quebra de expectativa em relação à posição da linha (vs. verbo) e ao modo usual de organização dos gráficos no eixo x. Quanto aos movimentos oculares, na área do gráfico, observou-se maior número e tempo total de duração das fixações nas condições corretas; na área da frase, tais condições apresentaram resultados opostos. Quanto à trajetória do olhar, os dados sugerem ser a informação linguística acessada em primeiro lugar, orientando a leitura do gráfico. Considerando os resultados em conjunto, pode-se afirmar que o custo de integração é determinado pela compatibilidade (ou não) entre as proposições geradas pelos módulos linguístico e visual. / [en] This thesis aims at investigating the mapping between the sentential content and the content presented in graphs in a multimodal comprehension process. We assume an experimental approach, based on Cognitive Pyschology and Psycholinguistics methodological and theoretical contributions as well as literacy and multimodality studies. Two proposals concerning the integration between linguistic and visual information are considered: one linked to Jackendoff s (1996) representational modularity hypothesis, in which, the idea of interface modules, of hybrid nature, is defended; and an alternative one according to which linguistic and visual processing could generate propositional/abstract representations which could be integrated into a conceptual interface. We tried to check (i) if top-down aspects such as prior knowledge can affect this integration and (ii) in what extent linguistic information may bring expectations about the information expressed in the graph. Sentence-picture comparison experiments were conducted with line and columns graphs using the pyscope software, and another one concerning line graphs with eye tracking technique. Top-down effects were not found in columns graphs experiment. However, significant effects related to response time associated with other aspects such as graph accuracy, lexical expression used in order to compare graph elements (larger x smaller, for example) and the number of elements in the sentence that must be found in the graph. In both experiments with line graphs, the independent variables were (i) congruency (congruent/incongruent line in relation to the verb - line up or down vs verb increase) and (ii) accuracy of the graph in order to express the content of the sentence, manipulated with changes in the line and time information order (ascendant/descendent) in x axis. In psyscope experiment, there was no difficulty in judging the sentence-picture compatibility when congruency and correction were not different. Concerning the response time, there was effect of congruency and correction, with shorter times associated, respectively, to the conditions in which line was congruent to the verb and correct graph. There was also effect of interaction. In eye tracking experiment, accuracy rates, number of fixations, total fixation duration and the scanpath in areas of interest were analysed. In relation to accuracy rates, similar to psyscope experiment, more difficulty in processing was associated to incongruent/incorrect condition, in which there is a break in the expectation related to the line position (vs.verb) and the common organization of the elements displayed in x axis. Concerning eye movements, in the graph area, number of fixations and total fixation duration were higher in correct conditions; in the sentence area, these results were opposite. Analyzing the scanpath, data suggest that linguistic information is accessed first, guiding the graph reading. To conclude, it s possible to state that the cost of integration is determined by compatibility (or not) between the propositions from both linguistic and visual modules.

[pt] Este trabalho visa investigar o processo de produção e revisão textuais de resumos acadêmicos na graduação através de uma reflexão teórica pautada em gêneros textuais e modelos processuais da escritura. Levamos em conta como os alunos realizam a sumarização, que operações línguísticas e estratégias de produção são mais utilizadas, com que conceito de revisão têm trabalhado e até que ponto esses fatores influenciam a qualidade textual. A escrita de textos acadêmicos tem se mostrado um desafio a universitários de todas as áreas, cada vez mais despreparados para o manejo dos diferentes gêneros nesse âmbito. Dentre esses, destaca-se o resumo, cujo domínio torna-se imprescindível por pressupor uma série de habilidades básicas de leitura e escrita. A metodologia adotada consiste numa análise de dados a partir de uma atividade escrita de produção de resumos realizada com dois grupos de alunos e que faz uso da ferramenta computacional Camtasia Studio. A estruturação dos resumos refletiu a organização discursiva do original. Os alunos fizeram amplo uso de paráfrase, cuja manifestação ocorreu predominantemente sob forma de sinonímia e alterações sintáticas. A sumarização foi marcada por diversos apagamentos, na maioria de orações consideradas acessórias (adjetivas e adverbiais), refletindo parcialmente o critério de extração de sumarizadores eletrônicos. Em boa parte, as proposições tomadas como mais relevantes corresponderam aos tópicos frasais do original e foram mais facilmente reconhecidas quando expressas em ordem direta e numa posição previsível. A revisão revelou predomínio de um processamento monitorado da escrita, com operações de revisão sendo executadas durante a produção. / [en] This research aims at investigating the process of writing and revising academic summaries in grad courses by focusing on fundamental concepts in textual genres and writing process models. We considered how students perform summarization, which linguistic features and production strategies they use the most, which concepts of revision they have, and to what extent these factors influence the text’s quality and effectiveness. Academic writing has proven to be a challenge among university students, who, regardless of their field, seem less and less prepared to cope with the different genres in grad contexts. The academic summary is a genre that stands out in this regard, since it involves mastering a set of basic reading and writing abilities required in the writing of more complex genres. The methodology is based on an analysis of data obtained from a writing activity regarding summary writing carried out with two groups of students and with the use of the Camtasia Studio software. Summaries’ structuring was similar to the source text’s discursive organization. Students used lots of paraphrasing, mainly through synonyms and syntactic modifications. Summarization was characterized by lots of deletions, mostly clauses that are considered accessorial (adjective and adverbial), thus partly reflecting electronic summarization extraction patterns. Generally, propositions that were considered the most relevant matched the source text’s phrasal topics and were more easily recognized when written in direct order and appearing in a predictable position. Revision as a monitored writing process prevailed as a concept, with revision operations being performed during text production.

Mass murder in the United States is increasing, yet understanding of mass murderers is still relatively limited. Many perpetrators compose manifestos, which include journals, blogs, letters, videos, and other writings. Previous research has indicated that personal messages are of great social and psychological importance; however, there remains an important gap in the current literature regarding studies specific to these manifestos. As such, the purpose of this qualitative multiple case study was to provide greater understanding of mass murderers' motives and mindsets through psycholinguistic analysis of their recorded words. The constructivist conceptual framework enabled gathering, analyzing, interpreting, and reporting thematic language from a purposeful sample of 12 American mass murderer manifestos, all of which were freely available online. The 6 research questions aligned with 6 psycholinguistic themes: ego survival and revenge; pseudocommando mindset: persecution, envy, obliteration; envy; nihilism; entitlement; and heroic revenge fantasy. Descriptive and analytical coding allowed for the identification of sentences and passages representative of each theme. Findings revealed a high degree of support for nihilism and ego survival and revenge, moderate support for heroic revenge fantasy and pseudocommando mindset, and limited support for entitlement and envy. These findings contribute to the existing literature, enhancing social change initiatives through increased understanding of mass murderers' communications and prompting further needed research. With greater awareness comes the potential for early identification and intervention, which may favorably impact psychology and law enforcement professionals and at-risk individuals.

Objective: A neuroscientific picture-word task was used to investigate semantic and phonological activation spreading in adults who stutter (AWS). Method: Fourteen AWS and 14 adults who do not stutter (AWNS) participated. On each trial, a picture was named at a delay. Sometimes, an attended probe word was heard before naming. Some probes were Semantically-Related to the labels. Those same probes also appeared following pictures with Unrelated labels. N400 ERPs recorded to these two probe types were compared (Semantically-Related versus Unrelated). Other probes were Phonologically-Related to the labels. Those same probes also appeared following pictures with unrelated labels (P-Unrelated). N400 ERPs recorded to these two probe types were compared (Phonologically-Related versus P-Unrelated). Results: AWNS exhibited typical N400 priming effects. AWS exhibited non-robust Semantic N400 priming, and a reverse Phonological N400 priming effect. Conclusions: Results suggest that AWS use attentional control strategies to influence the activation of words in the mental lexicon.

Research paper (M.A.) -- Cardinal Stritch College -- Milwaukee, 1968. / A research paper submitted in partial fulfillment of the requirements for the degree of Master of Arts in Education (Education of Mentally Handicapped). Includes bibliographical references (p. 27-28).

Statistical parametric text-to-speech synthesis currently relies on predefined and highly controlled prompts read in a “neutral” voice. This thesis presents work on utilising recordings of free conversation for the purpose of filled pause synthesis and as an inspiration for improved general modelling of speech for text-to-speech synthesis purposes. A corpus of both standard prompts and free conversation is presented and the potential usefulness of conversational speech as the basis for text-to-speech voices is validated. Additionally, through psycholinguistic experimentation it is shown that filled pauses can have potential subconscious benefits to the listener but that current text-to-speech voices cannot replicate these effects. A method for pronunciation variant forced alignment is presented in order to obtain a more accurate automatic speech segmentation something which is particularly bad for spontaneously produced speech. This pronunciation variant alignment is utilised not only to create a more accurate underlying acoustic model, but also as the driving force behind creating more natural pronunciation prediction at synthesis time. While this improves both the standard and spontaneous voices the naturalness of spontaneous speech based voices still lags behind the quality of voices based on standard read prompts. Thus, the synthesis of filled pauses is investigated in relation to specific phonetic modelling of filled pauses and through techniques for the mixing of standard prompts with spontaneous utterances in order to retain the higher quality of standard speech based voices while still utilising the spontaneous speech for filled pause modelling. A method for predicting where to insert filled pauses in the speech stream is also developed and presented, relying on an analysis of human filled pause usage and a mix of language modelling methods. The method achieves an insertion accuracy in close agreement with human usage. The various approaches are evaluated and their improvements documented throughout the thesis, however, at the end the resulting filled pause quality is assessed through a repetition of the psycholinguistic experiments and an evaluation of the compilation of all developed methods.

[pt] Esta dissertação tem por objetivo analisar como ocorre a interação entre informações de ordens linguística e visual em experimentos de compreensão de linguagem. Sentenças do português nas vozes ativa e passiva e com verbos de perspectiva (perseguir/fugir) foram analisadas a partir da técnica de comparação sentença-imagem, com manipulação de posição ocupada na imagem pelo personagem correspondente ao sujeito da sentença (esquerda vs. direita) e também do papel temático (agente/fonte vs. paciente/alvo) de um dos personagens sobre o qual recaía um recurso de manipulação de atenção visual. Do ponto de vista teórico, proble-matizou-se a interação entre conteúdos proposicionais oriundos do processamento visual e linguístico com base em uma articulação entre a faculdade da linguagem no sentido amplo (Hauser, Chomsky & Fitch, 2002) e a teoria da modularidade da mente (Fodor, 1983). Os resultados de dois experimentos realizados com falantes de português sugerem que, no mapeamento sentença-imagem, a posição do personagem correspondente ao sujeito não parece ser um fator relevante, a não ser em estruturas mais complexas, como no caso de sentenças envolvendo verbos de perspectiva em que o papel temático do sujeito não é prototípico. Em relação a papel temático, o fato de o foco atencional numa imagem estar sobre um elemento que corresponde a um sujeito com papel prototípico de agente parece facilitar o proces-samento. Quanto aos tipos de estrutura, como já verificado na literatura psicolin-guística, estruturas ativas parecem ser menos complexas do que passivas e facilitam o mapeamento visual. Quanto à expressão de perspectiva, verbos de perspectiva que empreendem um sujeito paciente/alvo parecem demandar maior custo de pro-cessamento, possivelmente em função de questões de acesso e representação lexical associadas a esses verbos. / [en] This dissertation aims to analyze how the interface between linguistic and visual information occurs based on language comprehension experiments. Active and passive voice sentences, as well as perspective predicates were analyzed using a sentence-image verification technique. The position of the characters representing the subject were manipulated (left-right orientation), and so were their theme roles (agent/source vs. patient/target) by means of attention manipulation. The proposi-tional theory, a relation between the faculty of language in the broad sense (Hauser, Chomsky and Fitch, 2002) and the modularity of mind theory (Fodor, 1983) were presented so as to explain how the interface between linguistic and visual information occurs. Our experiments were carried out with Portuguese speakers, and results indicate that during sentence-image mapping, left-right orientation does not seem to be a relevant factor, except for more complex structures, such as perspec-tive predicates where the subject s theme role is not prototypical. As for theme roles, the attention manipulation on the subject character seems to facilitate lan-guage processing. As for sentence types, active voice sentences seem to be pro-cessed more easily than passive ones. Perspective predicates whose subjects take a passive/target role seem to demand higher processing costs, possibly because of lexical access and representation.

Identification and selection of a speech-language caseload in the school setting can be a challenging task. The initial stages of caseload selection are usually in the form of a screening procedure. Although speech-language information is gathered at that time, information about its relationship to each student's academic status is usually not obtained. Such information would be useful in a setting that requires the provision of special education services to be justified from a basis of academic need.

京都大学 / 新制・課程博士 / 博士(人間・環境学) / 甲第25380号 / 人博第1122号 / 新制||人||261(附属図書館) / 京都大学大学院人間・環境学研究科共生人間学専攻 / (主査)准教授 金丸 敏幸, 教授 谷口 一美, 教授 守田 貴弘, 准教授 大谷 直輝 / 学位規則第4条第1項該当 / Doctor of Human and Environmental Studies / Kyoto University / DGAM

This study was conducted to investigate the relationship between the subtests of the Wechsler Intelligence Scale for Children (WISC) and the Illinois Test of Psycholinuistic Abilities (ITPA) and to investigate whether High Verbal-Low Performance (HV-LP) scorers on the WISC score significantly higher on certain ITPA subtests than High Performance-Low Verbal (HP-LV) scorers, and whether HP-LV scorers on the WISC score significantly higher on certain other subtests of the ITPA. Two main hypotheses were investigated in an effort to accomplish these purposes.