Bilingualism is becoming more common in world and, despite being much discussed their impact on the language, there s not much knowledge about the effect of different linguistic backgrounds in auditory processing skills. We know that, when a person is exposed to two languages, it increases speed and efficiency of information processing and, therefore, bilingual subject is benefited in development and recognition of patterns of important sounds for speech understanding. Investigate and compare performance of auditory skills in normal hearing adults with different levels of late bilingualism between them, and normal hearing monolingual people using behavioral and electrophysiological tests.This study is descriptive, quantitative and transversal. The sample was consisted of 65 subjects (Monolingual Group (MG) with 13 speakers of Portuguese; Teachers group (GT): 13 bilingual language - schools teachers - (Portuguese - English) and language school students at different levels of proficiency (Portuguese-English): 13 at advanced level (AG); 13 at intermediate level (IG); 13 at basic level (BG)) with normal hearing and no complaints about auditory processing abilities, aged 18-35 years. They were subjected to behavioral tests: Staggered Spondaic Word test (SSW), which evaluates attention skills, memory and figure-ground for verbal sounds; Random Gap Detection Test (RGDT) that assesses ability of temporal resolution; and electrophysiological test Long Latency Auditory Evoked Potential (LLAEP) with verbal stimuli (syllables / ba / - frequent stimulus and / di / - rare stimulus) evaluating memory, attention and auditory discrimination. In a general way, in analysis between groups, there were significant differences with higher values to age, SSW and lower values to RGDT for teachers, compared with monolinguals. Comparing students at different levels of English learning, there were higher values for RGDT and latency of component N1 for basic level of proficiency. Late bilinguals people have further development of attention ability and auditory memory, when compared to monolingual ones. In addition to that, there is an improvement in temporal resolution ability as English learning level increases. / O bilinguismo está cada vez mais comum no mundo e, apesar de ser bastante discutido o seu impacto sobre a linguagem, pouco se sabe sobre o efeito de diferentes origens linguísticas nas habilidades de processamento auditivo. Sabe-se que, quando uma pessoa é exposta a duas línguas, aumenta-se a velocidade e a eficácia do processamento da informação. Portanto, o sujeito bilíngue é beneficiado no desenvolvimento e reconhecimento dos padrões de sons importantes para a compreensão de fala. Esta dissertação visa investigar e comparar o desempenho de habilidades auditivas em indivíduos adultos normo-ouvintes com diferentes níveis de bilinguismo tardio entre si e em relação a normo-ouvintes monolíngues por meio de testes comportamentais e de teste eletrofisiológico. Esse estudo tem caráter descritivo, quantitativo e transversal. A amostra foi composta por 65 sujeitos: Grupo Monolíngue (GM): tre13ze indivíduos falantes da língua portuguesa; Grupo Professores (GP): 13 bilíngues professores de escolas de idiomas (português/inglês); alunos de escolas de idiomas em diferentes níveis de aprendizado (português/inglês): 13 no nível avançado (GA); 13 no nível intermediário (GI); 13 no nível básico (GB), com limiares auditivos tonais dentro dos limites da normalidade e sem queixas de habilidades de processamento auditivo, com idade entre 18 e 35 anos. Os sujeitos foram submetidos aos seguintes testes comportamentais: teste dicótico de dissílabos alternados (SSW), o qual avalia as habilidades de atenção, memória e figura-fundo para sons verbais; teste de detecção de gap (RGDT), que avalia a habilidade de resolução temporal; e teste eletrofisiológico potencial evocado auditivo de longa latência (PEALL) com estímulos verbais (sílabas /ba/ estímulo frequente e /di/ estímulo raro), a fim de avaliar memória, atenção e discriminação auditiva. De maneira geral, na análise entre grupos, houve diferenças significativas, com maiores valores de idade, SSW e menores valores de RGDT para os professores, quando comparados com os monolíngues. Comparando os alunos em diferentes níveis de aprendizado da língua inglesa, verificou-se maiores valores de RGDT e latência do componente N1 para o nível básico de proficiência. Concluiu-se que bilíngues tardios possuem aperfeiçoamento da habilidade de atenção e memória auditiva quando comparados aos monolíngues. Há, também, um aprimoramento da habilidade de resolução temporal conforme aumenta o nível de aprendizado da língua inglesa.

Made available in DSpace on 2016-03-15T19:41:23Z (GMT). No. of bitstreams: 1 Darlene Godoy de Oliveira.pdf: 3172504 bytes, checksum: 95d543d037f25f72c573d89ce7ccd732 (MD5) Previous issue date: 2014-07-31 / Coordenação de Aperfeiçoamento de Pessoal de Nível Superior / Developmental Dyslexia has a main deficit the effective word recognition, which is a complex cognitive processing due perceptual skills, language and later stages of syntactic and semantic integration. Among the wide range neurobiological evidence related this disorder in childhood and across life-span, event-related potential measures indicates differentiated pattern in amplitudes, latencies and hemispheric processing in different stages of sensory/perceptual, orthographic, phonologic and semantic processing. These electrophysiological evidences are related to behavioral deficits and to reading compensatory mechanisms in Dyslexia. The present thesis aimed to verify and compare the behavioral and electrophysiological pattern of adults (Study 1) and children and adolescents (Study 2) with and without Dyslexia during a Lexical Decision task. The sample of Study 1 comprised by 20 dyslexics and 23 normal readers with college degree. In Study 2, twenty dyslexic children and adolescents and twenty normal readers were included. All participants were matched for gender, age and educational level and performed a battery of intelligence, reading, writing and phonological awareness tasks. The lexical decision task was composed by regular high frequency words in Brazilian Portuguese, quasi-words derived from real words and pseudowords not derived from real words. Behavioral results in both studies revealed that dyslexics had worse accuracy and increased reaction times in all lexical categories. ERPs analysis of Study 1 indicated greater amplitudes in right P100 for both groups. The N170, N400 and LPC were reduces on the left hemisphere for dyslexics. N400 and LPC were higher for words and quasi-words, stimuli that are represented on orthographic and phonological lexicon. Correlations data in all sample verified reduced N170 and LPC left amplitudes associated with good performance in behavioral reading, writing and phonological awareness tests. GD with slow behavioral performance exhibited higher N170 and N400 on left hemisphere. Study 2 results indicated greater P100 on right hemisphere for all lexical categories in all sample, and reduced for DG. N170 were higher at left side and for quasi-words. N400 were higher for words and quasi-words, as well reduced in left hemisphere for DG. LPC were higher in left hemisphere for pseudowords and reduced in dyslexics. Correlational results revealed reduced left N170, N400 and LPC in dyslexics with slow behavioral performance. Controls with slow performance exibithed higher P100 amplitudes, as well higher left N400 if they had higher reading skills. Generally, ERP analysis indicated lacks of hemispheric specialization in dyslexics. The absence of ERP group differences on Study 2 can be related to developmental reading fluency processes, although we verified positive correlations between higher linguistic ERP amplitudes and better behavioral performances for both children and adults. We conclude that dyslexic children and adults present differenciated ERP amplitudes and hemispheric distribution during reading in Brazilian Portuguese. / A Dislexia do Desenvolvimento tem como déficit principal o reconhecimento eficaz de palavras, sendo este um processamento cognitivo complexo. Dentre as evidências neurobiológicas do transtorno, disléxicos apresentam alterações nos potenciais relacionados a eventos durante o reconhecimento de palavras, com padrão diferenciado de latência, amplitude e processamento hemisférico nos estágios sensório/perceptual, ortográfico, fonológico e semântico. Estes indicam déficits no processamento eletrofisiológico e uso de mecanismos compensatórios de leitura. Esta tese objetivou mensurar e comparar o padrão comportamental e eletrofisiológico de adultos (Estudo 1) e crianças e adolescentes (Estudo 2) com e sem Dislexia do Desenvolvimento durante uma tarefa de decisão lexical. Participaram do Estudo 1 vinte universitários disléxicos e vinte e três adultos bons leitores. Participaram do Estudo 2 vinte crianças e adolescentes disléxicos e vinte controles bom leitores. Os participantes foram pareados por sexo, idade e nível de escolaridade e realizaram uma bateria de testes de inteligência, leitura, escrita e consciência fonológica. A tarefa de decisão lexical foi composta por palavras regulares de alta frequência no português brasileiro, quase-palavras derivadas de palavras reais e pseudopalavras não derivadas. Os resultados comportamentais da tarefa de decisão lexical nos estudos indicaram pior acurácia, maior omissão e lentidão no julgamento dos itens de todas as classes lexicais pelos disléxicos. Análises dos ERPs no Estudo 1 indicaram maior amplitude do P100 no hemisfério direito em ambos os grupos. Os potenciais N170, N400 e LPC foram reduzidos no hemisfério esquerdo dos disléxicos. O N400 e o LPC foram mais pronunciados nas palavras e quase-palavras, estímulos com representação no léxico fonológico e ortográfico. Correlações com os dados da amostra total; indicaram menores amplitudes N170 e LPC no hemisfério esquerdo associadas à alta acurácia nos testes comportamentais de leitura, escrita e consciência fonológica, enquanto que no GD, o N170 e o N400 foram mais pronunciados no hemisfério esquerdo dos sujeitos mais lentos nas tarefas. Análises do Estudo 2 indicaram P100 maior no hemisfério direito em todas as categorias lexicais nos dois grupos, e reduzido no GD. O N170 tendeu a ser mais pronunciado no hemisfério esquerdo e nas quase-palavras. O N400 foi maior nas palavras e quase-palavras, sendo reduzido no hemisfério esquerdo do GD. O LPC foi maior no hemisfério esquerdo para as pseudopalavras e foi reduzido no GD. Foram encontradas correlações negativas entre amplitudes do N170, N400 e LPC esquerdo nos disléxicos com o tempo de execução nas tarefas comportamentais. No GC, o P100 foi maior nos sujeitos mais lentos e houve associação positiva dasamplitudes do N400 esquerdo e acurácia na leitura. No geral, as análises dos ERPs nos experimentos indicam déficits de especialização hemisférica em disléxicos. Ausências de diferenças entre os grupos do Estudo 2 nos ERPs analisados podem estar relacionadas a fatores desenvolvimentais da leitura, embora tanto em crianças como em adultos disléxicos já haja associação positiva entre bom desempenho comportamental e maiores amplitudes nos ERPs linguísticos. Conclui-se que crianças e adultos disléxicos apresentam padrão diferenciado de amplitudes e distribuição hemisférica em distintos ERPs durante a leitura no Português Brasileiro.

La navigation spatiale désigne la capacité de s'orienter et se repérer dans un environnement, et est particulièrement altérée chez les personnes âgées. Dans ce travail de thèse, nous proposons d'identifier les mécanismes sous-tendant le déclin de cette fonction chez les seniors. Nous avons comparé les performances de participants âgés à celles de sujets jeunes lors de tâches spatiales, et employé la technique des potentiels évoqués (PE) afin d’analyser les mécanismes neuronaux sous-jacents. Nous avons montré une atteinte de la localisation allocentrique chez les seniors, tandis que la localisation égocentrique semble préservée. Nous avons étudié l'efficience de processus visuo-perceptifs et attentionnels chez les sujets âgés. L'analyse des PE montre une préservation des processus perceptifs avec l'âge, tandis que les processus d'attention spatiale semblent particulièrement décliner. Enfin, les processus d'encodage spatial semblent également affectés chez les sujets âgés. / Spatial navigation refers to the ability to find one's way in complex environments, and is particularly affected in elderly individuals. We aimed to better understand the mechanisms underlying age-related deficits in spatial navigation, focusing on early cognitive processes. For this purpose, we compared performances obtained by elderly individuals above 60 years and by younger adults during spatial tasks, and used the event-related potentials (ERP) technique to investigate underlying neural processes. First, we found that allocentric localization is impaired in aging, whereas egocentric localization seems to be preserved. Then, we investigated the role of visuo-perceptive or attentional processes in spatial cognition, and their preservation in aging. ERP showed that perceptive processes seem to be preserved in elderly individuals, whereas spatial attention processes were impaired in these subjects. Finally, we showed that encoding processes are also particularly affected by aging.

L’objectif de ce travail de thèse a été d’avancer dans la compréhension des mécanismes par lesquels les émotions positives modulent cognition et comportement. En nous basant sur des mesures comportementales et électrophysiologiques, nous avons abordé ce questionnement chez des volontaires sains, et des personnes souffrant de schizophrénie, pathologie dans laquelle les affects n’influencent pas le comportement de manière appropriée. Nos résultats montrent que les émotions positives diminuent de manière globale la préparation attentionnelle, un des mécanismes de contrôle cognitif. Néanmoins, lorsqu’elles sont associées à un fort niveau de motivation, elles permettent au contraire une mobilisation plus importante du contrôle cognitif. Cette modulation du contrôle cognitif par les émotions positives est plus susceptible d’apparaitre chez les personnes présentant une tendance marquée à ressentir des émotions négatives. Chez les personnes souffrant de schizophrénie, cette modulation ne s’effectue pas de manière appropriée, y compris lorsque l’expérience affective positive est induite de manière non consciente. / The aim of this project was to deepen our understanding of the mechanisms by which positive emotions modulate cognition and behavior. By using behavioral and electrophysiological measures, we addressed this question in a population of healthy controls, and in patients suffering from schizophrenia, because in this disease affect does not appropriately modulate behavior. Our results show that positive emotions globally decrease attentional preparation, a cognitive control mechanism. Nevertheless, when associated with a high level of motivation, they allow for improved recruitment of cognitive control. This modulation of cognitive control by positive emotions is more likely to appear in individuals who have a marked tendency towards experiencing negative emotions. In patients suffering from schizophrenia, this modulation is not appropriate, not even for non-consciously induced positive affective experiences.

La particularité du temps est de n’être l’objet d’aucun système sensoriel, contrairement aux stimulations lumineuses ou sonores. Quelles sont les opérations cognitives, en dehors de l’horloge interne, qui sont impliquées dans le fait que nous soyons capables de dire qu’une durée est plus courte qu’une autre ? Quelle est la dynamique de ces processus ? Pour le déterminer, nous nous sommes basés sur l’étude du comportement et des potentiels évoqués dans des tâches de discrimination temporelle. Plusieurs objectifs ont été poursuivis. Premièrement, il s’agissait de déterminer les processus, ainsi que leur dynamique, pouvant être mis en évidence dans la manipulation de l’information temporelle. Un deuxième objectif consistait à préciser l’impact du contexte sur le recrutement et la dynamique de ces processus. Un dernier objectif était d’explorer l’effet de la durée présentée et celui de la consigne sur les processus impliqués dans le traitement temporel et sur leur dynamique. Les résultats principaux sont les suivants. Premièrement, des composantes évoquées frontopariétales indexaient la comparaison, la prise de décision, l’attention et la mémoire de travail. Deuxièmement, ces activités étaient modulées par la saillance perceptive. En outre, une durée particulièrement saillante permet de terminer la comparaison avant la fin du stimulus. Troisièmement, le contexte de présentation modulait les activités évoquées associées au moment où la décision est prise. En conclusion, cette thèse met en évidence que les processus à l’œuvre dans la perception temporelle ne sont pas spécifiques au traitement des durées, comme l’attention et la mémoire de travail. / The peculiarity of time is that it is not the object of any sensory system, contrary to the stimuli consisting of light or sound. What cognitive operations, apart from the internal clock, are involved in the fact that we are able to say that one duration is shorter than another? What is the dynamic of these processes? To determine it, we have based ourselves on the study of the behavior and the event-related potentials in several tasks of temporal discrimination. Several objectives were adressed. The first objective was to determining the processes and associated ERPs, as well as their dynamics that can be demonstrated in the manipulation of the temporal information. A second aim was to specify the impact of the context on recruitment and the dynamics of these processes. A final objective was to investigate the effect of the duration presented and that of the instruction on the processes involved in the temporal treatment as well as on their dynamics. The main results are as follows. First, frontoparietal event-related components indexed comparison, decision making, orientation of attention and working memory. Secondly, these activities were modulated by the perceptual salience of a duration. Moreover, a particularly salient duration allow the end of the comparison before the end of the stimulus. Third, the impact of the presentation context modulated the evoked activities associated at the time the decision is made. In conclusion, this thesis shows that the processes at work in time perception are not specific to the treatment of durations, such as attention and working memory.

Researchers are often interested in comparing brain activity between experimental contexts. Event-related potentials (ERPs) are a common electrophysiological measure of brain activity that is time-locked to an event (e.g., a stimulus presented to the participant). A variety of decomposition methods has been used for ERP data among them temporal exploratory factor analysis (EFA). Essentially, temporal EFA decomposes the ERP waveform into a set of latent factors where the factor loadings reflect the time courses of the latent factors, and the amplitudes are represented by the factor scores. An important methodological concern is to ensure the estimates of the condition effects are unbiased and the term variance misallocation has been introduced in reference to the case of biased estimates. The aim of the present thesis was to explore how exploratory factor analytic methods can be made less prone to variance misallocation. These efforts resulted in a series of three publications in which variance misallocation in EFA was described as a consequence of the properties of ERP data, ESEM was proposed as an extension of EFA that acknowledges the structure of ERP data sets, and regularized estimation was suggested as an alternative to simple structure rotation with desirable properties. The presence of multiple sources of (co-)variance, the factor scoring step, and high temporal overlap of the factors were identified as major causes of variance misallocation in EFA for ERP data. It was shown that ESEM is capable of separating the (co-)variance sources and that it avoids biases due to factor scoring. Further, regularized estimation was shown to be a suitable alternative for factor rotation that is able to recover factor loading patterns in which only a subset of the variables follow a simple structure. Based on these results, regSEMs and ESEMs with ERP-specific rotation have been proposed as promising extensions of the EFA approach that might be less prone to variance misallocation. Future research should provide a direct comparison of regSEM and ESEM, and conduct simulation studies with more physiologically motivated data generation algorithms.

Children learn their first language simply by listening to the linguistic utterances provided by their caregivers and other speakers around them. In order to extract meaning and grammatical rules from these utterances, children must track regularities in the input, which are omnipresent in language. The ability to discover and adapt to these statistical regularities in the input is termed statistical learning and has been suggested to be one of the key mechanisms underlying language acquisition. In this thesis, I investigated a special case of statistical learning, non-adjacent dependency (NAD) learning. NADs are grammatical dependencies between distant elements in an utterance, such as is and -ing in the sentence Mary is walking. I examined which factors play a role in the development of NAD learning by illuminating this process from different stand points: the first study compares NAD learning in the linguistic and the non-linguistic domain during the earliest stages of development, at 4 months of age. This study suggests that at this age, NAD learning seems to be domain-specific to language. The second study puts a spotlight on the development of NAD learning in the linguistic domain and proposes that there may be a sensitive period for linguistic NAD learning during early childhood. Finally, the third study shows that children can not only recall newly learned NADs in a test immediately following familiarization, but also recall them after a retention period, which is critical to show more long-term learning. Overall, the findings in this thesis further illuminate how NADs, as a spotlight into language acquisition, are learned, stored in memory, and recalled.

Brain-computer interfaces (BCIs) might restore communication to people severely disabled by amyotrophic lateral sclerosis (ALS) or other disorders. We sought to: 1) define a protocol for determining whether a person with ALS can use a visual P300-based BCI; 2) determine what proportion of this population can use the BCI; and 3) identify factors affecting BCI performance. Twenty-five individuals with ALS completed an evaluation protocol using a standard 6 × 6 matrix and parameters selected by stepwise linear discrimination. With an 8-channel EEG montage, the subjects fell into two groups in BCI accuracy (chance accuracy 3%). Seventeen averaged 92 (± 3)% (range 71-100%), which is adequate for communication (G70 group). Eight averaged 12 (± 6)% (range 0-36%), inadequate for communication (L40 subject group). Performance did not correlate with disability: 11/17 (65%) of G70 subjects were severely disabled (i.e. ALSFRS-R < 5). All L40 subjects had visual impairments (e.g. nystagmus, diplopia, ptosis). P300 was larger and more anterior in G70 subjects. A 16-channel montage did not significantly improve accuracy. In conclusion, most people severely disabled by ALS could use a visual P300-based BCI for communication. In those who could not, visual impairment was the principal obstacle. For these individuals, auditory P300-based BCIs might be effective.

La reconnaissance experte de l'expression faciale est cruciale pour l'interaction et la communication sociale. Le comportement, les potentiels évoqués (ERP), et les techniques d’oculométrie peuvent être utilisés pour étudier les mécanismes cérébraux qui participent au traitement visuel automatique. La reconnaissance d'expressions faciales implique non seulement l'extraction d'informations à partir de caractéristiques faciales diagnostiques, stratégie qualifiée de traitement local, mais aussi l'intégration d'informations globales impliquant des traitements configuraux. Des nombreuses recherches concernant le traitement des informations faciales émotionnelles il apparaît que l’interaction des traitements locaux et configuraux pour la reconnaissance des émotions est mal comprise. La complexité inhérente à l'intégration de l'information faciale est mise en lumière lorsque l'on compare la performance de sujets sains et d’individus atteints de schizophrénie, car ces derniers ont tendance à s’attarder sur quelques éléments locaux, parfois peu informatifs. Les différentes façons d'examiner les visages peuvent avoir un impact sur la capacité socio-cognitive de reconnaître les émotions. Pour ces raisons, cette thèse étudie le rôle des caractéristiques diagnostiques et configurales dans la reconnaissance de l'expression faciale. En plus des aspects comportementaux, nous avons donc examiné la dynamique spatiale et temporelle des fixations à l’aide de mesures oculométriques, ainsi que l’activité électrophysiologique précoce considérant plus particulièrement les composantes P100 et N170. Nous avons créé de nouveaux stimuli des esquisses par une transformation numérique de portraits photos en esquisses, pour des visages exprimant colère, tristesse, peur, joie ou neutralité, issus de la base Radboud Faces Database, en supprimant les informations de texture du visage et ne conservant que les caractéristiques diagnostiques (yeux et sourcils, nez, bouche). Ces esquisses altèrent le traitement configural en comparaison avec les visages photographiques, ce qui augmente le traitement des caractéristiques diagnostiques par traitement élémentaire, en contrepartie. La comparaison directe des mesures neurocognitives entre les esquisses et les visages photographiques exprimant des émotions de base n'a jamais été testée, à notre connaissance. Dans cette thèse, nous avons examiné (i) les fixations oculaires en fonction du type de stimulus, (ii) la réponse électrique aux manipulations expérimentales telles que l'inversion et la déconfiguration du visage. Concernant, les résultats comportementaux montrent que les esquisses de visage transmettent suffisamment d'information expressive (compte tenu de la présence des caractéristiques diagnostiques) pour la reconnaissance des émotions en comparaison des visages photographiques. Notons que, comme attendu, il y avait un net avantage de la reconnaissance des émotions pour les expressions heureuses par rapport aux autres émotions. En revanche, reconnaître des visages tristes et en colère était plus difficile. Ayant analysé séparément les fixations successives, les résultats indiquent que les participants ont adopté un traitement plus local des visages croqués et photographiés lors de la deuxième fixation. Néanmoins, l'extraction de l'information des yeux est nécessaire lorsque l'expression transmet des informations émotionnelles plus complexes et lorsque les stimuli sont simplifiés comme dans les esquisses. Les résultats de l’électroencéphalographie suggèrent également que les esquisses ont engendré plus de traitement basé sur les parties. Les éléments transmis par les traits diagnostiques pourraient avoir fait l'objet d'un traitement précoce, probablement dû à des informations de bas niveau durant la fenêtre temporelle de la P100, suivi d'un décodage ultérieur de la structure faciale dans la fenêtre temporelle de la N170. / Proficient recognition of facial expression is crucial for social interaction. Behaviour, event-related potentials (ERPs), and eye-tracking techniques can be used to investigate the underlying brain mechanisms supporting this seemingly effortless processing of facial expression. Facial expression recognition involves not only the extraction of expressive information from diagnostic facial features, known as part-based processing, but also the integration of featural information, known as configural processing. Despite the critical role of diagnostic features in emotion recognition and extensive research in this area, it is still not known how the brain decodes configural information in terms of emotion recognition. The complexity of facial information integration becomes evident when comparing performance between healthy subjects and individuals with schizophrenia because those patients tend to process featural information on emotional faces. The different ways in examining faces possibly impact on social-cognitive ability in recognizing emotions. Therefore, this thesis investigates the role of diagnostic features and face configuration in the recognition of facial expression. In addition to behavior, we examined both the spatiotemporal dynamics of fixations using eye-tracking, and early neurocognitive sensitivity to face as indexed by the P100 and N170 ERP components. In order to address the questions, we built a new set of sketch face stimuli by transforming photographed faces from the Radboud Faces Database through the removal of facial texture and retaining only the diagnostic features (e.g., eyes, nose, mouth) with neutral and four facial expressions - anger, sadness, fear, happiness. Sketch faces supposedly impair configural processing in comparison with photographed faces, resulting in increased sensitivity to diagnostic features through part-based processing. The direct comparison of neurocognitive measures between sketch and photographed faces expressing basic emotions has never been tested. In this thesis, we examined (i) eye fixations as a function of stimulus type, and (ii) neuroelectric response to experimental manipulations such face inversion and deconfiguration. The use of these methods aimed to reveal which face processing drives emotion recognition and to establish neurocognitive markers of emotional sketch and photographed faces processing. Overall, the behavioral results showed that sketch faces convey sufficient expressive information (content of diagnostic features) as in photographed faces for emotion recognition. There was a clear emotion recognition advantage for happy expressions as compared to other emotions. In contrast, recognizing sad and angry faces was more difficult. Concomitantly, results of eye-tracking showed that participants employed more part-based processing on sketch and photographed faces during second fixation. The extracting information from the eyes is needed when the expression conveys more complex emotional information and when stimuli are impoverished (e.g., sketch). Using electroencephalographic (EEG), the P100 and N170 components are used to study the effect of stimulus type (sketch, photographed), orientation (inverted, upright), and deconfiguration, and possible interactions. Results also suggest that sketch faces evoked more part-based processing. The cues conveyed by diagnostic features might have been subjected to early processing, likely driven by low-level information during P100 time window, followed by a later decoding of facial structure and its emotional content in the N170 time window. In sum, this thesis helped elucidate elements of the debate about configural and part-based face processing for emotion recognition, and extend our current understanding of the role of diagnostic features and configural information during neurocognitive processing of facial expressions of emotion.

Spoken language is produced with a great deal of variability with which listeners must be able to cope. One source of variation is coarticulation, which is due to articulatory planning and transitions between segments. Recently, the temporal features of coarticulation were investigated during a picture/spoken-word matching task by using spliced stimuli carrying either congruent or incongruent subphonemic cues at the CV juncture (Archibald & Joanisse, 2011). ERPs were recorded with attention paid to the phonological mapping negativity (PMN) (Connolly & Phillips, 1994; Newman & Connolly, 2004) – a prelexical response sensitive to violations of phonological expectations. Results found that the PMN varied in response to coarticulation violations and concluded that phonetic features in spoken words influence prelexical processing during word recognition. Using a written-/spoken-word paradigm, Arbour, 2012 controlled phonological shape by using onsets that were either fricatives or stops, hypothesizing that coarticulatory information would be differentially processed due to their temporal differences. Findings supported the PMN’s sensitivity to coarticulation but also showed that temporal and physical differences between onsets modulated the effect. These results raise the question of whether acoustic distance between vowels will modulate prelexical processing of speech as reflected by the PMN amplitude: the focus of the current study. Words were organized into minimal sets such that all onset/coda combinations appeared with each vowel provided that English words resulted. Vowels were one of /i, u, æ, ɑ/, maximizing acoustic distance (height and backness). Data from 20 subjects indicate that the PMN is sensitive to the degree of difference between the original and post-splice vowels. When the number of distinctive features changing is greater, the result is an earlier, more robust PMN. This suggests that the rate of speech recognition is not static but dynamic, and is dependent on likeness of subphonemic features. / Thesis / Master of Science (MSc)