No description available.

Submitted to the faculty of the University Graduate School in parital fulfillment of the requirements for the degree Master of Sciences in the School of Informatics, Indiana University, August 2005

Human information processing depends critically on continuous predictions about upcoming events, but the temporal convergence of expectancy-based top-down and input-driven bottom-up streams is poorly understood. We show that, during reading, event-related potentials differ between exposure to highly predictable and unpredictable words no later than 90 ms after visual input. This result suggests an extremely rapid comparison of expected and incoming visual information and gives an upper temporal bound for theories of top-down and bottom-up interactions in object recognition.

The main objective of this dissertation is to investigate the effects of acquiring a second language (L2) at later periods of language development and native-like homonym processing in the first language (L1) from the perspective of Event-Related brain Potentials (ERP) using a cross-modal lexical decision task. To date, there is a lack of neurophysiological investigations into the effect that acquiring an L2 can have on processing strategies in the L1, and whether or not there is a precise age at which L2 exposure no longer affects native-like language processing. As such, my goal is to pinpoint this sensitive period specifically for homonym processing. To achieve this, I will present and discuss the results of two studies. The first study employs behavioural response measures using a cross-modal lexical decision task where participants simultaneously heard a sentence and made a decision to a visually-presented pseudoword or real word. The second study employs ERP measures using a novel ERP paradigm which investigates not only the main objective of this dissertation, but the second objective as well. This second objective is for this dissertation to become the first to evaluate the outcome of combining the cross-modal lexical decision task with ERPs. The behavioural and neurophysiological results for the monolingual group support the Reordered Access Model (Duffy, Morris, & Rayner, 1988) while the results for the bilingual groups do not. The results of the current studies indicate that those bilinguals who acquired French as an L2 rather than as a second native L1 show increasing divergence from monolingual native speakers in L1 homonym processing, with later acquirers exhibiting an exponentially marked divergence. This was found even though the task was carried out in English, the L1 (or one of the L1s) of all participants. The diverging performances of the bilinguals from the monolinguals were apparent in behavioural responses as well as in the amplitude, scalp distribution, and latency of ERP components, These differences were unique to each group, which supports the hypothesis that the acquisition of an L2 influences processing in the L1 (Dussias & Sagarra, 2007). Specifically, the early and late bilingual groups exhibited a marked divergence from the monolingual group as they revealed syntactic priming effects (p<.001) as well as lexical frequency effects (p<.001). They also revealed the greatest P600-like effect as they processed target words which were inappropriately- related to the priming homonyms (such as skin in Richard had a shed in the back of the garden). This suggests a heightened sensitivity to surface cues due to the L2 influencing homonym processing in the L1 (Cook, 2003; Dussias & Sagarra, 2007). Comparatively, the monolingual group revealed equal N400-like effects for lexical ambiguities overall compared to the unrelated conditions, and a context-by-frequency-interaction slowing their processing of the target word that is appropriately-related to the subordinate reading of the priming homonym, suggesting that they are not as sensitive to these same surface cues. Importantly, these results confirm that using ERPs along with a cross-modal lexical decision task is a promising paradigm to further study language processing.

No description available.

The main objective of this dissertation is to investigate the effects of acquiring a second language (L2) at later periods of language development and native-like homonym processing in the first language (L1) from the perspective of Event-Related brain Potentials (ERP) using a cross-modal lexical decision task. To date, there is a lack of neurophysiological investigations into the effect that acquiring an L2 can have on processing strategies in the L1, and whether or not there is a precise age at which L2 exposure no longer affects native-like language processing. As such, my goal is to pinpoint this sensitive period specifically for homonym processing. To achieve this, I will present and discuss the results of two studies. The first study employs behavioural response measures using a cross-modal lexical decision task where participants simultaneously heard a sentence and made a decision to a visually-presented pseudoword or real word. The second study employs ERP measures using a novel ERP paradigm which investigates not only the main objective of this dissertation, but the second objective as well. This second objective is for this dissertation to become the first to evaluate the outcome of combining the cross-modal lexical decision task with ERPs. The behavioural and neurophysiological results for the monolingual group support the Reordered Access Model (Duffy, Morris, & Rayner, 1988) while the results for the bilingual groups do not. The results of the current studies indicate that those bilinguals who acquired French as an L2 rather than as a second native L1 show increasing divergence from monolingual native speakers in L1 homonym processing, with later acquirers exhibiting an exponentially marked divergence. This was found even though the task was carried out in English, the L1 (or one of the L1s) of all participants. The diverging performances of the bilinguals from the monolinguals were apparent in behavioural responses as well as in the amplitude, scalp distribution, and latency of ERP components, These differences were unique to each group, which supports the hypothesis that the acquisition of an L2 influences processing in the L1 (Dussias & Sagarra, 2007). Specifically, the early and late bilingual groups exhibited a marked divergence from the monolingual group as they revealed syntactic priming effects (p<.001) as well as lexical frequency effects (p<.001). They also revealed the greatest P600-like effect as they processed target words which were inappropriately- related to the priming homonyms (such as skin in Richard had a shed in the back of the garden). This suggests a heightened sensitivity to surface cues due to the L2 influencing homonym processing in the L1 (Cook, 2003; Dussias & Sagarra, 2007). Comparatively, the monolingual group revealed equal N400-like effects for lexical ambiguities overall compared to the unrelated conditions, and a context-by-frequency-interaction slowing their processing of the target word that is appropriately-related to the subordinate reading of the priming homonym, suggesting that they are not as sensitive to these same surface cues. Importantly, these results confirm that using ERPs along with a cross-modal lexical decision task is a promising paradigm to further study language processing.

Substantial research has been done on the electroencephalogram (EEG) neural signals generated by feedback within a simple choice task, and there is much evidence for the existence of a reward prediction error signal generated in the anterior cingulate cortex of the brain when the outcome of this type of choice does not match expectations. However, less research has been done to date on the neural responses to intermediate outcomes in a multi-step choice task. Here, I investigated the neural signals generated by a complex, non-deterministic task that involved multiple choices before final win/loss feedback in order to see if the observed signals correspond to predictions made by reinforcement learning theory. In Experiment One, I conducted an EEG experiment to record neural signals while participants performed a computerized task designed to elicit the reward positivity, an event-related brain potential (ERP) component thought to be a biological reward prediction error signal. EEG results revealed a difference in amplitude of the reward positivity ERP component between experimental conditions comparing unexpected to expected feedback, as well as an interaction between valence and expectancy of the feedback. Additionally, results of an ERP analysis of the amplitude of the P300 component also showed an interaction between valence and expectancy. In Experiment Two, I used machine learning to classify epoched EEG data from Experiment One into experimental conditions to determine if individual states within the task could be differentiated based solely on the EEG data. My results showed that individual states could be differentiated with above-chance accuracy. I conclude by discussing how these results fit with the predictions made by reinforcement learning theory about the type of task investigated herein, and implications of those findings on our understanding of learning and decision-making in humans. / Graduate

This dissertation investigates how grammatical functions in transitive sentences (i.e., `subject' and `direct object') are distributed in written Swedish discourse with respect to morphosyntactic as well as semantic and referential (i.e., prominence-based) information. It also investigates how assignment of grammatical functions during on-line comprehension of transitive sentences in Swedish is influenced by interactions between morphosyntactic and prominence-based information. In the dissertation, grammatical functions are assumed to express role-semantic (e.g., Actor and Undergoer) and discourse-pragmatic (e.g., Topic and Focus) functions of NP arguments. Grammatical functions correlate with prominence-based information that is associated with these functions (e.g., animacy and definiteness). Because of these correlations, both prominence-based and morphosyntactic information are assumed to serve as argument interpretation cues during on-line comprehension. These cues are utilized in a probabilistic fashion. The weightings, interplay and availability of them are reflected in their distribution in language use, as shown in corpus data. The dissertation investigates these assumptions by using various methods in a triangulating fashion. The first contribution of the dissertation is an ERP (event-related brain potentials) experiment that investigates the ERP response to grammatical function reanalysis, i.e., a revision of a tentative grammatical function assignment, during on-line comprehension of transitive sentences. Grammatical function reanalysis engenders a response that correlates with the (re-)assignment of thematic roles to the NP arguments. This suggests that the comprehension of grammatical functions involves assigning role-semantic functions to the NPs. The second contribution is a corpus study that investigates the distribution of prominence-based, verb-semantic and morphosyntactic features in transitive sentences in written discourse. The study finds that overt morphosyntactic information about grammatical functions is used more frequently when the grammatical functions cannot be determined on the basis of word order or animacy. This suggests that writers are inclined to accommodate the understanding of their recipients by more often providing formal markers of grammatical functions in potentially ambiguous sentences. The study also finds that prominence features and their interactions with verb-semantic features are systematically distributed across grammatical functions and therefore can predict these functions with a high degree of confidence. The third contribution consists of three computational models of incremental grammatical function assignment. These models are based upon the distribution of argument interpretation cues in written discourse. They predict processing difficulties during grammatical function assignment in terms of on-line change in the expectation of different grammatical function assignments over the presentation of sentence constituents. The most prominent model predictions are qualitatively consistent with reading times in a self-paced reading experiment of Swedish transitive sentences. These findings indicate that grammatical function assignment draws upon statistical regularities in the distribution of morphosyntactic and prominence-based information in language use. Processing difficulties in the comprehension of Swedish transitive sentences can therefore be predicted on the basis of corpus distributions.

Lo studio si prefigge di indagare il decoding simultaneo degli elementi vocali e della mimica facciale delle emozioni mediante i potenziali evocati corticali (ERPs), utilizzando un'ampia gamma di emozioni. Stimoli emotivi vocali e patterns mimici sono stati accoppiati in condizioni di congruenza o di incongruenza. Le variazioni ERPs e i tempi di risposta (TR) rilevati sono state sottoposti ad analisi univariata della varianza per misure ripetute (ANOVA). Alcuni fenomeni ERP sono altamente sensibili alla condizione di congruenza/incongruenza del pattern (con una maggiore ampiezza per stimoli congruenti rispetto a stimoli incongruenti) e costituiscono marker specifici dell'integrazione intersensoriale. In particolare, i dati permettono di riconoscere l'indice di media latenza P200 come un marker dell'integrazione intersensoriale di stimoli emotivi. Altri fenomeni, invece, maggiormente sensibili al contenuto emotivo, segnalano la presenza di processi cognitivi legati più in generale al decoding emotivo. I risultati indicano inoltre che l'integrazione, che nelle prime fasi di processamento è un fenomeno automatico, coinvolge successivamente processi decisionali intenzionali. Infine, è stato riscontrato che la condizione di congruenza provoca un effetto di riduzione dei TR per alcune delle emozioni analizzate (tristezza) ed un effetto inverso per un secondo gruppo di emozioni (paura, rabbia e sorpresa). Tale risultato viene discusso in riferimento al significato adattivo dei diversi correlati emotivi e dei rispettivi processi di decodifica cross-modale. / The study investigates the simultaneous processing of emotional tone of voice and emotional facial expression by event-related potentials (ERPs), through an ample range of different emotions. Auditory emotional stimuli and visual patterns were matched in congruous and incongruous pairs. ERPs variations and behavioral data (response time) were submitted to repeated measures analysis of variance (ANOVA). ANOVA showed numerous ERP effects, with different cognitive functions. Some of them, in particular the medium-latency P200, are highly sensible to pattern congruent/incongruent condition (with more intense amplitude for congruent rather then incongruent stimuli) and constitute intersensory integration specific markers. The other ERP effects, instead, are more sensible to the emotional content and signal the presence of cognitive processes that are more generally tied to the emotional decoding. Furthermore results show that, in the first processing phase, integration is an automatic and obliged phenomenon, while later it implies intentional decisional processes. Finally, a TR reduction was found for some congruous patterns (i.e. sadness) and an inverted effect for a second group of emotions (i.e. fear, anger, and surprise). Finally, behavioural results indicate that congruence causes a RT reduction for some emotions (sadness) and, on the contrary, an inverse effect for other emotions (fear, anger, surprise). This result is discussed with reference to different emotional correlates adaptive function and their respective cross-modal decoding processes.

L'objectif de cette thèse est d'étudier le développement du système lexico-sémantique chez les enfants monolingues et bilingues. La question posée est la suivante : quand et comment les significations des mots commencent à être reliées entre elles et à s'intégrer dans un système sémantique interconnecté. Dans un premier temps, trois études ont été menées chez des enfants monolingues français. L'Etude 1, a pour but d'observer si les mots sont organisés selon des liens taxonomiques (e.g., cochon - cheval). L'Etude 2 explore si l'effet d'amorçage sémantique est sous-tendu par des mécanismes cognitifs, comme les processus d'activation automatique et contrôlé. Puis enfin, l'Etude 3 observe si les mots sont organisés en fonction de leur distance de similarité sémantique (e.g., vache - mouton versus vache - cerf). Dans un deuxième temps, deux études ont été conduites chez des enfants apprenant deux langues simultanément. L'Etude 4 vise à déterminer si les mots sont taxonomiquement liés dans chacune des langues. L'Etude 5 explore si les mots présentés dans une langue activent leurs représentations sémantiques dans l'autre langue et vice versa. Dans le but de répondre à ces questions, le traitement lexico-sémantique a été étudié en utilisant deux techniques : l'eye-tracking et les potentiels évoqués (PEs). Ces deux techniques enregistrent lors de la présentation des mots des réponses comportementales (Etude 3) et neuronales (Etude 1, 2, 4 et 5) de haute résolution temporelle. Les Etudes 1 et 2 montrent que chez les monolingues les mots sont liés taxonomiquement à l'âge de 18 et 24 mois. Durant le développement du langage, les deux processus d'activation automatique et contrôlé sont impliqués dans le traitement des mots (Etude 2). L'Etude 3 montre qu'à 24 mois, les mots sont organisés dans le système lexico-sémantique en développement selon la distance des similarités sémantiques. L'Etude 4 montre que chez les enfants bilingues, le traitement sémantique ne diffère pas selon les deux langues, mais la topographie des PEs varie selon la langue traitée. L'Etude 5 montre que les mots présentés dans une langue activent leurs représentations sémantiques dans la deuxième langue et vice versa. Toutefois, la topographie des PEs est modulée selon la direction de traduction. Ces résultats suggèrent que l'acquisition de deux langues, bien qu'elle soit très précoce, requière deux ressources neuronales bien distinctes, sous-tendant ainsi le traitement lexico-sémantique des langues dominante et non-dominante. / The present doctoral research explored the developing lexical-semantic system in monolingual and bilingual toddlers. The question of how and when word meanings are first related to each other and become integrated into an interconnected semantic system was investigated. Three studies were conducted with monolingual French learning children which aimed at exploring how words are organized, that is, according to taxonomic relationships (e.g., pig - horse) and to semantic similarity distances between words (e.g., cow - sheep versus cow - deer), and whether cognitive mechanisms, such as automatic activation and controlled processes, underlie priming effects. An additional two studies conducted with children learning two languages simultaneously, aimed at determining, first, whether taxonomically related word meanings, in each of the two languages, are processed in a similar manner. The second goal was to explore whether words presented in one language activate words in another language, and vice versa. In an attempt to answer these questions, lexical-semantic processing was explored by two techniques: eye-tracking and event-related potentials (ERPs) techniques. Both techniques provide high temporal resolution measures of word processing but differ in terms of responses. Eye-movement measurements (Study III) reflect looking preferences in response to spoken words and their time-course, whereas ERPs reflect implicit brain responses and their activity patterns (Study I, II, IV, and V). Study I and II revealed that words are taxonomically organized at 18 and 24-month-olds. Both automatic and controlled processes were shown to be involved in word processing during language development (Study II). Study III revealed that at 24-month-olds, categorical and feature overlap between items underpin the developing lexical-semantic system. That is, lexical-items in each semantic category are organized according to graded similarity distances. Productive vocabulary skills influenced word recognition and were related to underlying cognitive mechanisms. Study IV revealed no differences in terms of semantic processing in the bilinguals¿ two languages, but the ERP distribution across the scalp varied according to the language being processed. Study V showed that words presented in one language activate their semantic representations in the second language and the other way around. The distribution of the ERPs depended, however, on the direction of translation. The results suggest that even early dual language experience yields distinct neural resources underlying lexical-semantic processing in the dominant and non-dominant languages during language acquisition.