Background. In everyday life it is often required to integrate multisensory input to successfully conduct response inhibition (RI) and thus major executive control processes. Both RI and multisensory processes have been suggested to be altered in autism spectrum disorder (ASD). It is, however, unclear which neurophysiological processes relate to changes in RI in ASD and in how far these processes are affected by possible multisensory integration deficits in ASD. Method. Combining high-density EEG recordings with source localization analyses, we examined a group of adolescent ASD patients (n = 20) and healthy controls (n = 20) using a novel RI task. Results. Compared to controls, RI processes are generally compromised in adolescent ASD. This aggravation of RI processes is modulated by the content of multisensory information. The neurophysiological data suggest that deficits in ASD emerge in attentional selection and resource allocation processes related to occipito-parietal and middle frontal regions. Most importantly, conflict monitoring subprocesses during RI were specifically modulated by content of multisensory information in the superior frontal gyrus. Conclusions. RI processes are overstrained in adolescent ASD, especially when conflicting multisensory information has to be integrated to perform RI. It seems that the content of multisensory input is important to consider in ASD and its effects on cognitive control processes.

Comment le cerveau intègre-t-il toutes les informations sensorielles qu'il reçoit en une perception cohérente de l'environnement ? Cette intrigante et importante question en neuroscience n’est pas élucidée et a inspiré ce travail de thèse. Plus précisément, mon objectif a été d’étudier les modifications cérébrales induites par l’apprentissage d’une association entre un son et une odeur. Inhabituelle chez l’homme, hormis dans l’alimentation, cette association est pourtant fréquente chez l’animal, pour la détection de prédateurs par exemple. Mais sons et odeurs permettent surtout d'étudier les mécanismes cérébraux nécessaires à l'association entre deux sens très différents : le système auditif traite l’information en temps réel tandis que le système olfactif est lent et rythmé par la respiration. Ce travail de thèse était centré autour de la question suivante : comment le cerveau traite-t-il les interactions multisensorielles audio-olfactives ? En enregistrant l’activité de potentiel de champs local de plusieurs structures cérébrales chez des rats en train d’apprendre cette association, nous avons pu mettre en évidence un potentiel rôle des oscillations neuronales béta (15-35 Hz), dans le traitement et la mise en mémoire des différentes informations sensorielles. Ces oscillations représenteraient un lien fonctionnel entre aires cérébrales distantes, permettant l’intégration et l’association d'informations de natures très différentes. / Multisensory interactions are constantly present in our everyday life and allow a unified representation of environment. Cross modal integration is often studied in multisensory associative brain regions, but recent findings suggest that most of the brain could be multisensory. But at this time, we still don’t know how the brain deals with information from different sensory systems. In this project, we want to understand whether the establishment of neuronal oscillations can functionally connect sensory regions and take part of the multisensory integration, and how this connection is built up by learning. For this, we examine changes in the cortical network involved in the acquisition of a multisensory association between a sound and an odor in rats through the analysis of the local field potentials’ oscillations The originality of the project is to sample a large network of brain structures including primary sensory cortex (primary auditory cortex, olfactory bulb) and multimodal areas towards which converge these two senses: the piriform and perirhinal cortices. We have developed a behavioral GO/NO GO test in which the rat must combine simultaneous auditory and olfactory informations to succeed. Data and brain signals obtained in this task suggest that the power of oscillations in beta frequency band within the olfactory areas and the coherences of oscillations between these areas are modified by the multisensory learning.

Nous percevons mieux notre corps et notre environnement si l’on tient compte de plusieurs sources sensorielles en même temps. Mais tous les systèmes sensoriels déclinent progressivement au cours du vieillissement. Cette thèse a contribué à mieux comprendre comment les perceptions multisensorielles et les réseaux cérébraux qui les sous-tendent sont modifiés chez la personne âgée. Ce travail souligne l’existence d’une repondération des informations sensorielles et une facilitation générale des processus d’interaction entre les sens pour optimiser la perception des mouvements du corps ou la perception de textures dès 65 ans. Au niveau cérébral, l'effondrement des processus inhibiteurs avec l'âge entrainerait une moins bonne sélection des réseaux et expliquerait les troubles perceptifs. Néanmoins, les personnes âgées pourraient bénéficier d’un recrutement cérébral moins spécifique pour surmonter au moins partiellement ces déclins sensoriels. / We can better perceive our body and our environment if we take into account several sensory sources at the same time. However, all sensory systems gradually decline with aging. This thesis contributes to a better understanding of how multisensory perceptions and the underlying brain networks are modified in the elderly. This work highlights both a reweighting of sensory information and a general facilitation of interaction processes between the senses to optimize the perception of body movements or the perception of textures as soon of 65 years old. At the brain level, the break-down of inhibitory processes with age would lead to a poorer selection of networks and would explain perceptual disorders. Nevertheless, older people could benefit from less specific brain recruitment to at least partially compensate these sensory declines.

The present study aimed to investigate intranasal trigeminal sensitivity in a large sample of patients with anosmia due to different etiologies. We investigated the trigeminal detection threshold for formic acid in healthy controls (n = 96) and patients with anosmia due to head trauma (n = 18) or sinonasal disease (n = 54). Anosmics exhibited higher thresholds compared with normosmics (p < 0.001). In addition, thresholds were found to be higher in patients with posttraumatic anosmia compared to anosmics with sinonasal disease (p < 0.001). The data indicate that (1) loss of olfactory sensitivity in humans may be associated with a decreased sensitivity towards trigeminal stimuli and (2) alteration of intranasal trigeminal function is stronger in patients with posttraumatic anosmia compared to patients with sinonasal disease. This may have implications for the medicolegal investigation of anosmic patients where trigeminal stimuli are frequently used to assess the patient’s response bias. / Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG-geförderten) Allianz- bzw. Nationallizenz frei zugänglich.

Contexte et objectif:C’est presque une banalité que de dire qu’une des caractéristiques principales de la parole est sa variabilité : variabilité inter-sexe, inter-locuteur, mais aussi variabilité d’un contexte à un autre ou d’une répétition à une autre pour un même sujet. C’est cette variabilité qui fait à la fois la beauté de la parole mais aussi la complexité de son traitement par les technologies vocales, et la difficulté pour en comprendre les mécanismes. Dans cette thèse nous étudions certains aspects de cette variabilité, avec comme point de départ la variabilité observée chez un locuteur dans la répétition d’un même son dans les mêmes conditions, que nous appelons variabilité intrinsèque.Les modèles de contrôle moteur de la parole abordent principalement la variabilité contextuelle de la parole mais prennent rarement en compte sa variabilité intrinsèque, alors même que l’on sait que c’est cette variabilité qui donne à la parole tout son caractère naturel. Dans le contexte général du contrôle moteur, l’origine précise de la variabilité intrinsèque reste peu comprise et controversée. Cependant, une hypothèse courante est que la variabilité intrinsèque serait essentiellement due à du bruit neuronal dans la chaine d’exécution.L’objectif principal de cette thèse est d’aborder la variabilité intrinsèque et contextuelle de la production de la parole dans un cadre formel intégrateur. Pour cela nous faisons l’hypothèse que la variabilité intrinsèque n’est pas que le résultat d’un bruit d’exécution, mais qu’elle résulte aussi d’une stratégie de contrôle où la variabilité inter-répétition fait partie intégrante de la représentation de la tâche.Méthodologie:Nous formalisons cette idée dans un cadre computationnel probabiliste, la modélisation Bayésienne, où l’abondance de réalisations possibles d’un même item de parole est représentée naturellement sous la forme d’incertitudes, et où la variabilité est donc manipulée formellement. Nous illustrons la pertinence de cette approche à travers trois contributions.Résultats:Dans un premier temps, nous reformulons un modèle existant de contrôle optimal de la parole, le modèle GEPPETO, dans le formalisme probabiliste et démontrons que le modèle Bayésien contient GEPPETO comme un cas particulier. En particulier, nous illustrons comment l’approche Bayésienne permet de rendre compte de la variabilité intrinsèque tout en incluant les mêmes principes d’émergence et de structuration de la variabilité contextuelle proposés par GEPPETO.Dans un deuxième temps, le formalisme nous permet de dépasser le cadre de GEPPETO en y intégrant une composante somatosensorielle dans la représentation des buts. Cela permet d’introduire une variabilité interindividuelle sur la préférence sensorielle, c’est-à-dire la modulation des poids relatifs des cibles auditives et somatosensorielles, et permet d’expliquer la variabilité de compensation observée dans les études de perturbation sensorielle. Cette étape a nécessité l’élaboration d’hypothèses sur l’intégration des retours sensoriels dans la planification, dont nous avons cherché à évaluer la pertinence en concevant une expérience originale de production-perception de parole.Dans un troisième temps, nous exploitons le formalisme pour réinterpréter des données expérimentales récentes qui mettent en évidence un changement perceptif consécutif à un apprentissage moteur induit par une altération du retour auditif. Cela est rendu possible grâce à la représentation unifiée des connaissances dans le modèle, qui permet d’intégrer la production et la perception dans un cadre formel unique.L’ensemble de ces travaux illustre la capacité du formalisme Bayésien à proposer une démarche systématique et structurée pour la construction des modèles. Cette démarche facilite le développement des modèles et leur complexification progressive en précisant et explicitant les hypothèses formulées. / Context and goal:It is almost a truism to affirm that one of the main features of speech is its variability: variability inter-gender, inter-speaker, but also variability from one context to another, or from one repetition to another for a given subject. Variability underlies at the same time the beauty of speech, the complexity of its treatment by speech technologies, and the difficulty for understanding its mechanism. In this thesis we study certain aspects of speech variability, our starting point being the variability characterizing the repetitions of a given utterance by a given subject, in a given condition, which we call intrinsic variability.Models of speech motor control have mainly focused on the contextual aspects of speech variability, and have rarely considered its intrinsic component, even though it is this fundamental component of variability that gives speech it naturalness. In the general context of motor control, the precise origin of the intrinsic variability of our movements remains controversial and poorly understood, however, a common assumption is that intrinsic variability would mainly originate from neural and muscular noise in the execution chain.The main goal of this thesis is to address the contextual and intrinsic component of speech variability in an integrative computational framework . To this aim, we postulate that the main component of the intrinsic variability of speech is not just execution noise, but that it results from a control strategy where intrinsic variability characterizes the abundance of possible productions of the intended speech item.Methodology:We formalize this idea in a probabilistic computational framework, Bayesian modeling, where the abundance of possible realizations of a given speech item is naturally represented as uncertainty, and where variability is thus formally manipulated. We illustrate the pertinence of this approach with three main contributions.Results:Firstly, we reformulate in Bayesian terms an existing model of speech motor control, the GEPPETO model, and demonstrate that this Bayesian reformulation, which we call B-GEPPETO, contains GEPPETO as a particular case . In particular, we illustrate how the Bayesian approach enables to account for the intrinsic component of speech variability while including the same principles proposed by GEPPETO for the emergence and structuration of its contextual component.Secondly, the Bayesian framework enable us to go beyond and extend B-GEPPETO in order to include a multisensory characterization of speech motor goals, with auditory and somatosensory components. We apply this extension to explore variability in the context of compensations to sensory-motor perturbation in speech production. We account for differences in compensation as sensory preferences implemented by modulating the relative contribution of each sensory modality in the model . The somatosensory characterization of speech motor goals involved a certain number of hypotheses that we intended to evaluate with two experimental studies.Finally, in our third contribution we exploit the formalism for the reinterpretation of recent experimental observations concerning perceptual changes following speech motor adaptation to auditory perturbations. This original analysis is made possible thanks to the unified representation of knowledge in the model, which enables to account for production and perception processes in a single computational framework.Taken together, these contributions illustrate how the Bayesian framework offers a structured and systematic approach for the construction of models in cognitive sciences . The framework facilitates the development of models and their progressive complexification by specifying and clarifying underlying assumptions.

No description available.

<div> <p><br></p> </div> Individuals with disabilities and persons operating in inaccessible environments can greatly benefit from the aid of robotic manipulators in performing activities of daily living (ADLs) and other remote tasks. Users relying on robotic manipulators to interact with their environment are restricted by the lack of sensory information available through traditional operator interfaces. These interfaces only allow visual task access and deprive users of somatosensory feedback that would be available through direct contact. Multimodal sensory feedback can bridge these perceptual gaps effectively. Given a set of object properties (e.g. temperature, weight) to be conveyed and sensory modalities (e.g. visual, haptic) available, it is necessary to determine which modality should be assigned to each property for an effective interface design. However, the effectiveness of assigning properties to modalities has varied with application and context. The goal of this study was to develop an effective multisensory interface for robot-assisted pouring tasks, which delivers nuanced sensory feedback while permitting high visual demand necessary for precise teleoperation. To that end, an optimization approach is employed to generate a combination of feedback properties to modality assignments that maximizes effective feedback perception and minimizes cognitive load. A set of screening experiments tested twelve possible individual assignments to form the combination. Resulting perceptual accuracy, load, and user preference measures were input into a cost function. Formulating and solving as a linear assignment problem, a minimum cost combination was generated. Results from experiments evaluating efficacy in practical use cases for pouring tasks indicate that the solution is significantly more effective than no feedback and has considerable advantage over an arbitrary design. <br>

No description available.

The following qualitative study sought to answer three questions: (1) What are the high priority design values used by expert exhibit developers to create meaningful exhibits at children's museums? (2) How do exhibit developers prioritize these design values? (3) What are the desirable outcomes that exhibit developers seek to achieve with the guests who interact with the exhibits? These questions were answered through interviews with children's museum exhibit developers, personal observations, and artifact analysis. The data collected was organized into four cases, each representing a different children's museum and corresponding exhibit developer. The cases were then compared against each other using multiple case study analysis as described by Stake (2006). The data revealed that most of the developers designed exhibits which promoted family learning by encouraging meaningful interactions between parents and children. Other high priority design values used by exhibit developers included physical engagement, multiple entry points, simplicity, durability, multisensory engagement, staff and volunteer facilitation, safety, and immersive environments. Successful museum exhibits empowered guests and were always created using multiple design values. This thesis may be downloaded for free at http://etd.byu.edu.

Voluntary actions affect subsequent perception. For example, an action that precedes an auditory stimulus is perceived to have occurred later in time than is actually the case, while the auditory stimulus is perceived earlier in time. This effect is known as intentional binding. Current literature regarding action effects focuses on perception of a single sensory modality while the effects on perception of multiple modalities remain largely unknown. The present thesis explored how actions influenced the timing of perceived multisensory events. Additionally, this thesis investigated differences in voluntary compared to involuntary actions on subsequent perception. In Chapter 2, action effects on perceived onsets of visual and tactile stimuli were explored. This question was extended to other bimodal pairs, including audiovisual and audiotactile, in Chapter 3. Lastly, in Chapter 4, action effects on temporal resolution were investigated. In all the experiments, participants performed a chosen or a fixed button press that followed a bimodal temporal order judgment (TOJ) task. To investigate the influence of spatial proximity between actions and stimuli on binding, in Chapters 2 and 3, each stimulus modality appeared on different sides. In Chapter 4, the critical stimuli appeared at the same location, either close to or far from the preceding action, to explore the effect of action on temporal resolution. The present data provide evidence that actions affect the perceived onsets of multisensory events in an idiosyncratic manner, depending on the subsequent stimuli. Actions appear to preferentially bind to vision, then touch, and lastly, audition, but actions do not always bind to subsequent stimuli. Furthermore, actions degrade temporal resolution of bimodal stimuli. Lastly, the type of action, whether chosen or fixed, did not impact the degree of binding. Together, these data contribute to the action-perception literature, illustrating that our behaviours dynamically affect how we perceive the world. / Dissertation / Doctor of Philosophy (PhD)