NEUROSCIENCE
Electrophysiological Signatures of Multisensory Temporal Processing
in the Human Brain
David Michael Simon
Dissertation under the direction of Professor Mark T. Wallace
Events in the natural world frequently generate sensory signals in more than one sensory modality. Multisensory integration, the process of combining these signals into a single coherent perceptual representation, conveys numerous behavioral and perceptual benefits. Integration of audiovisual inputs is particularly relevant to everyday function, as many ecologically important signals such as speech have both auditory and visual elements. To accomplish appropriate integration of audiovisual speech inputs, the nervous system utilizes a number of cues, one of which is the temporal relationship between the auditory and visual signals. We investigated the neurophysiological bases of how the brain uses temporal information to appropriately integrate audiovisual speech inputs using a combination of psychophysics and electroencephalography (EEG). This series of investigations elucidated that, for ecologically valid speech signals, the brain uses temporal concordance to reduce the magnitude of auditory cortical responses and increase the efficiency of cortical processing. Furthermore, we demonstrate that when temporal relationships are task relevant, the neural signals associated with temporal processing are distributed to other brain regions through the formation of functional neural networks. Lastly, perceptual plasticity at the single trial level during temporal processing was found to be associated with changes in the physiological signatures of sensory evidence accumulation in decisional circuits. These experiments offer unique insights into how the brain utilizes temporal concordance to control multiple levels of sensory integration which span low-level cortical responses, transfer of temporal information to higher cognitive systems, and the formation of flexible perceptual decisions. Together they offer the first comprehensive physiological characterization of audiovisual temporal processing in the human brain.
| Identifer | oai:union.ndltd.org:VANDERBILT/oai:VANDERBILTETD:etd-03192018-100046 |
| Date | 22 March 2018 |
| Creators | Simon, David Michael |
| Contributors | Mark Wallace, Geoffrey Woodman, Ramnaryan Ramachandran, Frank Tong |
| Publisher | VANDERBILT |
| Source Sets | Vanderbilt University Theses |
| Language | English |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | http://etd.library.vanderbilt.edu/available/etd-03192018-100046/ |
| Rights | unrestricted, I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to Vanderbilt University or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report. |
Page generated in 0.0016 seconds