We can hold conversations with people in environments where typically there are additional simultaneous talkers in background acoustic space or noise like vehicles on the street or music playing at a café on the sidewalk. This seemingly trivial everyday task is difficult for people with hearing deficits and is extremely hard to model in machines. This dissertation focuses on exploring the neural mechanisms of how the human brain encodes such complex acoustic environments and how cognitive processes like attention shapes processing of the attended speech. My initial experiments explore the representation of acoustic features that help us localize single sound sources in the environment- features like direction and spectrotemporal content of the sounds, and the interaction of these representations with each other. I play natural American English sentences coming from five azimuthal directions in space. Using intracranial electrocorticography (ECoG) recordings from the human auditory cortex of the listener, I show that the direction of sound and the spectrotemporal content are encoded in two distinct aspects of neural response, the direction modulates the mean of the response and the spectrotemporal features contributes to the modulation of neural response around its mean. Furthermore, I show that these features are orthogonal to each other and do not interact. This representation enables successful decoding of both spatial and phonetic information. These findings contribute to defining the functional organization of responses in the human auditory cortex, with implications for more accurate neurophysiological models of spatial speech processing. I take a step further to investigate the role of attention in encoding the direction and phonetic features of speech. I play a mixture of male and female spatialized talkers eg. male at left side to the listener and female at right side (talker’s locations switch randomly after each sentence). I ask the listener to follow a given talker e.g. follow male talker as they switch their location after each uttered sentence. While the listener performs this experiment, I collect intracranial EEG data from their auditory cortex. I investigate the bottom-up stimulus dependent and attention independent encoding of such a cocktail party speech and the top-down attention driven role in the encoding of location and speech features. I find a bottom-up stimulus driven contralateral preference in encoding of the mixed speech i.e. Left brain hemisphere automatically and predominantly encodes speech coming from right direction and vice-versa. On top of this bottom-up representation, I find that attended talker’s direction modulates the baseline of the neural response and attended talker’s voice modulates the spectrotemporal tuning of the neural response. Moreover, the modulation to attended talker’s location is present throughout the auditory cortex but the modulation to attended talker’s voice is present only at higher order auditory cortex areas. My findings provide crucially needed evidence to determine how bottom-up and top-down signals interact in the auditory cortex in crowded and complex acoustic scenes to enable robust speech perception. Furthermore, they shed light on the hierarchical encoding of attended speech that have implications on bettering the auditory attention decoding models. Finally, I talk about a clinical case study where we show that electrical stimulation to specific sites in planum temporale (PT) of an epilepsy patient implanted with intracranial electrode leads to enhancement in speech in noise perception. When noisy speech is played with such an electrical stimulation, the patient perceives that the noise disappears, and that the speech is similar to clean speech that they hear without any noise. We performed series of analysis to determine functional organization of the three main sub regions of the human auditory cortex- planum temporale (PT), Heschl’s gyrus (HG) and superior temporal gyrus (STG). Using Cortico-Cortical Evoked Potentials (CCEPs), we modeled the PT sites to be located between the sites in HG and STG. Furthermore, we find that the discriminability of speech from nonspeech sounds increased in population neural responses from HG to the PT to the STG sites. These findings causally implicate the PT in background noise suppression and may point to a novel potential neuroprosthetic solution to assist in the challenging task of speech perception in noise. Together, this dissertation shows new evidence for the neural encoding of spatial speech; interaction of stimulus driven, and attention driven neural processes in spatial multi-talker speech perception and enhancement of speech in noise perception by electrical brain stimulation.

The utilisation of navigation systems in cars has given rise to road safety concerns, and the design and functionality of such systems must therefore be adjusted to the users’ needs, since they have to divide their attention between driving and the operation of the navigation system. The study was aimed at finding the optimum system response time (SRT) which would enable a driver to focus as much as possible on the road while attaining an efficient task completion time using an electronic navigational system. The research project consists of two separate experiments and was completed by 10 subjects. Experiment 1 included a temporal reproduction task and a secondary memory task. The subjects had to memorise two symbols and then reproduce six time spans ranging from 1 to 30 s to provide a baseline measurement of their time estimation abilities. Experiment 2 consisted of a simulated automobile driving task. While driving in the simulator the subjects completed a memorising task displayed on a touch screen. The task was presented with seven different system response times (SRTs) ranging from 0 to 30 s. The effects of different SRTs on the eye movement from road to monitor, regarding the duration of fixation and the frequency of change were evaluated. The distribution of gazes to the secondary task was analysed to provide information about the time estimation performance in the driving simulator. Other dependent variables tested were the accuracy of selected items, memory game performance, drive performance and the subjective state of the test person. The results of this study can be employed to find the optimum duration of inter-task delays for in-vehicle technical devices. / Psychology / M.A. (Psychology)

Contemporary understanding of human visual spatial attention rests on the hypothesis of a top-down control sending from cortical regions carrying higher-level functions to sensory regions. Evidence has been gathered through functional Magnetic Resonance Imaging (fMRI) experiments. The Frontal Eye Field (FEF) and IntraParietal Sulcus (IPS) are candidates proposed to form the frontoparietal attention network for top-down control. In this work we examined the influence patterns between frontoparietal network and Visual Occipital Cortex (VOC) using a statistical measure, Granger Causality (GC), with fMRI data acquired from subjects participated in a covert attention task. We found a directional asymmetry in GC between FEF/IPS and VOC, and further identified retinotopically specific control patterns in top-down GC. This work may lead to deeper understanding of goal-directed attention, as well as the application of GC to analyzing higher-level cognitive functions in healthy functioning human brain. / by Wei Tang. / Thesis (Ph.D.)--Florida Atlantic University, 2011. / Includes bibliography. / Electronic reproduction. Boca Raton, Fla., 2011. Mode of access: World Wide Web.

[Truncated abstract] Controlled and automatic processing are broad categories, and how best to measure these constructs and their impact on functioning after mild traumatic brain injury (TBI) remains uncertain. The purpose of this thesis was to examine automatic and controlled processing aspects of attention after mild TBI using the Paced Auditory Serial Addition Task (PASAT) and event-related potentials (ERPs). The PASAT is one of the most frequently used tests to evaluate attentional functioning. It has been demonstrated to be a measure sensitive to both acute and longer-term effects of mild TBI, presumably due to demands for rapid processing and executive attentional control. ERPs provide a noninvasive neurophysiological index of sensory processing and cognitive functions and have demonstrated sensitivity to even minor cognitive dysfunction. The parameters provided by this functional technique may be those most likely to distinguish individuals with mild TBI from controls. Initially, it was hypothesized that successful novice PASAT performance requires the engagement of executive attention to establish novel controlled information processing strategies. Ten individuals who had suffered a mild TBI an average of 15.20 months previously were therefore expected to demonstrate processing abnormalities on the PASAT, relative to 10 healthy matched controls. Although the mild TBI group reported significant intensification of subjective symptoms since their injury, compared to controls, the mild TBI group provided a similar amount of correct PASAT responses. ... In the first experiment a visual search task consisting of an automatic detection and a controlled search condition was developed. In the second experiment the search task was performed concurrently with the PASAT task in a dual-task paradigm. In the mild TBI group, prior failure to establish more efficient forms of information processing with practice was found to significantly interfere with simultaneous performance of the PASAT task and the attention demanding condition of the search task. The pattern of impaired performance was considered to reflect a reduction in processing resources rather than a deficit in resource allocation. Dual-task performance in the control group was not associated with a large interference effect. In general, the results of this thesis suggest that individuals with mild TBI are impaired in their ability to progress from the stage of effortful controlled information processing to a stage of more efficient, automatic processing, and thus suffer a subtle attentional deficit. Following mild TBI, performance levels equivalent to controls may only be achieved with an abnormal expenditure of cognitive effort. As a result of the neuropathologic consequences of injury, individuals who have sustained a mild TBI are less able to benefit from practice, experience difficulty coping with simultaneous performance of secondary task, and are susceptible to distressing subjective symptomatology.

The utilisation of navigation systems in cars has given rise to road safety concerns, and the design and functionality of such systems must therefore be adjusted to the users’ needs, since they have to divide their attention between driving and the operation of the navigation system. The study was aimed at finding the optimum system response time (SRT) which would enable a driver to focus as much as possible on the road while attaining an efficient task completion time using an electronic navigational system. The research project consists of two separate experiments and was completed by 10 subjects. Experiment 1 included a temporal reproduction task and a secondary memory task. The subjects had to memorise two symbols and then reproduce six time spans ranging from 1 to 30 s to provide a baseline measurement of their time estimation abilities. Experiment 2 consisted of a simulated automobile driving task. While driving in the simulator the subjects completed a memorising task displayed on a touch screen. The task was presented with seven different system response times (SRTs) ranging from 0 to 30 s. The effects of different SRTs on the eye movement from road to monitor, regarding the duration of fixation and the frequency of change were evaluated. The distribution of gazes to the secondary task was analysed to provide information about the time estimation performance in the driving simulator. Other dependent variables tested were the accuracy of selected items, memory game performance, drive performance and the subjective state of the test person. The results of this study can be employed to find the optimum duration of inter-task delays for in-vehicle technical devices. / Psychology / M.A. (Psychology)

Female athletes exhibit three- to six-fold greater incidence of noncontact anterior cruciate ligament (ACL) injury relative to their male counterparts. The increased risk appears to stem from interactions between several risk factors, that can roughly be categorized as anatomic, biomechanical, hormonal, and neuromuscular. Neuromuscular risk factors have recently gained a greater focus, and include differences in the timing and magnitude of activation of lower extremity and trunk musculature. In addition to neuromuscular risk factors, the incidence of ACL injury is not evenly distributed across the menstrual cycle, suggesting that hormonal fluctuations may influence neuromuscular control. Finally, it is known that even well-trained athletes experience decrements in performance and postural control when forced to attend to multiple sensory stimuli, which is common in many sports. PURPOSE: To explore neuromuscular differences in the ways healthy and ACL-injured women respond to a secondary task requiring fine motor control and sustained mental focus (typing task). Our investigation encompassed three broad aims. First, we sought to determine whether ACL-injured individuals demonstrated similar reflex profiles to healthy individuals, as well as to determine whether the ACL-involved limb was similar to its uninvolved counterpart. Our second aim was to determine whether the typing task resulted in attenuated Hoffmann (H) reflex amplitudes, and to investigate whether any observed changes were similar in healthy and ACL-injured groups. Finally, our third broad aim was to utilize more complex H reflex analysis techniques to determine whether differences in spinal excitability existed at different points in the menstrual cycle. METHODS: Thirty nine recreationally active women (20 with prior unilateral noncontact ACL injury: 24.0 ± 4.5 years; 23.8 ± 4.5 kg•m⁻²; 4.1 ± 2.6 years post-injury; 19 with no history of knee injury: 23.8 ± 4.5 years; 23.1 ± 2.3 kg•m⁻²) agreed to participate, and were tested during days 2-5 (follicular phase) of the menstrual cycle. A sub-set of this original group (n=8; 24.0 ± 4.8 years; 22.0 ± 2.1 kg•m⁻²) also agreed to return for a second testing session 24-96 hours after ovulation (early luteal phase), in order to assess H reflex differences across the menstrual cycle. During each testing session, H reflex testing was used to explore spinal-level control mechanisms of the lower extremity musculature under both Rest and Task conditions. In the control group, the dominant limb was tested (CON-D) while in the ACL group, both the uninvolved (ACL-UN) and involved (ACL-INV) limbs were assessed. Differences between groups (Control vs. ACL) and within-groups (ACL-UN vs. ACL-INV) were explored. RESULTS: At rest, H reflex parameters in ACL-INV were generally similar to ACL-UN and to CON-D. However, differences in presynaptic inhibition were apparent in ACL-INV that imply reduced reflex plasticity. During the typing task, both the Control and ACL groups experienced attenuated H reflex parameters. In the sub-set of participants who were tested twice during the menstrual cycle, a significant increase in presynaptic inhibition was observed during the early luteal phase compared to the follicular phase. CONCLUSION: While individuals with prior ACL injury display similar H reflex profiles to healthy individuals, the ACL-involved limb may demonstrate less reflex plasticity in response to environmental changes. This lack of plasticity may potentially increase the risk of re-injury. In addition, an upper extremity task requiring fine motor control and sustained mental focus attenuates the H reflex in both groups. This attenuation has implications for lower-extremity neuromuscular control in dual-task environments. Finally, the increase in presynaptic inhibition observed during the early luteal phase may provide insight into why ACL injuries are not evenly distributed across the menstrual cycle. / Graduation date: 2012