In a world dominated by temporal order, memory capable of processing, encoding and subsequently recalling ordered information is very important. Over the decades this memory, known as serial memory, has been extensively studied, and its effects are well known. Many models have also been developed, and while these models are able to reproduce the behavioural effects observed in human recall studies, they are not always implementable in a biologically plausible manner. This thesis presents the Ordinal Serial Encoding model, a model inspired by biology and designed with a broader view of general cognitive architectures in mind. This model has the advantage of simplicity, and we show how neuro-plausibility can be achieved by employing the principles of the Neural Engineering Framework in the model’s design. Additionally, we demonstrate that not only is the model able to closely mirror human performance in various recall tasks, but the behaviour of the model is itself a consequence of the underlying neural architecture.

Several decades of physiology, imaging and psychophysics research on attention has generated an enormous amount of data describing myriad forms of attentional effects. A similar breadth of theoretical models have been proposed that attempt to explain these effects in varying amounts of detail. However, there remains a need for neurally detailed mechanistic models of attention that connect more directly with various kinds of experimental data -- behavioural, psychophysical, neurophysiological, and neuroanatomical -- and that provide experimentally testable predictions. Research has been conducted that aims to identify neurally consistent principles that underlie selective attentional processing in cortex. The research specifically focuses on describing the functional mechanisms of attentional routing in a large-scale hierarchical model, and demonstrating the biological plausibility of the model by presenting a spiking neuron implementation that can account for a variety of attentional effects. The thesis begins by discussing several significant physiological effects of attention, and prominent brain areas involved in selective attention, which provide strong constraints for developing a model of attentional processing in cortex. Several prominent models of attention are then discussed, from which a set of common limitations in existing models is assembled that need to be addressed by the proposed model. One central limitation is that, for many existing models, it remains to be demonstrated that their computations can be plausibly performed in spiking neurons. Further, few models address attentional effects for more than a single neuron or single cortical area. And finally, few are able to account for different forms of attentional modulation in a single detailed model. These and other limitations are addressed by the Attentional Routing Circuit (ARC) proposed in this thesis. The presentation of the ARC begins with the proposal of a high-level mathematical model for selective routing in the visual hierarchy. The mathematical model is used to demonstrate that the suggested mechanisms allow for scale- and position-invariant representations of attended stimuli to be formed, and provides a functional context for interpreting detailed physiological effects. To evaluate the model's biological plausibility, the Neural Engineering Framework (NEF) is used to implement the ARC as a detailed spiking neuron model. Simulation results are then presented which demonstrate that selective routing can be performed efficiently in spiking neurons in a way that is consistent with the mathematical model. The neural circuitry for computing and applying attentional control signals in the ARC is then mapped on to neural populations in specific cortical laminae using known anatomical interlaminar and interareal connections to support the plausibility of its cortical implementation. The model is then tested for its ability to account for several forms of attentional modulation that have been reported in neurophysiological experiments. Three experiments of attention in macaque are simulated using the ARC, and for each of these experiments, the model is shown to be quantitatively consistent with measured data. Specifically, a study by Womelsdorf et al. (2008) demonstrates that spatial shifts of attention result in a shifting and shrinking of receptive fields depending on the target's position. An experiment by Treue and Martinez-Trujllo (1999) reports that attentional shifts between receptive field stimuli produce a multiplicative scaling of responses, but do not affect the neural tuning sensitivity. Finally, a study by Lee and Maunsell (2010) demonstrates that attentional shifts result in a multiplicative scaling of neural contrast-response functions that is consistent with a response-gain effect. The model accounts for each of these experimentally observed attentional effects using a single mechanism for selectively processing attended stimuli. In conclusion, it is suggested that the ARC is distinguished from previous models by providing a unifying interpretation of attentional effects at the level of single cells, neural populations, cortical areas, and over the bulk of the visual hierarchy. As well, there are several advantages of the ARC over previous models, including: (1) scalability to larger implementations without affecting the model's principles; (2) a significant increase in biological plausibility; (3) the ability to account for experimental results at multiple levels of analysis; (4) a detailed description of the model's anatomical substrate; (5) the ability to perform selective routing while preserving biological detail; and (6) generating a variety of experimentally testable predictions.

In a world dominated by temporal order, memory capable of processing, encoding and subsequently recalling ordered information is very important. Over the decades this memory, known as serial memory, has been extensively studied, and its effects are well known. Many models have also been developed, and while these models are able to reproduce the behavioural effects observed in human recall studies, they are not always implementable in a biologically plausible manner. This thesis presents the Ordinal Serial Encoding model, a model inspired by biology and designed with a broader view of general cognitive architectures in mind. This model has the advantage of simplicity, and we show how neuro-plausibility can be achieved by employing the principles of the Neural Engineering Framework in the model’s design. Additionally, we demonstrate that not only is the model able to closely mirror human performance in various recall tasks, but the behaviour of the model is itself a consequence of the underlying neural architecture.

Several decades of physiology, imaging and psychophysics research on attention has generated an enormous amount of data describing myriad forms of attentional effects. A similar breadth of theoretical models have been proposed that attempt to explain these effects in varying amounts of detail. However, there remains a need for neurally detailed mechanistic models of attention that connect more directly with various kinds of experimental data -- behavioural, psychophysical, neurophysiological, and neuroanatomical -- and that provide experimentally testable predictions. Research has been conducted that aims to identify neurally consistent principles that underlie selective attentional processing in cortex. The research specifically focuses on describing the functional mechanisms of attentional routing in a large-scale hierarchical model, and demonstrating the biological plausibility of the model by presenting a spiking neuron implementation that can account for a variety of attentional effects. The thesis begins by discussing several significant physiological effects of attention, and prominent brain areas involved in selective attention, which provide strong constraints for developing a model of attentional processing in cortex. Several prominent models of attention are then discussed, from which a set of common limitations in existing models is assembled that need to be addressed by the proposed model. One central limitation is that, for many existing models, it remains to be demonstrated that their computations can be plausibly performed in spiking neurons. Further, few models address attentional effects for more than a single neuron or single cortical area. And finally, few are able to account for different forms of attentional modulation in a single detailed model. These and other limitations are addressed by the Attentional Routing Circuit (ARC) proposed in this thesis. The presentation of the ARC begins with the proposal of a high-level mathematical model for selective routing in the visual hierarchy. The mathematical model is used to demonstrate that the suggested mechanisms allow for scale- and position-invariant representations of attended stimuli to be formed, and provides a functional context for interpreting detailed physiological effects. To evaluate the model's biological plausibility, the Neural Engineering Framework (NEF) is used to implement the ARC as a detailed spiking neuron model. Simulation results are then presented which demonstrate that selective routing can be performed efficiently in spiking neurons in a way that is consistent with the mathematical model. The neural circuitry for computing and applying attentional control signals in the ARC is then mapped on to neural populations in specific cortical laminae using known anatomical interlaminar and interareal connections to support the plausibility of its cortical implementation. The model is then tested for its ability to account for several forms of attentional modulation that have been reported in neurophysiological experiments. Three experiments of attention in macaque are simulated using the ARC, and for each of these experiments, the model is shown to be quantitatively consistent with measured data. Specifically, a study by Womelsdorf et al. (2008) demonstrates that spatial shifts of attention result in a shifting and shrinking of receptive fields depending on the target's position. An experiment by Treue and Martinez-Trujllo (1999) reports that attentional shifts between receptive field stimuli produce a multiplicative scaling of responses, but do not affect the neural tuning sensitivity. Finally, a study by Lee and Maunsell (2010) demonstrates that attentional shifts result in a multiplicative scaling of neural contrast-response functions that is consistent with a response-gain effect. The model accounts for each of these experimentally observed attentional effects using a single mechanism for selectively processing attended stimuli. In conclusion, it is suggested that the ARC is distinguished from previous models by providing a unifying interpretation of attentional effects at the level of single cells, neural populations, cortical areas, and over the bulk of the visual hierarchy. As well, there are several advantages of the ARC over previous models, including: (1) scalability to larger implementations without affecting the model's principles; (2) a significant increase in biological plausibility; (3) the ability to account for experimental results at multiple levels of analysis; (4) a detailed description of the model's anatomical substrate; (5) the ability to perform selective routing while preserving biological detail; and (6) generating a variety of experimentally testable predictions.

Computational intelligence techniques, such as artificial neural networks (ANNs), have been widely used to improve the performance of power system monitoring and control. Although inspired by the neurons in the brain, ANNs are largely different from living neuron networks (LNNs) in many aspects. Due to the oversimplification, the huge computational potential of LNNs cannot be realized by ANNs. Therefore, a more brain-like artificial neural network is highly desired to bridge the gap between ANNs and LNNs. The focus of this research is to develop a biologically inspired artificial neural network (BIANN), which is not only biologically meaningful, but also computationally powerful. The BIANN can serve as a novel computational intelligence tool in monitoring, modeling and control of the power systems. A comprehensive survey of ANNs applications in power system is presented. It is shown that novel types of reservoir-computing-based ANNs, such as echo state networks (ESNs) and liquid state machines (LSMs), have stronger modeling capability than conventional ANNs. The feasibility of using ESNs as modeling and control tools is further investigated in two specific power system applications, namely, power system nonlinear load modeling for true load harmonic prediction and the closed-loop control of active filters for power quality assessment and enhancement. It is shown that in both applications, ESNs are capable of providing satisfactory performances with low computational requirements. A novel, more brain-like artificial neural network, i.e. biologically inspired artificial neural network (BIANN), is proposed in this dissertation to bridge the gap between ANNs and LNNs and provide a novel tool for monitoring and control in power systems. A comprehensive survey of the spiking models of living neurons as well as the coding approaches is presented to review the state-of-the-art in BIANN research. The proposed BIANNs are based on spiking models of living neurons with adoption of reservoir-computing approaches. It is shown that the proposed BIANNs have strong modeling capability and low computational requirements, which makes it a perfect candidate for online monitoring and control applications in power systems. BIANN-based modeling and control techniques are also proposed for power system applications. The proposed modeling and control schemes are validated for the modeling and control of a generator in a single-machine infinite-bus system under various operating conditions and disturbances. It is shown that the proposed BIANN-based technique can provide better control of the power system to enhance its reliability and tolerance to disturbances. To sum up, a novel, more brain-like artificial neural network, i.e. biologically inspired artificial neural network (BIANN), is proposed in this dissertation to bridge the gap between ANNs and LNNs and provide a novel tool for monitoring and control in power systems. It is clearly shown that the proposed BIANN-based modeling and control schemes can provide faster and more accurate control for power system applications. The conclusions, the recommendations for future research, as well as the major contributions of this research are presented at the end.

In the past decade, characterizing spiking neuron models has been extensively researched as an essential issue in computational neuroscience. In this thesis, we examine the estimation problem of two different neuron models. In Chapter 2, We propose a modified Izhikevich model with an adaptive threshold. In our two-stage estimation approach, a linear least squares method and a linear model of the threshold are derived to predict the location of neuronal spikes. However, desired results are not obtained and the predicted model is unsuccessful in duplicating the spike locations. Chapter 3 is focused on the parameter estimation problem of a multi-timescale adaptive threshold (MAT) neuronal model. Using the dynamics of a non-resetting leaky integrator equipped with an adaptive threshold, a constrained iterative linear least squares method is implemented to fit the model to the reference data. Through manipulation of the system dynamics, the threshold voltage can be obtained as a realizable model that is linear in the unknown parameters. This linearly parametrized realizable model is then utilized inside a prediction error based framework to identify the threshold parameters with the purpose of predicting single neuron precise firing times. This estimation scheme is evaluated using both synthetic data obtained from an exact model as well as the experimental data obtained from in vitro rat somatosensory cortical neurons. Results show the ability of this approach to fit the MAT model to different types of reference data.

No description available.