No description available.

This research provides a proof of concept and background theory for the physics behind the state-of-the-art ultra-fast plasmonic spiking neurons (PSN), which can serve as a primary synaptic device for developing a platform for fast neural computing. Such a plasmonic-powered computing system allows localized AI with ultra-fast operation speed. The designed architecture for a plasmonic spiking neuron (PSN) presented in this thesis is a photonic integrated nanodevice consisting of two electro-optic and optoelectronic active components and works based on their coupling. The electro-optic active structure incorporated a periodic array of seeded quantum nanorods sandwiched between two electrodes and positioned at a near-field distance from the topmost metal layer of a sub-wavelength metal-oxide multilayer metamaterial. Three of the metal layers of the metamaterials form the active optoelectronic component. The device operates based on the coupling of the two active components through optical complex modes supported by the multilayer and switching between two of them. Both action and resting potentials occur through subsequent quantum and extraordinary photonics phenomena. These phenomena include the generation of plasmonic high-k complex modes, switching between the modes by enhanced quantum-confined stark effect, decay of the plasmonic excitations in each metal layer into hot-electrons, and collecting hot-electrons by the optoelectronic component. The underlying principles and functionality of the plasmonic spiking neuron are illustrated using computer simulation.

Spike-timing dependent plasticity is a learning mechanism used extensively within neural modelling. The learning rule has been shown to allow a neuron to find the onset of a spatio-temporal pattern repeated among its afferents. In this thesis, the first question addressed is ‘what does this neuron learn?’ With a spiking neuron model and linear prediction, evidence is adduced that the neuron learns two components: (1) the level of average background activity and (2) specific spike times of a pattern. Taking advantage of these findings, a network is developed that can train recognisers for longer spatio-temporal input signals using spike-timing dependent plasticity. Using a number of neurons that are mutually connected by plastic synapses and subject to a global winner-takes-all mechanism, chains of neurons can form where each neuron is selective to a different segment of a repeating input pattern, and the neurons are feedforwardly connected in such a way that both the correct stimulus and the firing of the previous neurons are required in order to activate the next neuron in the chain. This is akin to a simple class of finite state automata. Following this, a novel resource-based STDP learning rule is introduced. The learning rule has several advantages over typical implementations of STDP and results in synaptic statistics which match favourably with those observed experimentally. For example, synaptic weight distributions and the presence of silent synapses match experimental data.

In hippocampal CA1 and CA3 regions, various properties of neuronal activity follow skewed, lognormal-like distributions, including average firing rates, rate and magnitude of spike bursts, magnitude of population synchrony, and correlations between pre- and postsynaptic spikes. In recent studies, the lognormal features of hippocampal activities were well replicated by a multi-timescale adaptive threshold (MAT) neuron network of lognormally distributed excitatory-to-excitatory synaptic weights, though it remains unknown whether and how other neuronal and network properties can be replicated in this model. Here we implement two additional studies of the same network: first, we further analyze its burstiness properties by identifying and clustering neurons with exceptionally bursty features, once again demonstrating the importance of the lognormal synaptic weight distribution. Second, we characterize dynamical patterns of activity termed neuronal avalanches in in vivo CA3 recordings of behaving rats and in the model network, revealing the similarities and differences between experimental and model avalanche size distributions across the sleep-wake cycle. These results show the comparison between the MAT neuron network and hippocampal readings in a different approach than shown before, providing more insight into the mechanisms behind activity in hippocampal subregions. / Nas regiões CA1 e CA3 do hipocampo, várias propriedades da atividade neuronal seguem distribuições assimétricas com características lognormais, incluindo frequência de disparo média, frequência e magnitude de rajadas de disparo (bursts), magnitude da sincronia populacional e correlações entre disparos pré- e pós-sinápticos. Em estudos recentes, as características lognormais das atividades hipocampais foram bem reproduzidas por uma rede de neurônios de limiar adaptativo (multi-timescale adaptive threshold, MAT) com pesos sinápticos entre neurônios excitatórios seguindo uma distribuição lognormal, embora ainda não se saiba se e como outras propriedades neuronais e da rede podem ser replicadas nesse modelo. Nesse trabalho implementamos dois estudos adicionais da mesma rede: primeiramente, analisamos mais a fundo as propriedades dos bursts identificando e agrupando neurônios com capacidade de burst excepcional, mostrando mais uma vez a importância da distribuição lognormal de pesos sinápticos. Em seguida, caracterizamos padrões dinâmicos de atividade chamados avalanches neuronais no modelo e em aquisições in vivo do CA3 de roedores em atividades comportamentais, revelando as semelhanças e diferenças entre as distribuições de tamanho de avalanche através do ciclo sono-vigília. Esses resultados mostram a comparação entre a rede de neurônios MAT e medições hipocampais em uma abordagem diferente da apresentada anteriormente, fornecendo mais percepção acerca dos mecanismos por trás da atividade em subregiões hipocampais.

In hippocampal CA1 and CA3 regions, various properties of neuronal activity follow skewed, lognormal-like distributions, including average firing rates, rate and magnitude of spike bursts, magnitude of population synchrony, and correlations between pre- and postsynaptic spikes. In recent studies, the lognormal features of hippocampal activities were well replicated by a multi-timescale adaptive threshold (MAT) neuron network of lognormally distributed excitatory-to-excitatory synaptic weights, though it remains unknown whether and how other neuronal and network properties can be replicated in this model. Here we implement two additional studies of the same network: first, we further analyze its burstiness properties by identifying and clustering neurons with exceptionally bursty features, once again demonstrating the importance of the lognormal synaptic weight distribution. Second, we characterize dynamical patterns of activity termed neuronal avalanches in in vivo CA3 recordings of behaving rats and in the model network, revealing the similarities and differences between experimental and model avalanche size distributions across the sleep-wake cycle. These results show the comparison between the MAT neuron network and hippocampal readings in a different approach than shown before, providing more insight into the mechanisms behind activity in hippocampal subregions. / Nas regiões CA1 e CA3 do hipocampo, várias propriedades da atividade neuronal seguem distribuições assimétricas com características lognormais, incluindo frequência de disparo média, frequência e magnitude de rajadas de disparo (bursts), magnitude da sincronia populacional e correlações entre disparos pré- e pós-sinápticos. Em estudos recentes, as características lognormais das atividades hipocampais foram bem reproduzidas por uma rede de neurônios de limiar adaptativo (multi-timescale adaptive threshold, MAT) com pesos sinápticos entre neurônios excitatórios seguindo uma distribuição lognormal, embora ainda não se saiba se e como outras propriedades neuronais e da rede podem ser replicadas nesse modelo. Nesse trabalho implementamos dois estudos adicionais da mesma rede: primeiramente, analisamos mais a fundo as propriedades dos bursts identificando e agrupando neurônios com capacidade de burst excepcional, mostrando mais uma vez a importância da distribuição lognormal de pesos sinápticos. Em seguida, caracterizamos padrões dinâmicos de atividade chamados avalanches neuronais no modelo e em aquisições in vivo do CA3 de roedores em atividades comportamentais, revelando as semelhanças e diferenças entre as distribuições de tamanho de avalanche através do ciclo sono-vigília. Esses resultados mostram a comparação entre a rede de neurônios MAT e medições hipocampais em uma abordagem diferente da apresentada anteriormente, fornecendo mais percepção acerca dos mecanismos por trás da atividade em subregiões hipocampais.

In a world dominated by temporal order, memory capable of processing, encoding and subsequently recalling ordered information is very important. Over the decades this memory, known as serial memory, has been extensively studied, and its effects are well known. Many models have also been developed, and while these models are able to reproduce the behavioural effects observed in human recall studies, they are not always implementable in a biologically plausible manner. This thesis presents the Ordinal Serial Encoding model, a model inspired by biology and designed with a broader view of general cognitive architectures in mind. This model has the advantage of simplicity, and we show how neuro-plausibility can be achieved by employing the principles of the Neural Engineering Framework in the model’s design. Additionally, we demonstrate that not only is the model able to closely mirror human performance in various recall tasks, but the behaviour of the model is itself a consequence of the underlying neural architecture.

Several decades of physiology, imaging and psychophysics research on attention has generated an enormous amount of data describing myriad forms of attentional effects. A similar breadth of theoretical models have been proposed that attempt to explain these effects in varying amounts of detail. However, there remains a need for neurally detailed mechanistic models of attention that connect more directly with various kinds of experimental data -- behavioural, psychophysical, neurophysiological, and neuroanatomical -- and that provide experimentally testable predictions. Research has been conducted that aims to identify neurally consistent principles that underlie selective attentional processing in cortex. The research specifically focuses on describing the functional mechanisms of attentional routing in a large-scale hierarchical model, and demonstrating the biological plausibility of the model by presenting a spiking neuron implementation that can account for a variety of attentional effects. The thesis begins by discussing several significant physiological effects of attention, and prominent brain areas involved in selective attention, which provide strong constraints for developing a model of attentional processing in cortex. Several prominent models of attention are then discussed, from which a set of common limitations in existing models is assembled that need to be addressed by the proposed model. One central limitation is that, for many existing models, it remains to be demonstrated that their computations can be plausibly performed in spiking neurons. Further, few models address attentional effects for more than a single neuron or single cortical area. And finally, few are able to account for different forms of attentional modulation in a single detailed model. These and other limitations are addressed by the Attentional Routing Circuit (ARC) proposed in this thesis. The presentation of the ARC begins with the proposal of a high-level mathematical model for selective routing in the visual hierarchy. The mathematical model is used to demonstrate that the suggested mechanisms allow for scale- and position-invariant representations of attended stimuli to be formed, and provides a functional context for interpreting detailed physiological effects. To evaluate the model's biological plausibility, the Neural Engineering Framework (NEF) is used to implement the ARC as a detailed spiking neuron model. Simulation results are then presented which demonstrate that selective routing can be performed efficiently in spiking neurons in a way that is consistent with the mathematical model. The neural circuitry for computing and applying attentional control signals in the ARC is then mapped on to neural populations in specific cortical laminae using known anatomical interlaminar and interareal connections to support the plausibility of its cortical implementation. The model is then tested for its ability to account for several forms of attentional modulation that have been reported in neurophysiological experiments. Three experiments of attention in macaque are simulated using the ARC, and for each of these experiments, the model is shown to be quantitatively consistent with measured data. Specifically, a study by Womelsdorf et al. (2008) demonstrates that spatial shifts of attention result in a shifting and shrinking of receptive fields depending on the target's position. An experiment by Treue and Martinez-Trujllo (1999) reports that attentional shifts between receptive field stimuli produce a multiplicative scaling of responses, but do not affect the neural tuning sensitivity. Finally, a study by Lee and Maunsell (2010) demonstrates that attentional shifts result in a multiplicative scaling of neural contrast-response functions that is consistent with a response-gain effect. The model accounts for each of these experimentally observed attentional effects using a single mechanism for selectively processing attended stimuli. In conclusion, it is suggested that the ARC is distinguished from previous models by providing a unifying interpretation of attentional effects at the level of single cells, neural populations, cortical areas, and over the bulk of the visual hierarchy. As well, there are several advantages of the ARC over previous models, including: (1) scalability to larger implementations without affecting the model's principles; (2) a significant increase in biological plausibility; (3) the ability to account for experimental results at multiple levels of analysis; (4) a detailed description of the model's anatomical substrate; (5) the ability to perform selective routing while preserving biological detail; and (6) generating a variety of experimentally testable predictions.

In a world dominated by temporal order, memory capable of processing, encoding and subsequently recalling ordered information is very important. Over the decades this memory, known as serial memory, has been extensively studied, and its effects are well known. Many models have also been developed, and while these models are able to reproduce the behavioural effects observed in human recall studies, they are not always implementable in a biologically plausible manner. This thesis presents the Ordinal Serial Encoding model, a model inspired by biology and designed with a broader view of general cognitive architectures in mind. This model has the advantage of simplicity, and we show how neuro-plausibility can be achieved by employing the principles of the Neural Engineering Framework in the model’s design. Additionally, we demonstrate that not only is the model able to closely mirror human performance in various recall tasks, but the behaviour of the model is itself a consequence of the underlying neural architecture.

Several decades of physiology, imaging and psychophysics research on attention has generated an enormous amount of data describing myriad forms of attentional effects. A similar breadth of theoretical models have been proposed that attempt to explain these effects in varying amounts of detail. However, there remains a need for neurally detailed mechanistic models of attention that connect more directly with various kinds of experimental data -- behavioural, psychophysical, neurophysiological, and neuroanatomical -- and that provide experimentally testable predictions. Research has been conducted that aims to identify neurally consistent principles that underlie selective attentional processing in cortex. The research specifically focuses on describing the functional mechanisms of attentional routing in a large-scale hierarchical model, and demonstrating the biological plausibility of the model by presenting a spiking neuron implementation that can account for a variety of attentional effects. The thesis begins by discussing several significant physiological effects of attention, and prominent brain areas involved in selective attention, which provide strong constraints for developing a model of attentional processing in cortex. Several prominent models of attention are then discussed, from which a set of common limitations in existing models is assembled that need to be addressed by the proposed model. One central limitation is that, for many existing models, it remains to be demonstrated that their computations can be plausibly performed in spiking neurons. Further, few models address attentional effects for more than a single neuron or single cortical area. And finally, few are able to account for different forms of attentional modulation in a single detailed model. These and other limitations are addressed by the Attentional Routing Circuit (ARC) proposed in this thesis. The presentation of the ARC begins with the proposal of a high-level mathematical model for selective routing in the visual hierarchy. The mathematical model is used to demonstrate that the suggested mechanisms allow for scale- and position-invariant representations of attended stimuli to be formed, and provides a functional context for interpreting detailed physiological effects. To evaluate the model's biological plausibility, the Neural Engineering Framework (NEF) is used to implement the ARC as a detailed spiking neuron model. Simulation results are then presented which demonstrate that selective routing can be performed efficiently in spiking neurons in a way that is consistent with the mathematical model. The neural circuitry for computing and applying attentional control signals in the ARC is then mapped on to neural populations in specific cortical laminae using known anatomical interlaminar and interareal connections to support the plausibility of its cortical implementation. The model is then tested for its ability to account for several forms of attentional modulation that have been reported in neurophysiological experiments. Three experiments of attention in macaque are simulated using the ARC, and for each of these experiments, the model is shown to be quantitatively consistent with measured data. Specifically, a study by Womelsdorf et al. (2008) demonstrates that spatial shifts of attention result in a shifting and shrinking of receptive fields depending on the target's position. An experiment by Treue and Martinez-Trujllo (1999) reports that attentional shifts between receptive field stimuli produce a multiplicative scaling of responses, but do not affect the neural tuning sensitivity. Finally, a study by Lee and Maunsell (2010) demonstrates that attentional shifts result in a multiplicative scaling of neural contrast-response functions that is consistent with a response-gain effect. The model accounts for each of these experimentally observed attentional effects using a single mechanism for selectively processing attended stimuli. In conclusion, it is suggested that the ARC is distinguished from previous models by providing a unifying interpretation of attentional effects at the level of single cells, neural populations, cortical areas, and over the bulk of the visual hierarchy. As well, there are several advantages of the ARC over previous models, including: (1) scalability to larger implementations without affecting the model's principles; (2) a significant increase in biological plausibility; (3) the ability to account for experimental results at multiple levels of analysis; (4) a detailed description of the model's anatomical substrate; (5) the ability to perform selective routing while preserving biological detail; and (6) generating a variety of experimentally testable predictions.

No description available.