The work presented in this thesis provides new perspectives and approaches for problems that arise in the analysis of neural data. Particular emphasis is placed on parameter fitting and automated analysis problems that would arise naturally in closed-loop experiments. Part one focuses on two brain-computer interface problems. First, we provide a framework for understanding co-adaptation, the setting in which decoder updating and user learning occur simultaneously. We also provide a new perspective on intention-based parameter fitting and tools to extend this approach to higher dimensional decoders. Part two focuses on event inference, which refers to the decomposition of observed timeseries data into interpretable events. We present application of event inference methods on voltage-clamp recordings as well as calcium imaging, and describe extensions to allow for combining data across modalities or trials.

In this work, we present a set of methods aimed at improving the discriminative power of time-varying features of signals that contain noise. These methods use properties of noise signals as well as information theoretic techniques to factor types of noise and support signal inference for electroencephalographic (EEG) based brain-machine interfaces (BMI). EEG data were collected over two studies aimed at addressing Psychophysiological issues involving symmetry and mental rotation processing. The Psychophysiological data gathered in the mental rotation study also tested the feasibility of using dissociations of mental rotation tasks correlated with rotation angle in a BMI. We show the feasibility of mental rotation for BMI by showing comparable bitrates and recognition accuracy to state-of-the-art BMIs. The conclusion is that by using the feature selection methods introduced in this work to dissociate mental rotation tasks, we produce bitrates and recognition rates comparable to current BMIs.

As Interfaces Cérebro-Computador (do inglês Brain-Computer Interfaces BCI) são sistemas que visam permitir a interação entre usuários e máquinas por meio do monitoramento das atividades cerebrais. Sistemas de BCI são considerados como uma alternativa para que pessoas com perda severa ou total do controle motor, tais como as que sofrem de Esclerose Lateral Amiotrófica, possam contar com algum controle sobre o ambiente externo. Para mapear intenções individuais em operações de máquina, os sistemas de BCI empregam um conjunto de etapas que envolvem a captura e pré-processamento dos sinais cerebrais, a extração e seleção de suas características mais relevantes e a classificação das intenções. O projeto e a implementação de sistemas de BCI viáveis ainda são questões em aberto devido aos grandes desafios encontrados em cada uma de suas etapas. Esta lacuna motivou este trabalho de mestrado o qual apresenta uma avaliação dos principais extratores de características utilizados para classificar ensaios de imagética motora, cujos dados foram obtidos por meio de eletroencefalografia (EEG) e apresentam influências de artefatos, mais precisamente daqueles produzidos por interferências provenientes de atividades oculares (monitoradas por eletrooculografia EOG). Foram considerados sinais coletados pela BCI Competition IV-2b, os quais contêm informações sobre três canais de EEG e três outros de EOG. Como primeira etapa, foi realizado o pré-processamento desses canais utilizando a técnica de Análise de Componentes Independentes (ICA) em conjunto com um limiar de correlação para a remoção de componentes associados a artefatos oculares. Posteriormente, foram avaliadas diferentes abordagens para a extração de características, a mencionar: i) Árvore Diádica de Bandas de Frequências (ADBF); ii) Padrões Espaciais Comuns (CSP); iii) Padrões Espectro-Espaciais Comuns (CSSP); iv) Padrões Esparsos Espectro-Espaciais Comuns (CSSSP); v) CSP com banco de filtros (FBCSP); vi) CSSP com banco de filtros (FBCSSP); e, finalmente, vii) CSSSP com banco de filtros (FBCSSSP). Contudo, como essas técnicas podem produzir espaços de exemplos com alta dimensionalidade, considerou-se, também, a técnica de Seleção de Características baseada em Informação Mútua (MIFS) para escolher os atributos mais relevantes para o conjunto de dados adotado na etapa de classificação. Finalmente, as Máquinas de Vetores de Suporte (SVM) foram utilizadas para a classificação das intenções de usuários. Experimentos permitem concluir que os resultados do CSSSP e FBCSSSP são equiparáveis àqueles produzidos pelo estado da arte, considerando o teste de significância estatística de Wilcoxon bilateral com confiança de 0, 95. Apesar disso o CSSSP tem sido negligenciado pela área devido ao fato de sua parametrização ser considerada complexa, algo que foi automatizado neste trabalho. Essa automatização reduziu custos computacionais envolvidos na adaptação das abordagens para indivíduos específicos. Ademais, conclui-se que os extratores de características FBCSP, CSSP, CSSSP, FBCSSP e FBCSSSP não necessitam da etapa de remoção de artefatos oculares, pois efetuam filtragens por meio de modelos autoregressivos. / Brain-Computer Interfaces (BCI) employ brain imaging to enable human-machine interaction without physical control. BCIs are an alternative so that people suffering from severe or complete loss of motor control, like those with Amyotrophic Lateral Sclerosis (ALS), may have some interaction with the external environment. To transform individual intentions onto machine operations, BCIs rely on a series of steps that include brain signal acquisition and preprocessing, feature extraction, selection and classification. A viable BCI implementation is still an open question due to the great challenges involved in each one of these steps. This gap motivated this work, which presents an evaluation of themain feature extractors used to classify Motor Imagery trials, whose data were obtained through Electroencephalography (EEG) influenced by ocular activity, monitored by Electrooculography (EOG). In this sense, signals acquired by BCI Competition IV-2b, were considered. As first step the preprocessing was performed through Independent Component Analysis (ICA) together with a correlation threshold to identify components associated with ocular artifacts. Afterwards, different feature extraction approaches were evaluated: i) Frequency Subband Dyadic Three; ii) Common Spatial Patterns (CSP); iii) Common Spectral-Spatial Patterns (CSSP); iv) Common Sparse Spectral-Spatial Patterns (CSSSP); v) Filter Bank Common Spatial Patterns (FBCSP); vi) Filter Bank Common Sectral-Spatial Patterns (FBCSSP); and, finally, vii) Filter Bank Sparse Spectral- Spatial Patterns (FBCSSSP). These techniques tend to produce high-dimensional spaces, so a Mutual Information-based Feature Selection was considered to select signal attributes. Finally, Support Vector Machines were trained to tackle the Motor Imagery classification. Experimental results allow to conclude that CSSSP and FBCSSSP are statistically equivalent the state of the art, when two-sided Wilcoxon test with 0, 95 confidence is considered. Nevertheless, CSSSP has been neglected by this area due to its complex parametrization, which is addressed in this work using an automatic approach. This automation reduced computational costs involved in adapting the BCI system to specific individuals. In addition, the FBCSP, CSSP, CSSSP, FBCSSP and FBCSSSP confirm to be robust to artifacts as they implicitly filter the signals through autoregressive models.

Esta dissertação de mestrado tem por objetivo analisar os conjuntos-K, uma hierarquia de redes neurais biologicamente mais plausíveis, e aplicá-los ao problema de classificação de imagética motora através do eletroencefalograma (EEG). A imagética motora consiste no ato de processar um movimento motor da memória humana de longo tempo para a memória de curto prazo. A imagética motora deixa um rastro no sinal do EEG que torna possível a identificação e classificação dos diferentes movimentos motores. A tarefa de classificação de imagética motora através do EEG é reconhecida como complexa devido à não linearidade e quantidade de ruído da série temporal do EEG e da pequena quantidade de dados disponíveis para aprendizagem. Os conjuntos-K são um modelo conexionista que simula o comportamento dinâmico e caótico de populações de neurônios do cérebro e foram modelados com base em observações do sistema olfatório feitas por Walter Freeman. Os conjuntos-K já foram aplicados em diversos domínios de classificação diferentes, incluindo EEG, tendo demonstrado bons resultados. Devido às características da classificação de imagética motora, levantou-se a hipótese de que a aplicação dos conjuntos-K na tarefa pudesse prover bons resultados. Um simulador para os conjuntos-K foi construído para a realização dos experimentos. Não foi possível validar a hipótese levantada no trabalho, dado que os resultados dos experimentos realizados com conjuntos-K e imagética motora não apresentaram melhorias significativas para a tarefa nas comparações realizadas. / This dissertation aims to examine the K-sets, a hierarchy of biologically plausible neural networks, and apply them to the problem of motor imagery classification through electroencephalogram (EEG). Motor imagery is the act of processing a motor movement from long-term to short-term memory. Motor imagery leaves a trail in the EEG signal, which makes possible the identification and classification of different motor movements. Motor imagery classification is a complex problem due to non-linearity of the EEG time series, low signal-to-noise ratio, and the small amount of data typically available for learning. K-sets are a connectionist model that simulates the dynamic and chaotic behavior of populations of neurons in the brain, modeled based on observations of the olfactory system by Walter Freeman. K-sets have already been used in several different classification domains, including EEG, showing good results. Due to the characteristics of motor imagery classification, a hypothesis that the application of K-sets in the task could provide good results was raised. A simulator for K-sets was created for the experiments. Unfortunately, the hypothesis could not be validated, as the results of the conducted experiments with K-sets and motor imagery showed no significant improvements in comparison in the task performed.

In recent years, brain computer interfaces (BCIs) have gained popularity in non-medical domains such as the gaming, entertainment, personal health, and marketing industries. A growing number of companies offer various inexpensive consumer grade BCIs and some of these companies have recently introduced the concept of BCI "App stores" in order to facilitate the expansion of BCI applications and provide software development kits (SDKs) for other developers to create new applications for their devices. The BCI applications access to users' unique brainwave signals, which consequently allows them to make inferences about users' thoughts and mental processes. Since there are no specific standards that govern the development of BCI applications, its users are at the risk of privacy breaches. In this work, we perform first comprehensive analysis of BCI App stores including software development kits (SDKs), application programming interfaces (APIs), and BCI applications w.r.t privacy issues. The goal is to understand the way brainwave signals are handled by BCI applications and what threats to the privacy of users exist. Our findings show that most applications have unrestricted access to users' brainwave signals and can easily extract private information about their users without them even noticing. We discuss potential privacy threats posed by current practices used in BCI App stores and then describe some countermeasures that could be used to mitigate the privacy threats. Also, develop a prototype which gives the BCI app users a choice to restrict their brain signal dynamically.

Les interfaces cerveau-machine (ICM) ouvrent des voies de communication alternatives entre le cerveau et son environnement. Elles peuvent être utilisées pour supplanter une fonction biologique défaillante ou pour permettre de nouveaux modes d’interaction à l’utilisateur. Les ICM de sortie, dont le fonctionnement se base sur la lecture de données biologiques, nécessitent la mesure de signaux de contrôle stables dans le temps et dans la population. La recherche de tels signaux et leur calibration sont des étapes clefs dans la conception d’une ICM. Cette étude s’intéresse en premier lieu aux ICM utilisant les potentiels évoqués visuels comme signaux de contrôle. Un modèle est proposé pour la prédiction individuelle de ces potentiels en régime permanent, c’est-à-dire lorsqu'ils sont issus d’une stimulation périodique. Ce modèle utilise une sommation linéaire corrigée en amplitude de la réponse à des stimulations visuelles discrètes pour prédire quantitativement la nature et la localisation spatiale de la réponse à des stimulations répétées. Les signaux modélisés sont ensuite utilisés en temps réel comme base de comparaison pour décoder les signaux électroencéphalographiques d’une ICM. Dans une deuxième partie, un paradigme est proposé pour le développement d’ICM cognitives, c’est-à-dire permettant la mesure de fonctions cérébrales de haut niveau. L’originalité du paradigme réside dans la volonté de mesurer la cognition en continu plutôt que son influence sur des événements discrets. Une expérience visant à discriminer différents états d’attention visuelle soutenue est proposée, avec l’ambition d’une mesure en temps réel pour le développement de systèmes de neurofeedback. / Brain-computer interfaces (BCIs) offer alternative communication pathways between the brain and its environment. They can be used to replace a defective biological function or to provide the user with new ways of interaction. Output BCIs, which are based on the reading of biological data, require the measurement of control signals as stable as possible in time and in the population. Identification and calibration of such signals are crucial steps in the conception of a BCI.The first part of this study focuses on BCIs using visual evoked potentials (VEPs) as control signals. A model is proposed to predict steady-state VEPs individually, i.e. to predict the response of a given subject’s brain to periodic visual stimulations. This model uses a linear summation of transient VEPs and an amplitude correction for quantitative prediction of the shape and spatial organization of the brain response to repeated stimulations. The simulated signals are then used as a basis of comparison for real-time decoding of electroencephalographic signals in a BCI.In the second part of this study, a paradigm is proposed for the development of cognitive BCIs, i.e. for the real-time measuring of high-level brain functions. The originality of the paradigm lies in the fact that correlates of cognition are measured continuously, instead of being observed on discrete events. An experiment with the purpose of discriminating between several levels of sustained visual attention is proposed, with the ambition of real-time measurement for the development of neurofeedback systems.

Thesis (MScEng (Electrical and Electronic Engineering))--University of Stellenbosch, 2009. / ENGLISH ABSTRACT: Brain-Computer Interface (BCI) monitors brain activity by using signals such as EEG, EcOG, and MEG, and attempts to bridge the gap between thoughts and actions by providing control to physical devices that range from wheelchairs to computers. A crucial process for a BCI system is feature extraction, and many studies have been undertaken to find relevant information from a set of input signals. This thesis investigated feature extraction from EEG signals using two different approaches. Wavelet packet decomposition was used to extract information from the signals in their frequency domain, and cepstral analysis was used to search for relevant information in the cepstral domain. A BCI was implemented to evaluate the two approaches, and three classification techniques contributed to finding the effectiveness of each feature type. Data containing two-class motor imagery was used for testing, and the BCI was compared to some of the other systems currently available. Results indicate that both approaches investigated were effective in producing separable features, and, with further work, can be used for the classification of trials based on a paradigm exploiting motor imagery as a means of control. / AFRIKAANSE OPSOMMING: ’n Brein-Rekenaar Koppelvlak (BRK) monitor brein aktiwiteit deur gebruik te maak van seine soos EEG, EcOG, en MEG. Dit poog om die gaping tussen gedagtes en fisiese aksies te oorbrug deur beheer aan toestelle soos rolstoele en rekenaars te verskaf. ’n Noodsaaklike proses vir ’n BRK is die ontginning van toepaslike inligting uit inset-seine, wat kan help om tussen verskillende gedagtes te onderskei. Vele studies is al onderneem oor hoe om sulke inligting te vind. Hierdie tesis ondersoek die ontginning van kenmerk-vektore in EEG-seine deur twee verskillende benaderings. Die eerste hiervan is golfies pakkie ontleding, ’n metode wat gebruik word om die sein in die frekwensie gebied voor te stel. Die tweede benadering gebruik kepstrale analise en soek vir toepaslike inligting in die kepstrale domein. ’n BRK is geïmplementeer om beide metodes te evalueer. Die toetsdata wat gebruik is, het bestaan uit twee-klas motoriese verbeelde bewegings, en drie klassifikasie-tegnieke was gebruik om die doeltreffendheid van die twee metodes te evalueer. Die BRK is vergelyk met ander stelsels wat tans beskikbaar is, en resultate dui daarop dat beide metodes doeltreffend was. Met verdere navorsing besit hulle dus die potensiaal om gebruik te word in stelsels wat gebruik maak van motoriese verbeelde bewegings om fisiese toestelle te beheer.

Une interface cerveau-ordinateur permet d'interagir avec un système, comme un système d'écriture, uniquement par l'activité cérébrale. Un des phénomènes neurophysiologiques permettant cette interaction est le potentiel évoqué cognitif P300, lequel correspond à une modification du signal 300 ms après la présentation d'une information attendue. Cette petite réaction cérébrale est difficile à observer par électroencéphalographie car le signal est bruité. Dans cette thèse, de nouvelles techniques basées sur la théorie des ondelettes sont développées pour améliorer la détection des P300 en utilisant des mesures de similarité entre les canaux électroencéphalographiques. Une technique présentée dans cette thèse débruite les signaux en considérant simultanément la phase des signaux. Nous avons également étendu cette approche pour étudier la localisation du P300 dans le but de sélectionner automatiquement la fenêtre temporelle à étudier et faciliter la détection / Brain-Computer Interfaces (BCI) are control and communication systems which were initially developed for people with disabilities. The idea behind BCI is to translate the brain activity into commands for a computer application or other devices, such as a spelling system. The most popular technique to record brain signals is the electroencephalography (EEG), from which Event-Related Potentials (ERPs) can be detected and used in BCI systems. Despite the BCI popularity, it is generally difficult to work with brain signals, because the recordings contains also noise and artifacts, and because the brain components amplitudes are very small compared to the whole ongoing EEG activity. This thesis presents new techniques based on wavelet theory to improve BCI systems using signals' similarity. The first one denoises the signals in the wavelet domain simultaneously. The second one combines the information provided by the signals to localize the ERP in time by removing useless information

Orientadores: Gabriela Castellano, Romis Ribeiro de Faissol Attux / Dissertação (mestrado) - Universidade Estadual de Campinas, Instituto de Física Gleb Wataghin / Made available in DSpace on 2018-09-06T19:40:58Z (GMT). No. of bitstreams: 1 StefanoFilho_CarlosAlberto_M.pdf: 6581881 bytes, checksum: fb23f8cb938a72e69a97b2bf2ff14cab (MD5) Previous issue date: 2016 / Resumo: Interfaces cérebro-computador (BCIs, brain-computer interfaces) são sistemas cuja finalidade é fornecer um canal de comunicação direto entre o cérebro e um dispositivo externo, como um computador, uma prótese ou uma cadeira de rodas. Por não utilizarem as vias fisiológicas convencionais, BCIs podem constituir importantes tecnologias assistivas para pessoas que sofreram algum tipo de lesão e, por isso, tiveram sua interação com o ambiente externo comprometida. Os sinais cerebrais a serem extraídos para utilização nestes sistemas devem ser gerados mediante estratégias específicas. Nesta dissertação, trabalhamos com a estratégia de imaginação motora (MI, motor imagery), e extraímos a resposta cerebral correspondente a partir de dados de eletroencefalografia (EEG). Os objetivos do trabalho foram caracterizar as redes cerebrais funcionais oriundas das tarefas de MI das mãos e explorar a viabilidade de utilizar métricas da teoria de grafos para a classificação dos padrões mentais, gerados por esta estratégia, de usuários de um sistema BCI. Para isto, fez-se a hipótese de que as alterações no espectro de frequências dos sinais de eletroencefalografia devidas à MI das mãos deveria, de alguma forma, se refletir nos grafos construídos para representar as interações cerebrais corticais durante estas tarefas. Em termos de classificação, diferentes conjuntos de pares de eletrodos foram testados, assim como diferentes classificadores (análise de discriminantes lineares ¿ LDA, máquina de vetores de suporte ¿ SVM ¿ linear e polinomial). Os três classificadores testados tiveram desempenho similar na maioria dos casos. A taxa média de classificação para todos os voluntários considerando a melhor combinação de eletrodos e classificador foi de 78%, sendo que alguns voluntários tiveram taxas de acerto individuais de até 92%. Ainda assim, a metodologia empregada até o momento possui várias limitações, sendo a principal como encontrar os pares ótimos de eletrodos, que variam entre voluntários e aquisições; além do problema da realização online da análise / Abstract: Brain-computer interfaces (BCIs) are systems that aim to provide a direct communication channel between the brain and an external device, such as a computer, a prosthesis or a wheelchair. Since BCIs do not use the conventional physiological pathways, they can constitute important assistive technologies for people with lesions that compromised their interaction with the external environment. Brain signals to be extracted for these systems must be generated according to specific strategies. In this dissertation, we worked with the motor imagery (MI) strategy, and we extracted the corresponding cerebral response from electroencephalography (EEG) data. Our goals were to characterize the functional brain networks originating from hands¿ MI and investigate the feasibility of using metrics from graph theory for the classification of mental patterns, generated by this strategy, of BCI users. We hypothesized that frequency alterations in the EEG spectra due to MI should reflect themselves, in some manner, in the graphs representing cortical interactions during these tasks. For data classification, different sets of electrode pairs were tested, as well as different classifiers (linear discriminant analysis ¿ LDA, and both linear and polynomial support vector machines ¿ SVMs). All three classifiers tested performed similarly in most cases. The mean classification rate over subjects, considering the best electrode set and classifier, was 78%, while some subjects achieved individual hit rates of up to 92%. Still, the employed methodology has yet some limitations, being the main one how to find the optimum electrode pairs¿ sets, which vary among subjects and among acquisitions; in addition to the problem of performing an online analysis / Mestrado / Física / Mestre em Física / 165742/2014-3 / 1423625/2014 / CNPQ / CAPES

Driver fatigue is a state of reduced mental alertness which impairs the performance of a range of cognitive and psychomotor tasks, including driving. According to the National Highway Traffic Safety Administration, driver fatigue was responsible for 72,000 accidents that lead to more than 800 deaths in 2015. A reliable method of driver fatigue detection is needed to prevent such accidents. There has been a great deal of research into studying driver fatigue via electroencephalography (EEG) to analyze brain wave data. These research works have produced three competing EEG data-based ratios that have the potential to detect driver fatigue. Research has shown these three ratios trend downward as fatigue increases. However, no empirical research has been conducted to determine whether drivers begin to feel fatigue at a certain Percent Change from an alert state to a fatigue state in one or more of these ratios. If a Percent Change could be identified for which drivers begin to feel fatigue, then it could be used as a method of fatigue detection in real-time system. This research focuses on answering this question by collecting brain wave data via an EEG device over a 60-minute driving session for 10 University of North Florida (UNF) students. A frequency distribution and cluster analysis was done to identify a common Percent Change for the participants who experienced fatigue. The results of the analysis were compared to a subset of users who did not experience fatigue to validate the findings. The project was approved by the UNF IRB on Nov. 1, 2016 (reference number 475514-4).