221 |
A Multi-Modal, Modified-Feedback and Self-Paced Brain-Computer Interface (BCI) to Control an Embodied Avatar's GaitAlchalabi, Bilal 12 1900 (has links)
Brain-computer interfaces (BCI) have been used to control the gait of a virtual self-avatar with the
aim of being used in gait rehabilitation. A BCI decodes the brain signals representing a desire to
do something and transforms them into a control command for controlling external devices.
The feelings described by the participants when they control a self-avatar in an immersive virtual
environment (VE) demonstrate that humans can be embodied in the surrogate body of an avatar
(ownership illusion). It has recently been shown that inducing the ownership illusion and then
manipulating the movements of one’s self-avatar can lead to compensatory motor control
strategies.
In order to maximize this effect, there is a need for a method that measures and monitors
embodiment levels of participants immersed in virtual reality (VR) to induce and maintain a strong
ownership illusion. This is particularly true given that reaching a high level of both BCI
performance and embodiment are inter-connected. To reach one of them, the second must be
reached as well. Some limitations of many existing systems hinder their adoption for
neurorehabilitation: 1- some use motor imagery (MI) of movements other than gait; 2- most
systems allow the user to take single steps or to walk but do not allow both, which prevents users
from progressing from steps to gait; 3- most of them function in a single BCI mode (cue-paced or
self-paced), which prevents users from progressing from machine-dependent to machine-independent
walking. Overcoming the aforementioned limitations can be done by combining
different control modes and options in one single system. However, this would have a negative
impact on BCI performance, therefore diminishing its usefulness as a potential rehabilitation tool.
In this case, there will be a need to enhance BCI performance. For such purpose, many techniques
have been used in the literature, such as providing modified feedback (whereby the presented
feedback is not consistent with the user’s MI), sequential training (recalibrating the classifier as
more data becomes available).
This thesis was developed over 3 studies. The objective in study 1 was to investigate the possibility
of measuring the level of embodiment of an immersive self-avatar, during the performing,
observing and imagining of gait, using electroencephalogram (EEG) techniques, by presenting
visual feedback that conflicts with the desired movement of embodied participants.
The objective of study 2 was to develop and validate a BCI to control single steps and forward
walking of an immersive virtual reality (VR) self-avatar, using mental imagery of these actions, in
cue-paced and self-paced modes. Different performance enhancement strategies were
implemented to increase BCI performance.
The data of these two studies were then used in study 3 to construct a generic classifier that could
eliminate offline calibration for future users and shorten training time.
Twenty different healthy participants took part in studies 1 and 2. In study 1, participants wore an
EEG cap and motion capture markers, with an avatar displayed in a head-mounted display (HMD)
from a first-person perspective (1PP). They were cued to either perform, watch or imagine a single
step forward or to initiate walking on a treadmill. For some of the trials, the avatar took a step with
the contralateral limb or stopped walking before the participant stopped (modified feedback).
In study 2, participants completed a 4-day sequential training to control the gait of an avatar in
both BCI modes. In cue-paced mode, they were cued to imagine a single step forward, using their
right or left foot, or to walk forward. In the self-paced mode, they were instructed to reach a target
using the MI of multiple steps (switch control mode) or maintaining the MI of forward walking
(continuous control mode). The avatar moved as a response to two calibrated regularized linear
discriminant analysis (RLDA) classifiers that used the μ power spectral density (PSD) over the
foot area of the motor cortex as features. The classifiers were retrained after every session. During
the training, and for some of the trials, positive modified feedback was presented to half of the
participants, where the avatar moved correctly regardless of the participant’s real performance.
In both studies, the participants’ subjective experience was analyzed using a questionnaire. Results
of study 1 show that subjective levels of embodiment correlate strongly with the power differences
of the event-related synchronization (ERS) within the μ frequency band, and over the motor and
pre-motor cortices between the modified and regular feedback trials.
Results of study 2 show that all participants were able to operate the cued-paced BCI and the selfpaced
BCI in both modes. For the cue-paced BCI, the average offline performance (classification
rate) on day 1 was 67±6.1% and 86±6.1% on day 3, showing that the recalibration of the classifiers
enhanced the offline performance of the BCI (p < 0.01). The average online performance was
85.9±8.4% for the modified feedback group (77-97%) versus 75% for the non-modified feedback
group. For self-paced BCI, the average performance was 83% at switch control and 92% at
continuous control mode, with a maximum of 12 seconds of control. Modified feedback enhanced
BCI performances (p =0.001). Finally, results of study 3 show that the constructed generic models
performed as well as models obtained from participant-specific offline data. The results show that
there it is possible to design a participant-independent zero-training BCI. / Les interfaces cerveau-ordinateur (ICO) ont été utilisées pour contrôler la marche d'un égo-avatar virtuel dans le but d'être utilisées dans la réadaptation de la marche. Une ICO décode les signaux du cerveau représentant un désir de faire produire un mouvement et les transforme en une commande de contrôle pour contrôler des appareils externes.
Les sentiments décrits par les participants lorsqu'ils contrôlent un égo-avatar dans un environnement virtuel immersif démontrent que les humains peuvent être incarnés dans un corps d'un avatar (illusion de propriété). Il a été récemment démontré que provoquer l’illusion de propriété puis manipuler les mouvements de l’égo-avatar peut conduire à des stratégies de contrôle moteur compensatoire.
Afin de maximiser cet effet, il existe un besoin d'une méthode qui mesure et surveille les niveaux d’incarnation des participants immergés dans la réalité virtuelle (RV) pour induire et maintenir une forte illusion de propriété.
D'autre part, atteindre un niveau élevé de performances (taux de classification) ICO et d’incarnation est interconnecté. Pour atteindre l'un d'eux, le second doit également être atteint. Certaines limitations de plusieurs de ces systèmes entravent leur adoption pour la neuroréhabilitation: 1- certains utilisent l'imagerie motrice (IM) des mouvements autres que la marche; 2- la plupart des systèmes permettent à l'utilisateur de faire des pas simples ou de marcher mais pas les deux, ce qui ne permet pas à un utilisateur de passer des pas à la marche; 3- la plupart fonctionnent en un seul mode d’ICO, rythmé (cue-paced) ou auto-rythmé (self-paced). Surmonter les limitations susmentionnées peut être fait en combinant différents modes et options de commande dans un seul système. Cependant, cela aurait un impact négatif sur les performances de l’ICO, diminuant ainsi son utilité en tant qu'outil potentiel de réhabilitation. Dans ce cas, il sera nécessaire d'améliorer les performances des ICO. À cette fin, de nombreuses techniques ont été utilisées dans la littérature, telles que la rétroaction modifiée, le recalibrage du classificateur et l'utilisation d'un classificateur générique.
Le projet de cette thèse a été réalisé en 3 études, avec objectif d'étudier dans l'étude 1, la possibilité de mesurer le niveau d'incarnation d'un égo-avatar immersif, lors de l'exécution, de l'observation et de l'imagination de la marche, à l'aide des techniques encéphalogramme (EEG), en présentant une rétroaction visuelle qui entre en conflit avec la commande du contrôle moteur des sujets incarnés. L'objectif de l'étude 2 était de développer un BCI pour contrôler les pas et la marche vers l’avant d'un égo-avatar dans la réalité virtuelle immersive, en utilisant l'imagerie motrice de ces actions, dans des modes rythmés et auto-rythmés. Différentes stratégies d'amélioration des performances ont été mises en œuvre pour augmenter la performance (taux de classification) de l’ICO.
Les données de ces deux études ont ensuite été utilisées dans l'étude 3 pour construire des classificateurs génériques qui pourraient éliminer la calibration hors ligne pour les futurs utilisateurs et raccourcir le temps de formation.
Vingt participants sains différents ont participé aux études 1 et 2. Dans l'étude 1, les participants portaient un casque EEG et des marqueurs de capture de mouvement, avec un avatar affiché dans un casque de RV du point de vue de la première personne (1PP). Ils ont été invités à performer, à regarder ou à imaginer un seul pas en avant ou la marche vers l’avant (pour quelques secondes) sur le tapis roulant. Pour certains essais, l'avatar a fait un pas avec le membre controlatéral ou a arrêté de marcher avant que le participant ne s'arrête (rétroaction modifiée).
Dans l'étude 2, les participants ont participé à un entrainement séquentiel de 4 jours pour contrôler la marche d'un avatar dans les deux modes de l’ICO. En mode rythmé, ils ont imaginé un seul pas en avant, en utilisant leur pied droit ou gauche, ou la marche vers l’avant . En mode auto-rythmé, il leur a été demandé d'atteindre une cible en utilisant l'imagerie motrice (IM) de plusieurs pas (mode de contrôle intermittent) ou en maintenir l'IM de marche vers l’avant (mode de contrôle continu). L'avatar s'est déplacé en réponse à deux classificateurs ‘Regularized Linear Discriminant Analysis’ (RLDA) calibrés qui utilisaient comme caractéristiques la densité spectrale de puissance (Power Spectral Density; PSD) des bandes de fréquences µ (8-12 Hz) sur la zone du pied du cortex moteur. Les classificateurs ont été recalibrés après chaque session. Au cours de l’entrainement et pour certains des essais, une rétroaction modifiée positive a été présentée à la moitié des participants, où l'avatar s'est déplacé correctement quelle que soit la performance réelle du participant. Dans les deux études, l'expérience subjective des participants a été analysée à l'aide d'un questionnaire.
Les résultats de l'étude 1 montrent que les niveaux subjectifs d’incarnation sont fortement corrélés à la différence de la puissance de la synchronisation liée à l’événement (Event-Related Synchronization; ERS) sur la bande de fréquence μ et sur le cortex moteur et prémoteur entre les essais de rétroaction modifiés et réguliers. L'étude 2 a montré que tous les participants étaient capables d’utiliser le BCI rythmé et auto-rythmé dans les deux modes. Pour le BCI rythmé, la performance hors ligne moyenne au jour 1 était de 67±6,1% et 86±6,1% au jour 3, ce qui montre que le recalibrage des classificateurs a amélioré la performance hors ligne du BCI (p <0,01). La performance en ligne moyenne était de 85,9±8,4% pour le groupe de rétroaction modifié (77-97%) contre 75% pour le groupe de rétroaction non modifié. Pour le BCI auto-rythmé, la performance moyenne était de 83% en commande de commutateur et de 92% en mode de commande continue, avec un maximum de 12 secondes de commande. Les performances de l’ICO ont été améliorées par la rétroaction modifiée (p = 0,001). Enfin, les résultats de l'étude 3 montrent que pour la classification des initialisations des pas et de la marche, il a été possible de construire des modèles génériques à partir de données hors ligne spécifiques aux participants. Les résultats montrent la possibilité de concevoir une ICO ne nécessitant aucun entraînement spécifique au participant.
|
222 |
Silent speech recognition in EEG-based brain computer interfaceGhane, Parisa January 2015 (has links)
Indiana University-Purdue University Indianapolis (IUPUI) / A Brain Computer Interface (BCI) is a hardware and software system that establishes direct communication between human brain and the environment. In a BCI system, brain messages pass through wires and external computers instead of the normal pathway of nerves and muscles. General work ow in all BCIs is to measure brain activities, process and then convert them into an output readable for a computer.
The measurement of electrical activities in different parts of the brain is called electroencephalography (EEG). There are lots of sensor technologies with different number of electrodes to record brain activities along the scalp. Each of these electrodes captures a weighted sum of activities of all neurons in the area around that electrode.
In order to establish a BCI system, it is needed to set a bunch of electrodes on scalp, and a tool to send the signals to a computer for training a system that can find the important information, extract them from the raw signal, and use them to recognize the user's intention. After all, a control signal should be generated based on the application.
This thesis describes the step by step training and testing a BCI system that can be used for a person who has lost speaking skills through an accident or surgery, but still has healthy brain tissues. The goal is to establish an algorithm, which recognizes different vowels from EEG signals. It considers a bandpass filter to remove signals' noise and artifacts, periodogram for feature extraction, and Support Vector Machine (SVM) for classification.
|
223 |
EEG Source AnalysisCongedo, Marco 22 October 2013 (has links) (PDF)
Electroencephalographic data recorded on the human scalp can be modeled as a linear mixture of underlying dipolar source generators. The characterization of such generators is the aim of several families of signal processing methods. In this HDR we consider in several details three of such families, namely 1) EEG distributed inverse solutions, 2) diagonalization methods, including spatial filtering and blind source separation and 3) Riemannian geometry. We highlight our contributions in each of this family, we describe algorithms reporting all necessary information to make purposeful use of these methods and we give numerous examples with real data pertaining to our published studies. Traditionally only the single-subject scenario is considered; here we consider in addition the extension of some methods to the simultaneous multi-subject recording scenario. This HDR can be seen as an handbook for EEG source analysis. It will be particularly useful to students and other colleagues approaching the field.
|
224 |
A case for memory enhancement : ethical, social, legal, and policy implications for enhancing the memoryMuriithi, Paul Mutuanyingi January 2014 (has links)
The desire to enhance and make ourselves better is not a new one and it has continued to intrigue throughout the ages. Individuals have continued to seek ways to improve and enhance their well-being for example through nutrition, physical exercise, education and so on. Crucial to this improvement of their well-being is improving their ability to remember. Hence, people interested in improving their well-being, are often interested in memory as well. The rationale being that memory is crucial to our well-being. The desire to improve one’s memory then is almost certainly as old as the desire to improve one’s well-being. Traditionally, people have used different means in an attempt to enhance their memories: for example in learning through storytelling, studying, and apprenticeship. In remembering through practices like mnemonics, repetition, singing, and drumming. In retaining, storing and consolidating memories through nutrition and stimulants like coffee to help keep awake; and by external aids like notepads and computers. In forgetting through rituals and rites. Recent scientific advances in biotechnology, nanotechnology, molecular biology, neuroscience, and information technologies, present a wide variety of technologies to enhance many different aspects of human functioning. Thus, some commentators have identified human enhancement as central and one of the most fascinating subject in bioethics in the last two decades. Within, this period, most of the commentators have addressed the Ethical, Social, Legal and Policy (ESLP) issues in human enhancements as a whole as opposed to specific enhancements. However, this is problematic and recently various commentators have found this to be deficient and called for a contextualized case-by-case analysis to human enhancements for example genetic enhancement, moral enhancement, and in my case memory enhancement (ME). The rationale being that the reasons for accepting/rejecting a particular enhancement vary depending on the enhancement itself. Given this enormous variation, moral and legal generalizations about all enhancement processes and technologies are unwise and they should instead be evaluated individually. Taking this as a point of departure, this research will focus specifically on making a case for ME and in doing so assessing the ESLP implications arising from ME. My analysis will draw on the already existing literature for and against enhancement, especially in part two of this thesis; but it will be novel in providing a much more in-depth analysis of ME. From this perspective, I will contribute to the ME debate through two reviews that address the question how we enhance the memory, and through four original papers discussed in part three of this thesis, where I examine and evaluate critically specific ESLP issues that arise with the use of ME. In the conclusion, I will amalgamate all my contribution to the ME debate and suggest the future direction for the ME debate.
|
Page generated in 0.0288 seconds