Interfaces cérebro-computador ou Interfaces cérebro-máquina (BCIs/BMIs do inglês Brain-computer interface/Brain-machine interface) são dispositivos que permitem ao usuário interagir com o ambiente ao seu redor sem que seja necessário ativar seus músculos esqueléticos. Estes dispositivos são de extrema valia para indivíduos portadores de deficiências motoras. Esta dissertação ambiciona revisar a literatura acerca de BMIs e expor diferentes técnicas de pré-processamento, extração de características e classificação de sinais neurofisiológicos. Em particular, uma maior ênfase será dada à Máquina de vetor de suporte (SVM do inglês Support-Vector machine), método de classificação baseado no princípio da minimização do risco estrutural. Será apresentado um estudo de caso, que ilustra o funcionamento de uma BMI, a qual permite ao usuário escolher um dentre seis objetos mostrados em uma tela de computador. Esta capacidade da BMI é conseqüência da implementação, através da SVM de um sistema capaz de detectar o potencial evocado P300 nos sinais de eletroencefalograma (EEG). A simulação será realizada em Matlab usando, como sinais de entrada, amostras de EEG de quatro indivíduos saudáveis e quatro deficientes. A análise estatística mostrou que o bom desempenho obtido pela BMI (80,73% de acerto em média) foi promovido pela aplicação da média coerente aos sinais, o que melhorou a relação sinal-ruído do EEG. / Brain-computer interfaces (BCIs) or Brain-machine interfaces (BMIs) technology provide users with the ability to communicate and control their environment without employing normal output pathway of peripheral nerves and muscles. This technology can be especially valuable for highly paralyzed patients. This thesis reviews BMI research, techniques for preprocessing, feature extracting and classifying neurophysiological signals. In particular, emphasis will be given to Support-Vector Machine (SVM), a classification technique, which is based on structural risk minimization. Additionally, a case study will illustrate the working principles of a BMI which analyzes electroencephalographic signals in the time domain as means to decide which one of the six images shown on a computer screen the user chose. The images were selected according to a scenario where users can control six electrical appliances via a BMI system. This was done by exploiting the Support-Vector Machine ability to recognize a specific EEG pattern (the so-called P300). The study was conducted offline within the Matlab environment and used EEG datasets recorded from four disabled and four able-bodied subjects. A statistical survey of the results has shown that the good performance attained (80,73%) was due to signal averaging method, which enhanced EEG signal-to-noise ratio.

Analisando-se os ambientes comerciais do setor imobiliário, pode-se verificar a presença frequente de maquetes que hoje fazem parte dos estandes de vendas dos edifícios. As maquetes são peças frágeis, de custo elevado, considerável prazo de execução e têm pequena vida útil, sendo usualmente descartadas no desmonte do estande de vendas. Nos estandes de vendas pode-se encontrar também o apartamento modelo decorado, com custos ainda mais elevados. É nesse ambiente que o MVE (Modelo Virtual Exploratório) se torna importante para os setores da construção e imobiliário, cujos mercados são cada vez mais competitivos, onde há a real necessidade da diminuição dos custos, da diminuição dos prazos de execução e do aumento da qualidade dos produtos. Por se tratar de um importante tema de pesquisa científica, este trabalho propôs o desenvolvimento do MVE para venda imobiliária residencial. O MVE foi modelado com um programa CAD (Computer-Aided Design) / BIM (Building Information Modeling) que se mostrou adequado às exigências levantadas na pesquisa. Avaliou-se o MVE através de estudos de caso em empreendimentos imobiliários reais, com corretores e clientes. Os resultados obtidos mostraram que o MVE pode ser desenvolvido com custo e prazo muito inferiores aos da maquete ou apartamento modelo e que tem grande aceitação tanto pelos profissionais de vendas quanto pelos clientes de empreendimentos imobiliários. / Examining the business environment of the real estate sector, it can be verified the large number of architectural mockups that today are part of real estate points-of-sale. Mockups are fragile, expensive, take considerable time to be made and have a short life span, as they are discarded when the sales booth is decommissioned. In the sales booths, it is also possible to find full size furnished mock-up flats, with even higher costs. In this environment, the MVE (Exploratory Virtual Model) becomes important for the construction and real estate industries, whose markets are increasingly competitive, where there is a real need to reduce costs, to decrease in execution times and to increase product quality. As it is an important topic of scientific research, this paper proposes the MVE development for selling residential real estate property. The MVE was modeled with a CAD (Computer-Aided Design) / BIM (Building Information Modeling) tool which proved adequate to meet requirements raised in the survey. The MVE was evaluated through case studies in real estate ventures with brokers and customers. Results show that MVE can be developed with much lower cost and in shorter time than the architectural mockup or the mock-up flat and that it has very well accepted both by real estate sales professionals and clients.

<p>A Real-Time Brain-Computer Interface is a technical system classifying increased or decreased brain activity in Real-Time between different body movements, actions performed by a person. Focus in this thesis will be on testing algorithms and settings, finding the initial time interval and how increased activity in the brain can be distinguished and satisfyingly classified. The objective is letting the system give an output somewhere within 250ms of a thought of an action, which will be faster than a persons reaction time. </p><p>Algorithms in the preprocessing were Blind Signal Separation and the Fast Fourier Transform. With different frequency and time interval settings the algorithms were tested on an offline Electroencephalographic data file based on the "Ten Twenty" Electrode Application System, classified using an Artificial Neural Network. </p><p>A satisfying time interval could be found between 125-250ms, but more research is needed to investigate that specific interval. A reduction in frequency resulted in a lack of samples in the sample window preventing the algorithms from working properly. A high frequency is therefore proposed to help keeping the sample window small in the time domain. Blind Signal Separation together with the Fast Fourier Transform had problems finding appropriate correlation using the Ten-Twenty Electrode Application System. Electrodes should be placed more selectively at the parietal lobe, in case of requiring motor responses.</p>

The main objective of the presented research is to design, fabricate, fully characterize, and assess the usability and functionality of a novel wireless tongue-operated assistive technology, called Tongue Drive System (TDS), that allows individuals with severe physical disabilities (such as quadriplegics) to effectively access computers, drive powered wheelchairs, and control environments using their voluntary tongue motion. The system can wirelessly detect users' tongue movements using an array of magnetic sensors, and a magnetic tracer secured on the tongue, and translate them into a set of user-defined commands in real time, which can then be used to communicate with target devices in users' environment. The principal advantage of the TDS is that a combination of magnetic sensors and a small permanent magnet can capture a large number of tongue movements, each of which can represent one specific command. A set of dedicated tongue movements can be configured as specific commands for each individual user based on his/her preferences, lifestyle, and remaining abilities. As a result, this technology can benefit a wide range of potential users with different types of disabilities. The work carried out in this dissertation is largely split into three portions: (1) Development, fabrication and characterization of external TDS (eTDS) prototypes to verify the concept of TDS that is detecting and extracting user's intention through their voluntary tongue motion, utilizing a combination of magnetic sensors and a small magnet, as well as the application of this idea in the context of assistive technology. This part of the work is presented in Chapters IV, V and VI. (2) Assessment of the TDS performance in medium term usage for both computer access and wheelchair control. The main purpose of this work was to gain valuable insight into the TDS learning process and its current limiting factors, which could lead the way in designing new generations of TDS with improved usability. This portion of the work is described in Chapter VII. (3) Development and performance assessment of a multimodal TDS (mTDS), that operates based on the information collected from two independent input channels: the tongue motion and speech. This multimodal system expands the access beyond one input channel and therefore improves the speed of access by increasing the information transfer bandwidth between users and computers. This part of the work is presented in Chapters VIII and IX. This dissertation has contributed to the innovation and advancement of the start-of-the-art assistive technology research by exploring, realizing and validating the use of tongue motion as a voluntary motor output to substitute some of the lost arm and hand functions in people with severe disabilities for computer access, wheelchair navigation, and environmental control.

A Real-Time Brain-Computer Interface is a technical system classifying increased or decreased brain activity in Real-Time between different body movements, actions performed by a person. Focus in this thesis will be on testing algorithms and settings, finding the initial time interval and how increased activity in the brain can be distinguished and satisfyingly classified. The objective is letting the system give an output somewhere within 250ms of a thought of an action, which will be faster than a persons reaction time. Algorithms in the preprocessing were Blind Signal Separation and the Fast Fourier Transform. With different frequency and time interval settings the algorithms were tested on an offline Electroencephalographic data file based on the "Ten Twenty" Electrode Application System, classified using an Artificial Neural Network. A satisfying time interval could be found between 125-250ms, but more research is needed to investigate that specific interval. A reduction in frequency resulted in a lack of samples in the sample window preventing the algorithms from working properly. A high frequency is therefore proposed to help keeping the sample window small in the time domain. Blind Signal Separation together with the Fast Fourier Transform had problems finding appropriate correlation using the Ten-Twenty Electrode Application System. Electrodes should be placed more selectively at the parietal lobe, in case of requiring motor responses.

This study focuses on realization of a Brain Computer Interface (BCI)for the paralyzed to control assistive environmental devices. For this purpose, different motor imagery tasks are classified using different signal processing methods. Specifically, band-pass filtering, Laplacian filtering, and common average reference (CAR) filtering areused to enhance the EEG signal. For feature extraction / Common Spatial Pattern (CSP), Power Spectral Density (PSD), and Principal Component Analysis (PCA) are tested. Linear Feature Normalization (LFN), Gaussian Feature Normalization (GFN), and Unit-norm Feature Vector Normalization (UFVN) are studied in Support Vector Machine (SVM) and Artificial Neural Network (ANN) classification. In order to evaluate and compare the performance of the methodologies, classification accuracy, Cohen&rsquo / s kappa coefficient, and Nykopp&rsquo / s information transfer are utilized. The first experiments on classifying motor imagery tasks are realized on the 3-class dataset (V) provided for BCI Competition III. Also, a 4-class problem is studied using the dataset (IIa) provided for BCI Competition IV. Then, 5 different tasks are studied in the METU Brain Research Laboratory to find the optimum number and type of tasks to control a motor imagery based BCI. Thereafter, an interface is designed for the paralyzed to control assistive environmental devices. Finally, a test application is implemented and online performance of the design is evaluated.

The goal of a Brain-Computer Interface (BCI) consists of the development of a unidirectional interface between a human and a computer to allow control of a device only via brain signals. While the BCI systems of almost all other groups require the user to be trained over several weeks or even months, the group of Prof. Dr. Klaus-Robert Müller in Berlin and Potsdam, which I belong to, was one of the first research groups in this field which used machine learning techniques on a large scale. The adaptivity of the processing system to the individual brain patterns of the subject confers huge advantages for the user. Thus BCI research is considered a hot topic in machine learning and computer science. It requires interdisciplinary cooperation between disparate fields such as neuroscience, since only by combining machine learning and signal processing techniques based on neurophysiological knowledge will the largest progress be made.<br><br> In this work I particularly deal with my part of this project, which lies mainly in the area of computer science. I have considered the following three main points:<br><br> <b>Establishing a performance measure based on information theory:</b> I have critically illuminated the assumptions of Shannon's information transfer rate for application in a BCI context. By establishing suitable coding strategies I was able to show that this theoretical measure approximates quite well to what is practically achieveable.<br> <b>Transfer and development of suitable signal processing and machine learning techniques:</b> One substantial component of my work was to develop several machine learning and signal processing algorithms to improve the efficiency of a BCI. Based on the neurophysiological knowledge that several independent EEG features can be observed for some mental states, I have developed a method for combining different and maybe independent features which improved performance. In some cases the performance of the combination algorithm outperforms the best single performance by more than 50 %. Furthermore, I have theoretically and practically addressed via the development of suitable algorithms the question of the optimal number of classes which should be used for a BCI. It transpired that with BCI performances reported so far, three or four different mental states are optimal. For another extension I have combined ideas from signal processing with those of machine learning since a high gain can be achieved if the temporal filtering, i.e., the choice of frequency bands, is automatically adapted to each subject individually.<br> <b>Implementation of the Berlin brain computer interface and realization of suitable experiments:</b> Finally a further substantial component of my work was to realize an online BCI system which includes the developed methods, but is also flexible enough to allow the simple realization of new algorithms and ideas. So far, bitrates of up to 40 bits per minute have been achieved with this system by absolutely untrained users which, compared to results of other groups, is highly successful. / Ein Brain-Computer Interface (BCI) ist eine unidirektionale Schnittstelle zwischen Mensch und Computer, bei der ein Mensch in der Lage ist, ein Gerät einzig und allein Kraft seiner Gehirnsignale zu steuern. In den BCI Systemen fast aller Forschergruppen wird der Mensch in Experimenten über Wochen oder sogar Monaten trainiert, geeignete Signale zu produzieren, die vordefinierten allgemeinen Gehirnmustern entsprechen. Die BCI Gruppe in Berlin und Potsdam, der ich angehöre, war in diesem Feld eine der ersten, die erkannt hat, dass eine Anpassung des Verarbeitungssystems an den Menschen mit Hilfe der Techniken des Maschinellen Lernens große Vorteile mit sich bringt. In unserer Gruppe und mittlerweile auch in vielen anderen Gruppen wird BCI somit als aktuelles Forschungsthema im Maschinellen Lernen und folglich in der Informatik mit interdisziplinärer Natur in Neurowissenschaften und anderen Feldern verstanden, da durch die geeignete Kombination von Techniken des Maschinellen Lernens und der Signalverarbeitung basierend auf neurophysiologischem Wissen der größte Erfolg erzielt werden konnte.<br><br> In dieser Arbeit gehe ich auf meinem Anteil an diesem Projekt ein, der vor allem im Informatikbereich der BCI Forschung liegt. Im Detail beschäftige ich mich mit den folgenden drei Punkten:<br><br> <b>Diskussion eines informationstheoretischen Maßes für die Güte eines BCI's:</b> Ich habe kritisch die Annahmen von Shannon's Informationsübertragungsrate für die Anwendung im BCI Kontext beleuchtet. Durch Ermittlung von geeigneten Kodierungsstrategien konnte ich zeigen, dass dieses theoretische Maß den praktisch erreichbaren Wert ziemlich gut annähert.<br> <b>Transfer und Entwicklung von geeigneten Techniken aus dem Bereich der Signalverarbeitung und des Maschinellen Lernens:</b> Eine substantielle Komponente meiner Arbeit war die Entwicklung von Techniken des Machinellen Lernens und der Signalverarbeitung, um die Effizienz eines BCI's zu erhöhen. Basierend auf dem neurophysiologischem Wissen, dass verschiedene unabhängige Merkmale in Gehirnsignalen für verschiedene mentale Zustände beobachtbar sind, habe ich eine Methode zur Kombination von verschiedenen und unter Umständen unabhängigen Merkmalen entwickelt, die sehr erfolgreich die Fähigkeiten eines BCI's verbessert. Besonders in einigen Fällen übertraf die Leistung des entwickelten Kombinationsalgorithmus die beste Leistung auf den einzelnen Merkmalen mit mehr als 50 %. Weiterhin habe ich theoretisch und praktisch durch Einführung geeigneter Algorithmen die Frage untersucht, wie viele Klassen man für ein BCI nutzen kann und sollte. Auch hier wurde ein relevantes Resultat erzielt, nämlich dass für BCI Güten, die bis heute berichtet sind, die Benutzung von 3 oder 4 verschiedenen mentalen Zuständen in der Regel optimal im Sinne von erreichbarer Leistung sind. Für eine andere Erweiterung wurden Ideen aus der Signalverarbeitung mit denen des Maschinellen Lernens kombiniert, da ein hoher Erfolg erzielt werden kann, wenn der temporale Filter, d.h. die Wahl des benutzten Frequenzbandes, automatisch und individuell für jeden Menschen angepasst wird.<br> <b>Implementation des Berlin Brain-Computer Interfaces und Realisierung von geeigneten Experimenten:</b> Eine weitere wichtige Komponente meiner Arbeit war eine Realisierung eines online BCI Systems, welches die entwickelten Methoden umfasst, aber auch so flexibel ist, dass neue Algorithmen und Ideen einfach zu verwirklichen sind. Bis jetzt wurden mit diesem System Bitraten von bis zu 40 Bits pro Minute von absolut untrainierten Personen in ihren ersten BCI Experimenten erzielt. Dieses Resultat übertrifft die bisher berichteten Ergebnisse aller anderer BCI Gruppen deutlich. <br> <hr> Bemerkung:<br> Der Autor wurde mit dem <i>Michelson-Preis</i> 2005/2006 für die beste Promotion des Jahrgangs der Mathematisch-Naturwissenschaftlichen Fakultät der Universität Potsdam ausgezeichnet.

With the improvement of multimedia technologies such as broadband-enabled HDTV, video on demand and internet TV, the computer and the TV are merging to become a single device. Moreover the previously cited technologies as well as DVD or Blu-ray can provide menu navigation and interactive content. The growing interest in video conferencing led to the integration of the webcam in different devices such as laptop, cell phones and even the TV set. Our approach is to directly use an embedded webcam to remotely control a TV set using hand gestures. Using specific gestures, a user is able to control the TV. A dedicated interface can then be used to select a TV channel, adjust volume or browse videos from an online streaming server. This approach leads to several challenges. The first is the use of a simple webcam which leads to a vision based system. From the single webcam, we need to recognize the hand and identify its gesture or trajectory. A TV set is usually installed in a living room which implies constraints such as a potentially moving background and luminance change. These issues will be further discussed as well as the methods developed to resolve them. Video browsing is one example of the use of gesture recognition. To illustrate another application, we developed a simple game controlled by hand gestures. The emergence of 3D TVs is allowing the development of 3D video conferencing. Therefore we also consider the use of a stereo camera to recognize hand gesture.

以肢體動作為基礎的人機介面一直被認為是未來家庭人機介面的表徵，然而，由於缺乏適合的應用環境和辨識技術，相關的應用尚未成熟。本研究嘗試提出一個互動式仿鏡顯示裝置作為肢體指令的平台，並提出相關的辨識技術，以設計一個可應用在智慧家庭環境中，符合人因工程的互動顯示裝置。 / Gesture-based user interfaces have long been associated with the image of future technology. However, due to the lack of proper environments and recognition technologies, practical applications of intelligent user interfaces are still rare in modern life. In this research, we propose an interactive mirror which can be controlled by gesture commands. We also provide several recognition techniques for this interactive display device. Practical applications are developed on this smart mirror, and user test is conducted to evaluate this novel user interface.

L'interface cerveau-ordinateur (ICO) décode les signaux électriques du cerveau requise par l’électroencéphalographie et transforme ces signaux en commande pour contrôler un appareil ou un logiciel. Un nombre limité de tâches mentales ont été détectés et classifier par différents groupes de recherche. D’autres types de contrôle, par exemple l’exécution d'un mouvement du pied, réel ou imaginaire, peut modifier les ondes cérébrales du cortex moteur. Nous avons utilisé un ICO pour déterminer si nous pouvions faire une classification entre la navigation de type marche avant et arrière, en temps réel et en temps différé, en utilisant différentes méthodes. Dix personnes en bonne santé ont participé à l’expérience sur les ICO dans un tunnel virtuel. L’expérience fut a était divisé en deux séances (48 min chaque). Chaque séance comprenait 320 essais. On a demandé au sujets d’imaginer un déplacement avant ou arrière dans le tunnel virtuel de façon aléatoire d’après une commande écrite sur l'écran. Les essais ont été menés avec feedback. Trois électrodes ont été montées sur le scalp, vis-à-vis du cortex moteur. Durant la 1re séance, la classification des deux taches (navigation avant et arrière) a été réalisée par les méthodes de puissance de bande, de représentation temporel-fréquence, des modèles autorégressifs et des rapports d’asymétrie du rythme β avec classificateurs d’analyse discriminante linéaire et SVM. Les seuils ont été calculés en temps différé pour former des signaux de contrôle qui ont été utilisés en temps réel durant la 2e séance afin d’initier, par les ondes cérébrales de l'utilisateur, le déplacement du tunnel virtuel dans le sens demandé. Après 96 min d'entrainement, la méthode « online biofeedback » de la puissance de bande a atteint une précision de classification moyenne de 76 %, et la classification en temps différé avec les rapports d’asymétrie et puissance de bande, a atteint une précision de classification d’environ 80 %. / A Brain-Computer Interface (BCI) decodes the brain signals representing a desire to do something, and transforms those signals into a control command. However, only a limited number of mental tasks have been previously detected and classified. Performing a real or imaginary navigation movement can similarly change the brainwaves over the motor cortex. We used an ERS-BCI to see if we can classify between movements in forward and backward direction offline and then online using different methods. Ten healthy people participated in BCI experiments comprised two-sessions (48 min each) in a virtual environment tunnel. Each session consisted of 320 trials where subjects were asked to imagine themselves moving in the tunnel in a forward or backward motion after a randomly presented (forward versus backward) command on the screen. Three EEG electrodes were mounted bilaterally on the scalp over the motor cortex. Trials were conducted with feedback. In session 1, Band Power method, Time-frequency representation, Autoregressive models and asymmetry ratio were used in the β rhythm range with a Linear-Discriminant-analysis classifier and a Support Vector Machine classifier to discriminate between the two mental tasks. Thresholds for both tasks were computed offline and then used to form control signals that were used online in session 2 to trigger the virtual tunnel to move in the direction requested by the user's brain signals. After 96 min of training, the online band-power biofeedback training achieved an average classification precision of 76 %, whereas the offline classification with asymmetrical ratio and band-power achieved an average classification precision of 80%.