Event-related brain potentials (ERPs) in electroencephalography are manifestations at the scalp of neural activity that is triggered by, and is involved in, the processing of specific events. This chapter focuses on braincomputer interfaces (BCIs) that use P300, an endogenous ERP component. The P300 is a positive potential that occurs over central-parietal scalp 250- 700 msec after a rare event occurs in the context of the oddball paradigm. This paradigm has three essential attributes: a subject is presented with a series of events (i.e., stimuli), each of which falls into one of two classes; the events that fall into one of the classes are less frequent than those that fall into the other class; and the subject performs a task that requires classifying each event into one of the two classes.

Conselho Nacional de Desenvolvimento Científico e Tecnológico / Many fatal traffic accidents are caused by fatigued and drowsy drivers. In this context, automatic drowsiness detection devices are an alternative to minimize this issue. In this work, two new methodologies to drowsiness detection are presented, considering a signal obtained from a single electroencephalography channel: (i) drowsiness detection through best m-term approximation, applied to the wavelet expansion of the analysed signal; (ii) drowsiness detection through Mahalanobis distance with wavelet coefficients. The results of both methodologies are compared with a method which uses Mahalanobis distance and Fourier coefficients to drowsiness detection. All methodologies consider the medical evaluation of the brain signal, given by the hypnogram, as a reference. / A sonolência diurna em motoristas, principal consequência da privação de sono, tem sido a causa de diversos acidentes graves de trânsito. Neste contexto, a utilização de dispositivos que alertem o condutor ao detectar automaticamente o estado de sonolência é uma alternativa para a minimização deste problema. Neste trabalho, duas novas metodologias para a detecção automática da sonolência são apresentadas, utilizando um único canal de eletroencefalografia para a obtenção do sinal: (i) detecção da sonolência via melhor aproximação por m-termos, aplicada aos coeficientes wavelets da expansão em série do sinal; e (ii) detecção da sonolência via distância de Mahalanobis e coeficientes wavelets. Os resultados de ambas as metodologias são comparados a uma implementação utilizando distância de Mahalanobis e coeficientes de Fourier. Para todas as metodologias, utiliza-se como referência a avaliação médica do sinal cerebral, dada pelo hipnograma.

<p dir="ltr">This research explored a solution to a high accident rate in remotely operating Unmanned Aerial Vehicles (UAVs) in a complex environment; it presented a new Brain-Computer Interface (BCI) enabled supervisory control system to fuse human and machine intelligence seamlessly. This study was highly motivated by the critical need to enhance the safety and reliability of UAV operations, where accidents often stemmed from human errors during manual controls. Existing BCIs confronted the challenge of trading off a fully remote control by humans and an automated control by computers. This study met such a challenge with the proposed supervisory control system to optimize human-machine collaboration, prioritizing safety, adaptability, and precision in operation.</p><p dir="ltr">The research work included designing, training, and testing BCI and the BCI-enabled control system. It was customized to control a UAV where the user’s motion intents and cognitive states were monitored to implement hybrid human and machine controls. The DJI Tello drone was used as an intelligent machine to illustrate the application of the proposed control system and evaluate its effectiveness through two case studies. The first case study was designed to train a subject and assess the confidence level for BCI in capturing and classifying the subject’s motion intents. The second case study illustrated the application of BCI in controlling the drone to fulfill its missions.</p><p dir="ltr">The proposed supervisory control system was at the forefront of cognitive state monitoring to leverage the power of an ML model. This model was innovative compared to conventional methods in that it could capture complicated patterns within raw EEG data and make decisions to adopt an ensemble learning strategy with the XGBoost. One of the key innovations was capturing the user’s intents and interpreting these into control commands using the EmotivBCI app. Despite the headset's predefined set of detectable features, the system could train the user’s mind to generate control commands for all six degrees of freedom of adapting to the quadcopter by creatively combining and extending mental commands, particularly in the context of the Yaw rotation. This strategic manipulation of commands showcased the system's flexibility in accommodating the intricate control requirements of an automated machine.</p><p dir="ltr">Another innovation of the proposed system was its real-time adaptability. The supervisory control system continuously monitors the user's cognitive state, allowing instantaneous adjustments in response to changing conditions. This innovation ensured that the control system was responsive to the user’s intent and adept at prioritizing safety through the arbitrating mechanism when necessary.</p>

Signals recorded from the brain often show rhythmic patterns at different frequencies, which are tightly coupled to the external stimuli as well as the internal state of the subject. These signals also have transient structures related to spiking or sudden onset of a stimulus, which have a duration not exceeding tens of milliseconds. Further, brain signals are highly non-stationary because both behavioral state and external stimuli can change over a short time scale. It is therefore essential to study brain signals using techniques that can represent both rhythmic and transient components of the signal. In Chapter 2, we describe a multi-scale decomposition technique based on an over-complete dictionary called matching pursuit (MP), and show that it is able to capture both sharp stimulus-onset transient and sustained gamma rhythm in local field potential recorded from the primary visual cortex. Gamma rhythm (30 to 80 Hz), often associated with high-level cortical functions, has been proposed to provide a temporal reference frame (“clock”) for spiking activity, for which it should have least center frequency variation and consistent phase for extended durations. However, recent studies have proposed that gamma occurs in short bursts and it cannot act as a reference. In Chapter 3, we propose another gamma duration estimator based on matching pursuit (MP) algorithm, which is tested with synthetic brain signals and found to be estimating the gamma duration efficiently. Applying this algorithm to real data from awake monkeys, we show that the median gamma duration is more than 330 ms, which could be long enough to support some cortical computations.