Cette thèse s’intéresse à la manière d’optimiser l’apprentissage du pilotage par l’amélioration de l’éducation du comportement oculaire. Dans divers domaines (e.g., médical, aéronautique), différentes méthodes d’éducation du comportement oculaire ont démontré leur efficacité quant à leur capacité à optimiser le temps d’apprentissage d’une tâche. Toutefois, dans le domaine du pilotage, cela n’a reçu que très peu de validation empirique (Ziv, 2016) notamment à cause de difficultés de mise en œuvre technique et méthodologique inhérentes à la nature dynamique et complexe de l’activité de pilotage (Eyrolle et al., 1996). Dans le but d’éduquer le comportement oculaire des élèves-pilotes, nous avons tout d’abord modélisé les caractéristiques du comportement oculaire à adopter. Puis nous avons conçu, développé et validé expérimentalement un outil spécifique, le PilotGazeTrainer, permettant de mettre en œuvre une nouvelle méthode originale d’éducation du comportement oculaire basée sur deux principes essentiels : l’analyse permanente du regard du participant, et l’affichage en temps-réel de feedbacks visuels ou sonores. Afin d’évaluer cette nouvelle méthode, nous avons réalisé plusieurs expérimentations sur un simulateur de vol et sur un micromonde développé pour l’occasion (l’AbstractFlyingTask). Les premiers résultats montrent que notre méthode permet, en très peu de temps, une modification durable du comportement oculaire bénéfique pour les personnes concernées. Ces résultats comportementaux ont également révélé le potentiel des outils développés – le micromonde AbstractFlyingTask et le PilotGazeTrainer – pour éduquer le comportement oculaire. / This thesis focuses on how to optimize the learning of piloting by improving the ocular behavior educationIn several fields (e.g., medical, aeronautics), various methods of ocular behavior educating have demonstrated their effectiveness in their ability to optimize the learning of a task. However, the education of ocular behavior has received few empirical validations in the field of piloting training (Ziv, 2016) especially because of difficulties in the technical and methodological implementation (e.g., real-time analysis of the gaze location) inherent in the dynamic and complex nature of the piloting situation (Eyrolle, Mariné & Mailles, 1996). In order to educate the ocular behavior of the pilot students, we first modeled the characteristics of the ocular behavior to be adopted. Then we designed, developed and validated experimentally a first specific tool, the PilotGazeTrainer (a software), which allows the implementation of a new and original method of ocular behavior education based on two essential principles: the permanent analysis of the participant's ocular behavior, and the production in real-time of visual or sound feedbacks. In order to evaluate this new method, we conducted several experiments on a flight simulator and on a microworld developed for the purposes of this evaluation (the AbstractFlyingTask). The first results show that our method allows a lasting modification of the ocular behavior in a very short intervention time. These behavioral results also revealed the potential of the developed tools - the AbstractFlyingTask microworld and the PilotGazeTrainer - to educate ocular behavior.

In this thesis, we explore the potential benefits of leveraging eye-tracking information for dependency parsing on the English part of the Dundee corpus. To achieve this, we cast dependency parsing as a sequence labelling task and then augment the neural model for sequence labelling with eye-tracking features. We also augment a graph-based parser with eye-tracking features and parse the Dundee Corpus to corroborate our findings from the sequence labelling parser. We then experiment with a variety of parser setups ranging from parsing with all features to a delexicalized parser. Our experiments show that for a parser with all features, although the improvements are positive for the LAS score they are not significant whereas our delexicalized parser significantly outperforms the baseline we established. We also analyze the contribution of various eye-tracking features towards the different parser setups and find that eye-tracking features contain information which is complementary in nature, thus implying that augmenting the parser with various gaze features grouped together provides better performance than any individual gaze feature. 1

Syftet med denna studie är att undersöka vilken information om matematiska strategier som går att urskilja ur en persons ögonrörelser vid en undersökning med en enklare typ av eye-tracker. Eye-tracking är en metod som gör det möjligt att studera människors ögonrörelser genom att följa den visuella uppmärksamheten utifrån vart en person tittar. I studien används en stationär eye-tracker för att kunna mäta ögonrörelserna. I den här studien har eye-tracking-undersökningar genomförts med två deltagare som tittar på och löser matematiska uppgifter som kräver prioritering. Den här studien använder en billig (kostar cirka 1000 SEK) kommersiell eye-tracker med ett egentillverkat datainsamlingsprogram. Resultatet av studien visade att det gick att utläsa information och baserat på det gick det att tolka att deltagarna verkligen använde sig av prioriteringsreglerna vid uppgifterna. / The aim of this study is to investigate what information can be gathered by studying a person’s eye movements with a simpler kind of eye-tracker device. Eye-tracking is a technique that allows studying eye movements. In this study a stationary eye-tracking device was used to study and measure eye movements. This study is an original eyetracking study, consisting of two participants who solved mathematical problems that require the use of order of operations whilst wearing an eye-tracker device. The device was a relatively cheap (cost around 1000 SEK) commercial eye-tracker with a home-made data acquisition software system. The result of the study is that it is indeed possible to collect and interpret information using an eye-tracker. Based on the results the conclusion can be made that the participants used the order of operations to solve the assignments.

An early detection of hearing loss in children is important for the child's speech and language development. For children between 3-6 months, a reliable method to measure hearing and determine hearing thresholds is missing. A hearing test based on the pupillary response to auditory signal detection as measured by eye tracking is based on an automatic physiological response. This hearing test could be used instead of the objective hearing tests used today. The presence of pupillary response has been shown in response to speech, but it is unstudied in response to sinus tones. The objective of this thesis was to study whether there is a consistent pupillary response to different sinus tone frequencies commonly used in hearing tests and if yes, to determine reliably the time window of this response. Four different tests were done. The adult pupillary response in regard to sinus tone stimuli with four frequency levels (500 Hz, 1000 Hz, 2000 Hz and 4000 Hz), and four loudness levels (silence, 30 dB, 50 dB and 70 dB) was tested (N=20, 15 females, 5 males). Different brightness levels and distractions on the eye tracking screen were investigated in three substudies (N=5, 4 females, 1 male). Differences between silence and loudness levels within frequency levels were tested for statistical significance. A pupillary response in regard to sinus tones occurred consistently between 300 ms and 2000 ms with individual variation, i.e. earlier than for speech sounds. Differences between silence and loudness levels were only statistically significant for 4000 Hz. No statistical difference was shown between different brightness levels or if there were distractions present on the eye tracker screen. The conclusion is that pupillary response to pure sinus tones in adults is a possible measure of hearing threshold for at least 4000 Hz. Larger studies are needed to confirm this, and also to more thoroughly investigate the other frequencies. / En tidig upptäckt av hörselnedsättning hos barn är viktig för barnets tal- och språkutveckling. För barn mellan 3-6 månader saknas det en tillförlitlig metod för att mäta hörsel och bestämma hörtrösklar. Ett hörseltest baserad på pupillreaktion på ljud som mäts med en eye tracker bygger på en automatisk fysiologisk reaktion och skulle kunna användas istället för de objektiva test som används idag. Hitintills har pupillreaktion på tal påvisats, men det saknas studier som studerat eventuella reaktioner på sinustoner. Syftet med denna uppsats var att undersöka om det finns en enhetlig pupillreaktion på de olika frekvenserna av sinustoner som vanligen används i hörseltest. Vidare var studiens syfte att fastställa ett tillförlitligt tidsfönster för pupillreaktion. Fyra olika typer av tester utfördes. Pupillreaktionen mot sinustoner med fyra olika frekvensnivåer (500 Hz, 1000 Hz, 2000 Hz och 4000 Hz), och fyra olika ljudnivåer (tystnad, 30 dB, 50 dB och 70 dB) undersöktes i ett test på vuxna deltagare (N=20, 15 kvinnor, 5 män). Olika ljusnivåer och distraktioner på eye tracker-skärmen undersöktes i tre test (N=5, 4 kvinnor, 1 man). Skillnaderna mellan ljudnivåer och frekvensnivåer testades med statistiska tester. Resultaten visade att pupillreaktion på sinustoner inträffade konsekvent mellan 300 ms och 2000 ms med individuella variationer. Denna reaktionstid inträffar tidigare än för taljud. En statistisk signifikant skillnad mellan tystnad och olika ljudnivåer kunde endast ses för frekvensnivån 4000 Hz. Ingen statistisk skillnad uppmättes mellan olika ljudnivåer eller om det fanns distraktioner på eye tracker-skärmen. De i studien framkomna resultaten tyder på att pupillreaktioner mot rena sinustoner hos vuxna är en möjlig metod för att identifiera hörseltrösklar för åtminstone 4000 Hz. Större studier behöver göras för att fastställa detta och en noggrannare undersökning behöver genomföras för de andra frekvenserna.

No description available.

[pt] O Autismo é um transtorno do neurodesenvolvimento caracterizado por prejuízos na interação social, na comunicação e no comportamento. Um dos deficit apresentados em seu escopo é no reconhecimento de emoções, apontando para uma série de estratégias de visualização atípicas, tais como: olhar reduzido para estímulos sociais; preferência para a região da boca em vez dos olhos e dificuldades em fixar a atenção. Todavia, não existe um consenso, até o momento, sobre os fatores que podem acarretar tais prejuízos, bem como se existe um padrão característico do rastreio viso espacial para essa população. Com base nesses dados, que a presente dissertação desenvolveu um paradigma de rastreio visual no reconhecimento de emoções em crianças do Espectro Autista (EA). Para tanto, foi necessária uma revisão sistemática, que a partir de uma seleção criteriosa, verificou 65 paradigmas investigados na avaliação do Transtorno do Espectro Autista (TEA) que utilizaram o Eye-tracker como instrumento. A partir de então foi desenvolvido um roteiro para a posterior programação das tarefas. O paradigma de rastreio foi, então, aplicado em quatro crianças diagnosticadas com TEA, que compunham o grupo experimental e em três com desenvolvimento típico para controle, com a finalidade de avaliar a sua aplicabilidade. E embora existam limitações na tarefa que precisam passar por adaptações, foi possível verificar que os participantes do grupo experimental tiveram a duração da tarefa ampliada em decorrência de uma dificuldade na fixação do olhar, bem como tiveram o desempenho prejudicado no reconhecimento das emoções. Esses dados, junto a outros estudos, sugerem que os indivíduos do espectro autista utilizam estratégias visuais atípicas. Entretanto mais pesquisas são necessárias sobre o assunto. / [en] Autism is a neurodevelopmental disorder characterized by impairments in social interaction, communication and behavior. One of the deficits presented in its scope is the emotions recognition, pointing to a number of atypical visualization strategies, such as: reduced look at social stimuli; preference for the mouth instead of the eyes region, and difficulties in fixing attention. However, there is no consensus so far on the factors that can lead to such damages, as well as whether there is a characteristic pattern of visuospatial screening for that population. Based on these data, this dissertation developed a visual tracking paradigm in the recognition of emotions in children of the Autistic Spectrum (EA). Therefore, a system-atic review was necessary, which, based on a careful selection, verified 65 paradigms investigated in the evaluation of Autistic Spectrum Disorder (ASD) and that used the Eye-tracker as instrument. From then on, a script was developed for later tasks programming. The screening paradigm was then applied in four children diagnosed with ASD, who composed the experimental group, and in three with typical development, to control, to evaluate its applicability. Although there are limitations in the task, that must undergo adaptations, it was possible to verify that the participants of the experimental group had a longer duration of the task, due to it s difficulty in fixing the look, as well as they had the performance impaired in the emotions recognition. These data, along with other studies, suggest that individuals on the autistic spectrum use atypical visual strategies. However more research is needed on the subject.

Published Article / This study evaluated the difficulty, in terms of usability, of upgrading from one version of a word processor user interface (Microsoft Word 2003) to another (2007). Laboratory-based usability testing involving 23 participants, who had never used Microsoft Word 2007 before, was conducted. All participants used the two versions in a repeated-measures experimental design. A Tobii 1750 Eye Tracker was used for screen recordings during testing. Participants were also required to fill in user satisfaction questionnaires. Results from the usability test showed that, in terms of usability, migrating from an original interface to a completely changed user interface is not easy.

I relation till andra former är banner en av de mest uppskattade annonsformerna. Dock har det utvecklats fenomen så som banner blindness och annonsblockering vilket förhindrar att betraktare tar till sig reklamen och agerar. Syftet med denna studie har varit att undersöka om generation Y registrerar banners på Internet samt hur deras attityder är gentemot banners som annonsform. Detta undersöktes via ett eye-tracker experiment med kompletterande enkät där urvalet var 30 kvinnor och 30 män som studerade i Borås, Sverige. Resultatet blev att kvinnor och män i generation Y registrerar banners, tittar liknande på dem och generellt är attityden mindre positiv mot banners. Undersökningen fann även att innehållet i form av text, placerad till höger samt under huvudinnehållet på en webbsida uppmärksammades av flest. Detta indikerar att utformning av innehåll och placering är av betydelse.

Η εξέλιξη των συνεργατικών εφαρμογών χαρακτηρίζεται από συνεχή δημιουργία και βελτίωση μηχανισμών που προάγουν και διευκολύνουν τη συνεργασία. Η ενημερότητα και η εστίαση προσοχής αναμφισβήτητα παίζουν κύριο ρόλο σε μία επιτυχημένη συνεργασία, γιατί υποδεικνύουν άμεσα αν ο χρήστης έχει γνώση και αντίληψη της κατάστασης των συνεργατών του. Στην εφαρμογή Synergo που αναπτύσσεται από την Ερευνητική Ομάδα Επικοινωνίας Ανθρώπου-Υπολογιστή (Human-Computer Interaction Group - HCI Group)υ τμήματος Ηλεκτρολόγων Μηχανικών και Τεχνολογίας Υπολογιστών της Πολυτεχνικής σχολής του πανεπιστημίου Πατρών και υποστηρίζει τη συνεργασία χρηστών κατά τη δημιουργία διαγραμμάτων σε κοινή επιφάνεια εργασίας, προστέθηκαν μηχανισμοί που βελτιώνουν την ενημερότητα και την εστίαση προσοχής του χρήστη. Αναπτυσσονται οι έννοιες της συνεργασίας μέσω υπολογιστή, των φαινομένων προσοχής και της ενημερότητας επιφάνειας εργασίας. Αφού γίνεται μία θεωρητική προσέγγιση στις παραπάνω έννοιες, γίνεται επισκόπιση του εργαλείου eye-tracker, περιγραφή της εφαρμογής Synergo και εξηγείται ο τρόπος προσαρμογής των συγκεκριμένων μηχανισμών. Αναλύεται λεπτομερώς το πειραματικό στάδιο και τα αποτελέσματά του και γίνεται αξιολόγηση και προτάσεις για δυνατές μελλοντικές τροποποιήσεις της εφαρμογής / The evolution of collaborative software is characterized by continuous creation and improvement of the mechanisms that promote and help communication. Awareness and attention shifting indisputably play the first role in a successful collaboration because they show directly if the user has the knowledge and the perception of his partners' state. In Synergo, a software that is developed from the Human-Computer Interaction Group - (HCI Group) of Electrical Engineering and Computer Technology department of Patra's University and supports the collaboration between users during the creation of conceptual graphs in a common workspace, mechanisms that improve user's awareness attention were developed.The concepts of computer supported cooperative work, attention phenomena and workspace awareness are explained. After a theoretical approach of the above concepts, eye tracker and Synergo software are being described and the adding of the mechanisms is being explained.The experimental stadium and it's results are described with every detail and the software is evaluated. There are also proposals for possible future improvements.

Tesis para optar al grado de Magíster en Gestión de Operaciones / Memoria para optar al título de Ingeniero Civil Industrial / Este trabajo busca generar tres modelos de predicción: fijaciones en áreas de interés que los usuarios visitan durante su navegación en un sitio web específico, fijaciones realizadas en las diferentes coordenadas del sitio, e indicadores mentales, bajo condiciones ambientales controladas, de iluminación y tarea asignada. Se basa en la experimentación llevada a cabo por Cristian Retamal [88] en el Estudio del comportamiento de la carga cognitiva de usuarios que navegan en un sitio web , bajo el contexto del proyecto Fondecyt A Cognitive Resource-Aware Mobile Service Framework to Support Human-Computer-Interactions in Ubiquitous Computing Environments , liderado por el Profesor Ángel Jiménez. La predicción del primer modelo utiliza señales fisio-psicológicas: Eye tracker, sensor de respuesta electrodermal (GSR), Sensor de Temperatura de la piel (ST) y fotopletismógrafo (PPG), para estudiar las transiciones entre zonas agrupadas semánticamente, basado en ventanas de tiempo de 5 segundos (parámetro a elección), pronosticando secuencias de áreas de interés, y aproximándose a una predicción en tiempo real. El modelo se basa en tres etapas, Predicción de intención de visita de cada área de interés , es decir, que zonas elige visitar cada usuario en cada ventana de tiempo, la Asignación de estado mental del usuario en cada ventana de tiempo, a partir de variables fisio-psicológicas y Algoritmo de generación de caminos visuales , etapa final en la cual se consideran los resultados anteriores para entregar la predicción se secuencias para una ventana de tiempo. Para llevar a cabo estas etapas, se utilizan respectivamente los métodos de Clasificación multi-etiqueta , Hard clustering y Redes neuronales recurrentes . El segundo modelo utiliza datos de mirada (fijaciones, sacadas y puntos indefinidos) registrados por el EyeTracker para generar densidades de probabilidad en las zonas de la página que son atendidas por el usuario. Utiliza redes neuronales recurrentes con mezclas de densidades gaussianas para generar secuencias de probabilidades de movimientos oculares registrados en una ventana de tiempo. Este modelo se basa en una arquitectura encoder decoder, donde los datos de mirada son codificados por una red neuronal recurrente bidireccional y decodificados en los parámetros de las distribuciones gaussianas a ser mezcladas. El tercer modelo utiliza cluster de K-mean para categorizar las ventanas de tiempo con los diferentes índices mentales. Posteriormente se utilizan métodos de clasificación de secuencias para las señales EEG, para la predicción de cada índice mental, utilizando las señales fisiológicas del usuario, usando una arquitectura encoder-decoder. Todos los modelos se evalúan con validación cruzada de diez conjuntos de entrenamientoprueba,utilizando diferentes medidas de distancia para cada caso.