In this thesis, I investigate the link between A-movement and online processing in eye-tracking and self-paced reading (SPR). A-movement refers to movement of an element to an argument position, where an element may be base-generated and hold a semantic role of the main predicate of the clause. I analyze six constructions in English, divided into three experimental pairings. Unaccusative constructions argued to involve movement are contrasted with unergatives as control, in a purely intransitive pairing. Transitive verb expectations are controlled by contrasting optional transitive constructions and purported movement in inchoative constructions. Argument alternation is taken into consideration in comparing instrumental constructions and possible movement in middle constructions. The results from the SPR experiment did not show significant differences in reading times or fixation durations between pairings in any regions. In the eye-tracking results, no significant effects were found at the verb region, where the syntactic complexity of movement could lead to greater processing effort. In the subject noun region of the optional transitive and inchoative constructions and instrumental and middle constructions, significant differences in gaze duration, total fixation duration, and go-past time were found. These results are compatible with theories of frequency effects. Differences at the adverb could support lexical or derivational approaches, as controls and experimental conditions had equal length fixations in our first pairing, controls had longer fixations in our second pairing, and experimental items had longer fixations in our third pairing. Ultimately, the results do not offer strong support for the derivational approach, and are not accounted for through a lexical approach. / Thesis / Master of Science (MSc)

With the growing adoption of laparoscopic surgery practices, high quality training and qualification of laparoscopic skills through objective assessment has become critical. While eye-gaze and instrument motion analyses have demonstrated promise in producing objective metrics for skill assessment in laparoscopic surgery, three areas deserve further research attention. First, most eye-gaze metrics do not account for trainee behaviors that change the visual scene or context that can be addressed by computer vision. Second, feedforward control metrics leveraging on the relationship between eye-gaze and hand movements has not been investigated in laparoscopic surgery. Finally, eye-gaze metrics have not demonstrated sensitivity to skill progressions of trainees as the literature has focused on differences between experts and novices although feedback on skill acquisition is most useful for trainees or educators. To advance eye-gaze assessment in laparoscopic surgery, this research presents a three-stage gaze based assessment methodology to provide a standardized process for generating context-dependent gaze metrics and estimating the proficiency levels of medical trainees on surgery. The three stages are: (1) contextual scene analysis for segmenting surgical scenes into areas of interest, (2) compute context dependent gaze metrics based on eye fixation on areas of interest, and (3) defining and estimating skill proficiency levels with unsupervised and supervised learning, respectively. This methodology was applied to analyze 499 practice trials by nine medical trainees practicing the peg transfer task in the Fundamental of Laparoscopic Surgery program. The application of this methodology generated five context dependent gaze and one tool movement metrics, defined three proficiency levels of the trainees, and developed a model predicting proficiency level of a participant for a given trial with 99% accuracy. Further, two of six metrics are completely novel, capturing feed-forward behaviors in the surgical domain. The results also demonstrated that gaze metrics could reveal skill levels more precisely than between experts and novices as suggested in the literature. Thus, the metrics derived from the gaze based assessment methodology also shows high sensitive to trainee skill levels. The implication of this research includes providing automated feedback to trainees on where they have looked during practice trial and what skill proficiency level attained after each practice trial. / Master of Science / Laparoscopic surgery is type of minimally invasive surgery which is being widely adopted. Skills required for performing laparoscopic surgeries are different than open surgeries. Hence, it is critical to ensure that adequate training and assessment is provided to surgeons. Eye-gaze tracking technology has made it possible to compute metrics that could be employed for skill assessment. These metrics are based on involuntary gaze behaviors and are independent of the nature of the surgical training task being performed. Hence, they may not be suitable for feedback during training. Metrics suitable for feedback are context dependent metrics which take into account the task based information. Experts tend to show look-ahead behavior while performing a task which can be quantified using context dependent metrics. This research presents a three stage methodology which facilitates computation of context dependent metrics and feed-forward metrics enabling identification of different skill levels in trainees. Applying this methodology to dataset of nine trainees with 499 practice trials, a total of six metrics were computed and a classification model was built to predict three identified skill level with 99% accuracy. This research is directly applicable to developing an automated system for laparoscopic training and assessment.

Ziel der vorliegenden Arbeit ist es, den unwillkürlichen Einfluss emotionaler lexikaler Informationen auf frühe und anhaltende visuelle Aufmerksamkeitsprozesse bei gesunden Individuen zu explorieren. Dabei wird der Einfluss des Persönlichkeitsmerkmals Alexithymie auf das Blickverhalten untersucht. Denn alexithyme Individuen weisen Defizite in der Verarbeitung von emotionalen Informationen aus der Umwelt auf. Ob die Wahrnehmung emotionaler lexikaler Informationen bei Alexithymie bereits auf automatischer Verarbeitungsebene beeinträchtigt ist, konnte noch nicht abschließend geklärt werden. In der vorliegenden Eye-Tracking-Studie wurde das Blickverhalten von 105 gesunden Proband*innen während eines affektiven Priming-Experiments untersucht. Einzelne Emotionswörter (Neutral, Freude, Ekel und Angst) wurden sehr kurz und maskiert präsentiert. Nachfolgend wurden vier verschiedene Gesichtsausdrücke (Neutral, Freude, Ekel und Angst) gleichzeitig dargeboten und das Blickverhalten analysiert. Die Ausprägung der Alexithymie wurde anhand der 20-Item Toronto-Alexithymie-Skala erhoben. Nur die Proband*innen, die angaben, die Wörter nicht bewusst wahrgenommen zu haben, wurden in die Analyse aufgenommen (84 von 105). Die vorliegenden Befunde deuten darauf hin, dass subliminal präsentierte Emotionswörter das Blickverhalten beeinflussen könnten. Die Proband*innen orientierten nach Darbietung des lexikalen Primes Angst den Blick schneller und länger auf ängstliche Gesichter. Nach Präsentation des lexikalen Primes Ekel orientierten die Proband*innen den Blick langsamer auf Ekel ausdrückende Gesichter. Nach Präsentation des lexikalen Primes Freude betrachteten die Proband*innen kürzer freudige Gesichter. Die alexithymen Merkmale Schwierigkeiten beim Beschreiben von Gefühlen und external orientierter Denkstil gingen mit einem geringeren Bahnungseffekt durch Angst-Primes auf die Verweildauer auf Angstgesichter einher, d.h. ängstliche Gesichter wurden kürzer betrachtet. Die vorliegenden Ergebnisse könnten darauf hindeuten, dass alexithyme Individuen den emotionalen Inhalt des lexikalen Primes Angst zwar automatisch wahrnehmen und für die initiale Blickausrichtung nutzen, angstbezogenen fazialen Reizen jedoch unwillkürlich weniger Aufmerksamkeitsressourcen zuweisen.

En el ámbito de la expresión gráfica arquitectónica, la realidad virtual supone una herramienta, indispensable en nuestros días, para comunicar del proyecto de arquitectura. Entre todos los canales de expresión de la realidad virtual, los renders o perspectivas digitales son los más comúnmente empleados en concursos, publicaciones y medios de divulgación arquitectónica. En estos soportes, las imágenes renderizadas permiten una rápida comprensión de la propuesta planteada, sean expertos o no los observadores de las mismas. El rápido avance de los programas informáticos de modelización digital ha permitido a los arquitectos producir sofisticadas imágenes como una valiosa herramienta para seducir a los observadores de las mismas. Si los medios de representación diédrica requieren del observador determinadas habilidades de interpretación espacial para imaginar el futuro lugar que el proyecto contendrá, estas imágenes nos trasladan directamente a él y nos permiten sentir lo que en aquellos lugares experimentaríamos. Estas sensaciones evocadas, generarán en el observador, una opinión más o menos favorable, sobre el espacio que la imagen representa. El proyecto necesita comunicarse, y por lo tanto requiere de cierta estrategia de comunicación. Si hasta ahora era el punto de vista del arquitecto el que inundaba la expresión del proyecto de arquitectura, ahora aparece la figura del usuario (jurado de concurso, futuro cliente, comprador de un piso) como un nuevo filtro a través del cual, se hace necesario observar el proyecto. Conocer los factores cognitivos que hay detrás del proceso de evaluación del observador permite la aplicación de técnicas, de manera que analizando las preferencias del usuario, éstas pueden ser incluidas en el proceso de diseño. La publicidad actual desarrolla sofisticadas estrategias para captar la atención del público general o de un determinado sector en particular, y despertar en él sentimientos que favorezcan la elección del producto diseñado. Sin embargo, no se encuentran apenas trabajos de investigación que analicen los factores cognitivos en renders de arquitectura. / Iñarra Abad, S. (2014). EL RENDER DE ARQUITECTURA. Análisis de la respuesta emocional del observador [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/38447 / Premios Extraordinarios de tesis doctorales

[EN] The main objective of this thesis is contribute to emotional assessments of design product through three tools: differential semantic (DS), Eye-tracking (ET) and Event-related potential (ERP). Together these three tools will evaluate the methodology in four experiments developed by this thesis.The first experiment proposes an objective evaluation to compare a real product with a virtual representation. Both stimuli was evaluated separately with the same conditions by a single sample. This experiment proposes two assessments: (1) the DS intervention to quantify subjective elements for real and virtual bottle comparison. (2) ET applying to quantified the differences with virtual and real bottle. The results obtained by the two tools exposes 3 effects: (1) DS indicated a 70% of similitude between them. (2) DS indicated a difference evoked by visual quality. (3) ET indicated a 66% of similitude in the vision behavior for the two stimuli. The second experiment use a ceramic flooring as a stimulus in different decorative contexts to make an assessment. The stimulus was designed with two elements: (1) A scenario with the same ceramic flooring with different decoration style. (2) A bipolar semantic scale below the scenarios. This experiment proposes two assessments: (1) DS intervention to quantify the perception of flooring inside the scenarios with 9 bipolar scale and 3 scale related with decoration impression. (2) ET measure to find visual differences between stimuli biased by scenario impression and participant gender. The findings for DS, indicated that ceramic flooring was better valued with adjectives related to the concept of "modern" inside of modern decoration. The findings for ET, exposed a significant difference in the way men and women visualize. Furthermore, the inverted attention on flooring correlates with specific adjectives related with decoration used. The third experiment focuses on preference prediction or liking, using vision tracking and assessment rank. This experiment used a two independent sample of participants (children) for 2 type of stimuli. A series of isotypes and toys was created with three aesthetic dimension. The experiment are composed by two phases: (1) apply an assessment methodology-centered in a particular stimuli arrangement to be selected by vision. (2) Each stimuli used in the first phase was evaluated by a liking scale to determine which was the more liked. The findings described two aspects for this experiment: (1) The participant vision predict a subconscious selection until 1.5 seconds before conscious choice was made. (2) The perception of aesthetic dimensions and the assessment rank was biased by gender. The last experiment proposes a complete analysis with the three tools. The methodology focuses on capture the ERPs applied to healthy food packaging (boiled ham and turkey breast). This experiment possess a high degree of complexity to propose a quantification of cognitive process related with semantic product perception. The experiment uses the comparison of priming (adjectives) that describe positive or negative a target (packaging). A categorization was made in two groups of pairs of target (ham and turkey and packaging with sticker promotion or not [with and without a promotion sticker]). Simultaneously, a vision tracking was made to observed graphic elements. The findings describes several effects. For ET measure, the main areas of interest observed in the packaging during the semantic assessment (positive or negative adjective) were: the product photographic, the attribute information and the sticker promotion. For ERPs measure, the semantic positive effect was congruent with the healthiest packaging perceived (turkey breast) while the semantic negative effect was congruent with less healthy (boiled ham). For the packaging with sticker promotion, the semantic positive effect was congruent with them while the semantic negative effects was congruence with no sticker promotion. / [ES] El objetivo general de esta tesis es contribuir a la evaluación emocional del diseño de producto mediante las tres herramientas: diferenciales semánticos (DS), Eye-tracking (ET) y Potenciales relacionados con eventos (Event-related Potential, ERP). Estas tres herramientas validarán las aportaciones para la tesis en cuatro experimentos de la tesis. El primer experimento evalúa una comparación de un producto real frente una versión virtual del mismo. El experimento plantea dos evaluaciones: (1) El uso de DS para cuantificar elementos subjetivos de la comparativa de la botella real y virtual. (2) El uso de ET para cuantificar las diferencias de visualización entre la botella real y la virtual. Los resultados obtenidos fueron: (2) Los DS muestran un 70% de similitud entre los estímulos. (2) Los DS muestras una diferencia en términos de calidad visual de los estímulos. (3) El ET muestra un 66% de similitud de la mirada para los estímulos. El segundo experimento evalúa la percepción de un pavimento cerámico en diferentes contextos decorativos. Los estímulos generados contenían dos elementos: (1) Una imagen con el pavimento y las decoraciones. (2) Una escala bipolar de adjetivos descriptivos. El experimento plantea dos evaluaciones: (1) El uso de DS para cuantificar la percepción del pavimento dentro de las decoraciones, con 9 escalas bipolares y 3 escalas relacionadas con la decoración. (2) El uso de ET para encontrar diferencias de visualización entre estímulos sesgados por la valoración del escenario y género de los participantes. Los resultados encontrados para los DS muestran que el pavimento cerámico fue mejor valorado con adjetivos relacionados al concepto de moderno dentro del escenario de decoración moderna. El ET expone una diferente forma de mirar entre hombres y mujeres y la atención invertida en el pavimento se correlaciona con ciertos adjetivos. El tercer experimento se enfoca en anticipar la preferencia o gusto por medio de la visión, contrastada con la valoración de los estímulos expuestos. Se generaron una serie de isotipos y juguetes con tres dimensiones estéticas. Este experimento se compone de dos partes: (1) usar una metodología de evaluación centrada en una distribución de estímulos con una composición particular para una elección por visión. (2) Cada estímulo utilizado en la primera parte, se valoró por medio de una escala de gusto para determinar cuál era el más gustado. Los resultados encontrados describen dos aspectos del experimento: (1) La visión del participante anticipa una elección subconsciente hasta 1.5 segundos antes de la elección consciente de un producto. (2) La percepción de las dimensiones estéticas y su valoración fueron sesgadas por el género. El último experimento plantea un análisis completo con las tres herramientas. La metodología se centra en la captura de los ERPs aplicados a envases de comida saludable. Este experimento posee un grado de complejidad mayor que los anteriores, al plantear una cuantificación del proceso cognitivo relacionado con la percepción semántica de un producto. El experimento plantea una comparación de adjetivos (priming) que describen positivamente o negativamente los envases (target). Para esta metodología se categorizaron dos grupos de dos parejas de target Simultáneamente, se hizo una captura de visión por medio del ET para ver que gráficos fueron los más observados durante toda la experimentación. Los resultados para ET, se encontró que las principales zonas de interés observadas en los envases durante el contexto de la evaluación semántica fueron: las fotografías, la información de atributos y la promoción que se añade al envase. Para los ERPs se encontró que la carga semántica positiva era congruente con el envase del producto más saludable (pechuga de pavo) mientras que la carga semántica negativa para el otro (jamón cocido). Para los envases con la etiqueta de promoción se en / [CA] L'objectiu general d'aquesta tesi és contribuir a l'avaluació emocional del disseny de producte mitjançant les tres eines: diferencials semàntics (DS), Eye-tracking (ET) i Potencials relacionats amb esdeveniments (Event-related Potential, ERP). En conjunt aquestes tres eines validaran les aportacions en quatre experiments. El primer experiment planteja avaluar objectivament una comparació d'un producte real front una versió virtual del mateix. L'experiment planteja dues avaluacions: (1) L'ús de DS per a quantificar elements subjectius per a la comparativa de la botella real i virtual. (2) L'ús de ET per a quantificar les diferències de visualització entre la botella real i la virtual. Els resultats obtinguts de les dues eines exposen 3 efectes: (2) Els DS mostren un 70% de similitud entre els dos estímuls. (2) Els DS mostres una diferència en termes de qualitat visual dels estímuls. (3) El mesurament de ET mostra un 66% de similitud de la mirada per als dos estímuls. El segon experiment planteja avaluar la percepció d'un paviment ceràmic en diferents contextos decoratius. Els estímuls generats contenien dos elements: (1) Un escenari on es presentava el mateix paviment ceràmic amb diferents tipus de decoracions. (2) Una escala bipolar d'adjectius descriptius. L'experiment planteja dues avaluacions: (1) L'ús de DS per a quantificar la percepció del paviment dins de les decoracions, amb 9 escales bipolars i 3 escales relacionades amb la decoració. (2) L'ús de ET per a trobar diferències de visualització entre estímuls esbiaixats per la valoració de l'escenari i gènere dels participants. Els resultats oposats per als DS mostren que el paviment ceràmic va ser millor valorat amb adjectius relacionats al concepte de modern dins de l'escenari de decoració moderna. Les dades de ET exposen una diferent forma de mirar entre homes i dones i l'atenció invertida en el paviment es correlaciona concordes amb la decoració utilitzada. El tercer experiment planteja un anticipar la preferència o gust per mitjà de la visió, contrastada amb la valoració dels estímuls exposats. Es van generar una sèrie de isotipus i joguines amb tres dimensions estètiques. Aquest experiment es compon de 2 parts: (1) utilitzar una metodologia d'avaluació centrada en una distribució d'estímuls amb una composició particular per a una elecció per visió. (2) Cada estímul utilitzat en la primera part, es va valorar per mitjà d'una escala de gust per a determinar quin era el més agradat. Els resultats oposats descriuen dos aspectes de l'experiment: (1) La visió del participant anticipa una elecció subconscient fins a 1.5 segons abans de l'elecció conscient d'un producte. (2) La percepció de les dimensions estètiques i la seua valoració van ser esbiaixades pel gènere. L'últim experiment se centra en la captura dels ERPs aplicats a envasos de menjar saludable (pernil cuit i pit de pollastre). Aquest experiment posseeix un grau de complexitat major que els anteriors, en plantejar una quantificació del procés cognitiu relacionat amb la percepció semàntica d'un producte. L'experiment planteja una comparació d'adjectius (priming) que descriuen positiva o negativament els envasos (target). Per a aquesta metodologia es van categoritzar dos grups de dues parelles de target (pernil cuit amb pit de pollastre i envàs amb una etiqueta de promoció o sense ella). Simultàniament, es va fer una captura de visió per mitjà del ET per observats elements gràfics. Els resultats obtinguts descriuen diversos aspectes. Per ET, es va trobar que les principals zones d'interès observades en els envasos durant el context de l'avaluació semàntica van ser: Les fotografies, la informació d'atributs i la promoció que s'afig a l'envàs. Per ERPs es va trobar que la càrrega semàntica positiva era congruent amb l'envàs del producte més saludable (pit de pollastre). Per als envasos amb l'etiqueta de promoció es va trobar que la / Rojas López, JC. (2016). Contribución a la evaluación emocional en el diseño de productos mediante la integración de tecnologías de seguimiento de la mirada (Eye-tracking), diferenciales semánticos y potenciales evocados (ERPs) [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/66140

The primary goal of this study was to examine how infants' language and emotion development intersect around the end of the first year. Specifically, is learning enhanced when a speaker is happy vs. neutral? Eighteen 12-month-old infants were familiarized and tested on four word-object associations that varied in bimodal emotion (happy vs. neutral), which were presented on a Tobii© T60 eye-tracker. Familiarization trials comprised of actresses looking towards and labeling a target object while ignoring a non-target distractor object on the opposite side of the screen. It was expected that infants would demonstrate better learning of word-object associations during the test trials when the speaker was happy. This hypothesis was partially supported, in that infants demonstrated a novelty preference for the novel non-target object compared to the familiar target object in the happy test trials only. However, no difference in attention was seen in happy test trials with the familiar target object and a familiar non-target object or for either of the neutral test trials. A second goal of this study was to examine infant-parent correspondence in emotion processing. Both infants and parents were presented with a series of emotion pairs on the eye-tracker, and the correlations between their gaze patterns were examined. In general, infants and parents had little to no correspondence in first look tendencies or overall fixation duration to either face in the pair. They also fixated on different areas of the face (infants on mouth region, parents on eye region). Finally, parental sensitivity was examined using a free-play interaction task. Parents' sensitivity was analyzed with respect to measures of infants learning during the language task as well as other infant characteristics (e.g. temperament, vocabulary). Overall, these findings add to the relatively limited research examining the intersection of language and socioemotional development in infancy. / Ph. D.

Fluctuations in attention are ubiquitous. We all experience the waxing and waning of our attention, with periods of focus alternating with periods of distraction by irrelevant thoughts or external sensations. Given the pervasiveness of these fluctuations, it is important to understand how they influence both our behavior in the moment and the structure of our memory. In this dissertation, I use behavioral studies and eye tracking to measure spontaneous attentional fluctuations and examine how these fluctuations shape online behavior and subsequent memory. I test my primary hypothesis that optimal attentional states help us link experiences over time to allow our memories to be temporally organized, whereas suboptimal states disrupt the temporal structure of memory. In Chapter 1, I present four studies using a novel experimental design to connect research on sustained attention and memory. I replicate prior findings linking response-time-based measures of attention to online behavior. Surprisingly, I found that these response-time measures of attention do not predict the temporal structure of free recall. In Chapter 2, I indexed attentional fluctuations with both response times and pre-trial pupil size and demonstrated that these measures of attention predict complementary aspects of behavior. Attentional fluctuations, as indexed by pupil size, predicted the temporal organization of memory but not attentional lapses in online behavior. Conversely, response times predicted attentional lapses in the moment but did not predict the temporal organization of memory. Finally, in ongoing work in Chapter 3, I examine whether providing cues at retrieval enhances or diminishes the effects of attentional fluctuations on the temporal organization of memory. Together, my results shed light on the complex interactions between fluctuations in attention and episodic memory. Critically, I show that different measures of attention – behavioral vs. physiological approaches – capture distinct aspects of cognitive function, and suggest that the attentional states that shape online behavior and later memory are at least partly distinct.

With the continuous rise in email use, the prevalence and sophistication of phishing attacks have increased. Expanding cybersecurity awareness and strengthening email practices will help reduce the dangers posed by phishing emails, but ultimately, the extent to which a user can accurately detect phishing emails directly impacts the amount of risk to which they are exposed. Being interrupted while reading and replying to emails is a consequence of working in a dynamic world. Interruptions are often identified to be disruptive, both in terms of time costs and performance changes; they reliably increase a task's completion time, but their impact on accuracy is less consistent. The present three studies manipulated the length (Experiment 1), difficulty (Experiment 2), and similarity (Experiment 3) of interruptions in accordance with the memory for goals (MFG) model, which aims to explain why interruptions may be disruptive. Participants classified emails as either phishing or legitimate, while periodically being interrupted with a secondary task. Across all three experiments, interruptions did not affect classification accuracy, but they did reliably increase classification response time. Oculomotor analyses indicated that interruptions, regardless of type, impaired memory of previously encoded email information. This was evidenced across all three experiments by an increase in refixations and an increase in the distance between fixations pre- and post-interruption. MFG can account for some of these findings, but not all. Interruptions did not impair performance on an email classification task when participants could review the interrupted information, yet overall classification accuracy was still low. These results may suggest a pathway toward improving email classification performance however, as participants exhibited behaviors known to improve performance on other tasks, such as revisiting previously viewed areas of an email.

This dissertation examines the emerging practice of consumer neuroscience and neuromarketing, combined called CNNM. CNNM utilizes tools and technologies to measure brain activity and human behavior coupled with scientific theories for explaining behavior and cognition. Consumer neuroscience is one of the newest areas of application of neuroscience and related techniques, and is of significant social consequence for its possible deployment in the market place to both study and shape consumer behavior. Concerns arise in terms of consumer influence and manipulation, but there are also concerns regarding the actual efficacy and utility of the technologies and the application of behavioral theories. The dissertation's three essays each examine a facet of CNNM. Using historical sources, conference participation, and ethical analyses, the dissertation forms a multi-prong effort at a better understanding of CNNM through the use of science and technology studies (STS) methods. The first essay is an historical review of the usage of technologies to measure brain activity and behavior, parallel to the development of psychological theories created to account for human decisionmaking. This essay presents a new conception of "closure" and "momentum" as envisioned by social construction of technology and technological momentum theories, arriving at a new concept for inclusion called "convergence" which offers a multi-factor explanation for the acceptance and technical implementation of unsettled science. The second essay analyzes four discourses discovered during the review of approximately seventy presentations and interviews given by experts in the field of CNNM. Using and adapting actor-network theory, the essay seeks to describe the creation of expertise and group formation in the field of CNNM researchers. The third essay draws on a variety of ethical analyses to expand understanding of the ethical concerns regarding CNNM. It raises questions that go beyond the actual efficacy of CNNM by applying some of the theories of Michel Foucault relating to the accumulation of power via expertise. This essay also points in the direction for actionable steps at ameliorating some of the ethical concerns involving CNNM. CNNM is a useful technique for understanding consumer behavior and, by extension, human behavior and neuroscience more generally. At the same time, it has been routinely misunderstood and occasionally vilified (for concerns about both efficacy and non-efficacy). This dissertation develops some of the specific historical movements that created the field, surveys and analyzes some of the foremost experts and how they maneuvered in their social network to achieve that status, and identifies novel ethical issues and some solutions to those ethical issues. / Ph. D. / Consumer neuroscience, or neuromarketing, (CNNM) is a new and emerging field which uses different devices to measure brain activity and behavior. For many years, scientists and marketers have been seeking to understand and explain decisions and, more specifically, consumer decisions. It has only been in the most recent decades that technology and scientific theories have been working in a close fashion to help understand human decision and consumer behavior. In three essays, this dissertation uses tools from science and technology studies (STS) to better understand CNNM. In Essay One, I track the parallel history of the technologies to measure brain activity and behavior with scientific theories put forward to explain them. In Essay Two, I analyze the content of presentations given by experts in the field to understand how CNNM expertise is formed. In Essay Three, I explore the ethical concerns and propose some new ways of solving some of the ethical problems (such as power, influence, and expertise.) CNNM is an important social phenomenon because of its possibilities of helping marketers, but it is also important for its part in developing areas of technology and scientific theories. The dissertation represents some new approaches at helping to understand its complexities and consequences.

Increasing automation in aviation is impacting the role of the air traffic controller (ATCO). New support tools and changing work environments require the monitoring of multiple display systems and the detection of potential system failures. When training these requirements, eye tracking holds great promise for gaining a deeper insight into trainees’ perceptual and cognitive processes. Because there are hardly any studies on the effects of training on gaze behavior in air traffic control (ATC), the aim of the present work was to evaluate the applicability of the method in this domain. Three experimental studies were conducted with novices with no ATC experience. These investigated whether training effects are reflected not only in common performance measures such as accuracy and speed, but also in gaze parameters such as relative fixation count, time to first fixation, and normalized entropy. They further examined to what extent future monitoring tasks can be trained and what kind of additional factors play a role in this. An adapted version of the abstract monitoring test (MonT) was used to investigate the research questions. Each study consisted of three test blocks in which air traffic had to be monitored in up to three automatically controlled airspaces. In the first study (N = 60), the adapted simulation environment was evaluated, and initial results on the effect of practice were collected. Improvements, which occurred primarily at the beginning of the test, were reflected in a more accurate failure detection performance and a more strategic gaze behavior. The traffic load, and therefore the amount of information to be monitored, played a decisive role in the results. The second study (N = 139) investigated the influence of different interventions for directing attention. Highlighting relevant information (bottom-up approach) moderated the effect of practice significantly more than an attention strategy (top-down approach) or no intervention (control). Relevant information was viewed more frequently and failures were anticipated more easily—even when a manual control task was added. Repeating the test after an average of four months showed little to no significant changes in performance and gaze behavior (N = 19). Overall, with an average detection rate of 83%, the results indicate that future monitoring can be trained to a high level. However, the design of the system, the difficulty of the task, and the prior knowledge of the individual must always be considered. Because it was shown that gaze behavior predicted performance, the recording of eye movements in future ATC training is encouraged. In this context, current developments in the use of artificial intelligence promise to facilitate the classification of individual scan patterns and promote adaptive training.