Access control solutions face challenges of the implications of social and emotional behaviour of their human users. Thus, the research questions I set out for my thesis deal with how the social and emotional aspects of humans affect access control security interactions and what the implications of considering these aspects when designing access control systems will have for the emotional experience of authorised users. By selecting cases from my fieldwork representative of the social and emotional experiences of authorised users of current access control solutions I have been able to uncover issues of how the technological system is inconsiderate of the social and emotional behaviour of its human users, resulting in negative social and emotional experiences of access control solutions. However, by considering how technology can be designed to reshape the social behaviour of users I have explored ways of designing access control solutions that consider both the technological security and the emotional experience of authorised users.

En dialogue humain-humain et humain-système, le terrain commun (constitué des informations que les locuteurs ont conscience de partager ; Clark & Marshall, 1981) sert de base à la production de références adaptées au partenaire (Isaacs & Clark, 1987 ; Powers et al., 2005). La production des références appartenant au terrain commun dépend de leur accessibilité en mémoire pour chaque partenaire : plus une référence est accessible, plus elle est susceptible d'être produite (Horton & Gerrig, 2005a, 2005b). En ce sens, la production de références appartenant au terrain commun fait l'objet d'un biais égocentrique, étant donné qu'elle reflète principalement l'état mental du partenaire produisant les références (Barr & Keysar, 2002 ; Keysar, 1997). L'objectif de la thèse est de montrer que l'accessibilité en mémoire des références du terrain commun influence non seulement l'adaptation à autrui, mais aussi la réutilisation des références, c'est-à-dire la production de références après leur intégration au terrain commun par les partenaires. Cinq expériences ont été réalisées en vue de caractériser la réutilisation des références en dialogue humain-humain et humain-système. Il s'agit également d'isoler les facteurs linguistiques et non-linguistiques susceptibles d'influencer l'accessibilité en mémoire des références appartenant au terrain commun. Les résultats ont confirmé que la réutilisation pendant le dialogue fait l'objet d'un biais égocentrique. La production par soi et par autrui au moment où les références sont intégrées au terrain commun constitue un déterminant important du niveau d'accessibilité de ces références. Par ailleurs, le niveau d'accessibilité des références varie au long de l'interaction. Sur la base de ces résultats, un nouveau modèle théorique est développé en vue de rendre compte du dialogue de manière dynamique. Les implications pour le dialogue humain-humain et humain-système sont discutées. / In human-human and human-system dialogue, the common ground (which includes the knowledge that the dialogue partners are aware of sharing; Clark & Marshall, 1981) serves as a basis for the production of partner-adapted references (Isaacs & Clark, 1987; Powers et al., 2005). The production of references which belong to the common ground is guided by their accessibility in memory from each speaker's point of view: the more accessible a reference, the more likely it is to be produced (Horton & Gerrig, 2005a, 2005b). In this sense, the production of references which belong to the common ground is subject to an egocentric bias, as it mainly reflects the state of mind of the speaking producing the references (Barr & Keysar, 2002; Keysar, 1997). The purpose of this thesis is to show that the accessibility in memory of the references which belong to the common ground guides not only partner-adaptation, but also reference reuse, that is, reference production after these references have been grounded by the speakers. Five experiments were conducted in order to characterize reference reuse in human-human and human-system dialogue. The aim was also to identify the linguistic and nonlinguistic factors which are likely to influence the accessibility in memory of the references which belong to the common ground. The results confirmed that reuse during dialogue is subject to an egocentric bias. Self- and partner-production at the time of reference grounding constitutes an important determinant of reference subsequent accessibility. What's more, reference accessibility varies throughout the interaction. On the basis of these results, a new theoretical model is developed in order to account for dialogue in a dynamic fashion. Implications for human-human and human-system dialogue are then discussed.

Unmanned Aerial Vehicles (UAVs), commonly called drones, have been applied in manifold fields recently. With the development of UAV autonomy, the next generation of drone applications is moving towards team-based, multi-drone operations. This also promotes the transition of the operator role to the supervisory control of multiple UAVs. Situation awareness (SA) is a significant concept in this aspect to evaluate human performance in complex systems. This thesis work proposes a human-system interface for monitoring multiple autonomous UAVs simultaneously by a single operator, and investigates how to decrease the impact of task switching among different UAVs on the operator’s SA. Tasks in the context of fleet mission control are defined to be of different levels of urgency. Several design strategies have been concluded to address the research question. In conclusion, the usage of similar interface layouts between different tasks is effective to generally decrease the impact of task switching. The alert system with appropriate design is a specific factor in mitigating the impact of task switching towards higher urgency tasks/interfaces. Moreover, the reasonable division of areas of the interface and proper presentation of information by their importance are significant, especially for task switching towards lower urgency tasks/interfaces. / Unmanned Aerial Vehicles (UAV), vanligtvis kallade drönare, har använts i många områden nyligen. Med utvecklingen av UAV-autonomi, går nästa generation av drönarapplikationer mot teambaserad, multi-drönarverksamhet. Detta främjar också övergången av operatörsrollen till övervakande kontroll av flera UAV. Situationsmedvetenhet (SA) är ett betydelsefullt koncept i denna aspekt för att utvärdera mänsklig prestation i komplexa system. Detta examensarbete föreslår ett gränssnitt mellan människa och system för att övervaka flera autonoma UAV:er samtidigt av en enda operatör, och undersöker hur man kan minska effekten av uppgiftsbyte mellan olika UAV:er på operatörens SA. Uppgifter i samband med kontroll av flottans uppdrag definieras till att vara av olika brådskande nivå. Flera designstrategier har tagits fram för att ta itu med forskningsfrågan. Sammanfattningsvis är användningen av liknande gränssnittslayouter mellan olika uppgifter effektivt för att generellt minska effekten av uppgiftsbyte. Varningssystemet med lämplig design är en specifik faktor för att mildra effekterna av uppgiftsbyte mot mer brådskande uppgifter/gränssnitt. Dessutom är den rimliga uppdelningen av områden i gränssnittet och korrekt presentation av information efter deras betydelse betydande, särskilt för uppgiftsbyte mot mindre brådskande uppgifter/gränssnitt.

In this paper, an investigation of the impact of menu design and input device for gaze-based menu selection tasks is reported. The study investigates the usability, measured by effectiveness, efficiency, and user satisfaction, for gaze-based interaction in realistic, complex menu selection tasks. The study includes three different menu designs, a linear drop-down menu (L1), a radial dynamic menu (R1), and a semi-radial menu (R2), along with two different input devices, a unimodal input device using dwell-time (DT) and a multimodal input device using a combination of gaze and a manual switch (GMS). In a user study with nine test participants, the impact of menu design, input device, and navigation complexity on task completion time, accuracy rate, cognitive load, and quality of use ratings for menu selection tasks were investigated. The usability results confirmed the expectations of the advantages of radial menu designs, with the radial dynamic menu (R1) being better suited for gaze- based interaction than either the linear drop-down menu (L1) or semi-radial menu (R2). The usability results also confirmed the expectations regarding the input device, namely, the multimodal GMS input device was superior to the unimodal DT input device for gaze-based interaction. / I den här studien rapporteras en undersökning av effekterna av menydesign och inmatningsenhet för blickbaserade menyvalsuppgifter. Studien undersöker användbarheten, mätt av verkningsgrad, effektivitet, och användarnöjdhet, för blickbaserad interaktion i realistiska, komplexa menyvalsuppgifter. Studien innefattar tre olika menydesigner, en linjär rullgardinsmeny (L1), en radiell dynamisk meny (R1) och en halvradiell meny (R2), tillsammans med två olika inmatningsenheter, en unimodal inmatningsenhet som använder dwell-time (DT) och en multimodal inmatningsenhet som använder en kombination av blick och en manuell knapp (GMS). I en användarstudie med nio testdeltagare undersöktes effekterna av menydesign, inmatningsenhet och navigeringskomplexitet på tiden för uppgifts slutförandet, noggrannhet, kognitiv belastning och kvalitet på användningsbetyg för menyvalsuppgifter. Användbarhetsresultaten bekräftade förväntningarna om fördelarna med radiella menydesigner, varvid den radiella dynamiska menyn (R1) passar bättre för blickbaserad interaktion än både den linjära rullgardinsmenyn (L1) eller halvradialmenyn (R2). Användbarhetsresultaten bekräftade också förväntningarna avseende inmatningsenheten, nämligen att multimodal GMS-inmatningsenheten var överlägsen den unimodala DT-inmatningsenheten för blickbaserad interaktion.

Sammanfattning Titel Lönesättande samtal i praktiken - En kvalitativ studie om hur chefer på Myndigheten för samhällsskydd och beredskap upplever management med fokus på lönesättande samtal. Nivå                        Datum Magister                  Augusti 2018 Författare               Handledare Victor Skoglund        Jonas Axelsson Syfte Syftet med denna studie är att få kunskap och djupare förståelse av lönesättande chefers upplevelser av management med särskilt fokus på arbetet med lönesättande samtal. Metod Studien är baserad på kvalitativ metod och det empiriska materialet har tagits fram med hjälp av semistrukturerad intervjuform. Sammanlagt har 7 intervjuer genomförts och urvalet består av lönesättande chefer som arbetar på Myndigheten för samhällsskydd och beredskap. Resultat och slutsatser Undersökningen kommer fram till olika slutsatser angående lönesättande chefs arbete kring lönesättande samtal. Resultatet visar att det generella chefskapet innehåller vad bland annat Mintzberg (1973), Tengblad (2012), Kanter (1977) och Sayles (1964) kallar för managementarbete, eftersom chefskapet upplevs innehålla många och olika arbetsuppgifter, hektisk arbetsmiljö, förväntningar från berörda intressenter, långa arbetstider, anpassningsförmåga och beslut som ska främja verksamhetens intressen. Vidare visar studien att ekonomiska resurser, höga ingångslöner, omplacering till ny tjänst och allmänt formulerade lönekriterier försvårar lönesättande chefs arbete med lönesättande samtal. Studien skiljer sig något från Lysgaards (1985) teori om arbetarkollektivet då cheferna inte upplever något ”starkare” kollektiv bland medarbetarna. Däremot kan lönesättningen spegla efter hur kollektivavtalen är reglerade med fackförbundet ST, Seko och Saco. Slutligen visar studien att det råder maktfördelning till fördel cheferna enligt Korpis (1978) teori om makt och konflikt eftersom chefen, arbetsgivaren, är den beslutsfattande parten att påverka medarbetarens nya lön. Nyckelord Lönesättande samtal, Individuell lönesättning, Teknisk/ekonomiska system, Mänskligt system, Kollektivets system, Management, Arbetarkollektiv, Makt och konflikt. / Abstract Title Pay setting conversations in practice - A qualitative study on how managers at the Swedish Civil Contingencies Agency experience management regarding pay setting conversations. Level                     Date Magister-level         August 2018 Author                   Supervisor Victor Skoglund       Jonas Axelsson Aim The aim of this study is to gain knowledge and a deeper understanding of pay setting managers ́ experiences of management with a particular focus on the work of pay setting conversations. Method The study is based on qualitative methodology and the empirical material has been developed using semistructured interviews. A total of 7 interviews have been conducted and the selection consists of pay setting managers who work at the Swedish Civil Contingencies Agency. Results and conclusions The study reveals different conclusions regarding the pay setting managers ́ work with pay setting conversations. The result shows that the general leadership includes what Mintzberg (1973), Tengblad (2012), Kanter (1977) and Sayles (1964) calling for management work, because the leadership is perceived to contain many and different tasks, hectic working environment, stakeholder expectations, long working hours, adaptability and decisions to promote the company’s interests. Furthermore, the study results that financial resources, high entrance salary, redeployement of position and generally formulated salary criteria complicating pay setting managers ́ work with pay setting conversations. The study differs somewhat from Lysgaard's (1985) theory of the labor collective, since the managers do not experience any ”stronger” collective among the employees. On the other hand, the pay setting can reflect how collective agreements are regulated with the trade union ST, Seko and Saco. Finally, the study results that there is power distribution to the advantage of the leaders according to Korpi's (1978) theory of power and conflict because the manager, the employer, is the decision-making part to influence the employees ́ new salary. Keywords Pay setting conversations, Individual pay setting, Technical/economic system, Human system, Collective system, Management, Labor collective, Power and conflict.

Aujourd’hui, les écrans ont envahi nos quotidiens. Cette colonisation a engendré l’avènement de nouveaux écrans, les écrans de grand format. Or, ces grands écrans sont souvent utilisés comme de simples affichages statiques n’autorisant que très peu d’interaction aux utilisateurs en présence. Mais alors comment permettre des interactions multi-utilisateur et surtout quels modes et moyens d’interactions proposer afin d’interagir avec ces grands écrans ? Il faut évidemment définir des règles de collaboration : que faire si plusieurs personnes consultent la même information en même temps ? Comment permettre à un nouvel arrivant de prendre conscience de ce qu’il y a à voir alors que des utilisateurs ont déjà “transformé” l’affichage par leur utilisation courante ?Face à ces enjeux, notre travail a consisté, dans un premier temps, à tester des interactions multi-utilisateurs sur grand écran à l’aide d’un dispositif de détection et de suivi de la position et de l’orientation de la tête (head tracking) instrumenté. Nous avons ainsi mis en évidence l’importance du concept de « vision flottante » dans la recherche collaborative d’informations sur grand écran. Dans un second temps, nos recherches se sont concentrées sur le développement d’un dispositif d’head tracking permettant des interactions multi-utilisateur (jusqu’à 6 personnes), sans artefacts et sans calibrage avec un écran de grand format. Enfin, nous présentons l’étude comparative d’un même affichage tantôt statique et tantôt rendu dynamique à l’aide de notre dispositif. Cette étude est basée sur l’évaluation de l’expérience utilisateur (UX). Ainsi, nous avons pu dégager les premières recommandations concernant les métaphores d’interactions à mettre en place pour interagir avec un écran de grand format dans un contexte d’usage en groupe ouvert.Ce travail de doctorat a été consacré à la mise en avant de la faisabilité, de l’intérêt et de la proposition de premières orientations concernant la conception d’interactions multi-utilisateurs avec un écran de grand format basées sur une technique d’head tracking. / Screens have invaded our daily life. Amongst them, large displays are becoming increasingly present in public places. Sometimes, a few interaction are proposed to the users, but most of the time they are simply used as static displays. So, how to interact with these large displays and especially how to allow multi-user interactions? Of course, we have to define rules for collaboration: what we have to do if several people consult the same information at the same time? How to allow a newcomer to become aware of what there is to see when users have already "transformed" the display by their current use?First, our work consisted in testing instrumented multi-user interactions, based on a head tracking system, during a collaborative information seeking task, on a large display. In this part, we have highlighted the importance of the concept of "floating vision". Then, our research focused on the development of a head tracking system allowing intuitive interactions, without needing neither a special equipment nor individual calibration. Our system supports several users (up to six) simultaneously interacting with individualized information on a large display. Finally, we present the study of performance gain within a context of multi-user competitive consultation of information. We compare the benefit of an adaptive display (information move in front of users who are focusing on them), with a standard display. This study is based on user experience (UX) analysis. Thus, we were able to identify the first recommendations about interaction metaphors allowing intuitive interactions with a large display in an open group context.This research was devoted to highlighting the feasibility, interest and proposition of initial orientations concerning the design of multi-user interactions with large public displays based on a head tracking technique.

L’aéronautique civile commerciale poursuit l’objectif du déplacement de biens ou de personnes, par les airs, en maintenant un niveau optimal de sécurité. Depuis plus de trente ans, en dépit de cadres normatifs de plus en plus stricts et d’automatismes de plus en plus performants, le rapport entre performance visée et risque encouru ne progresse plus.Le facteur humain constitue un levier d’action majeur pour franchir ce plancher de verre. Dans le cadre contraint de l’aéronautique, la conception d’outils visant à assister la cognition des pilotes est ainsi une direction d’avenir. L’anticipation a été identifiée comme un processus central dans la gestion des ressources cognitives. Dans une démarche de cognitique, nous avons ainsi entrepris la conception d’un outil d’aide à l’anticipation en impliquant des pilotes à chaque étape des développements.D’une analyse de l’activité sur la base d’enregistrements en cockpit et d’entretiens, nous avons construit un modèle de l’activité réelle des pilotes lors de la descente et l’approche sur l’aéroport de Rio de Janeiro. L’étude bibliographique mit en lumière des points critiques relevant de l’anticipation et nécessitant une expérimentation préliminaire. Les résultats expérimentaux conciliés à nos hypothèses de compréhension de l’anticipation achevèrent le cahier des charges du cœur fonctionnel de notre outil d’aide à l’anticipation. Un algorithme de planification dynamique exploitant notre modèle de l’activité fut conçu et implémenté au sein d’ASAP (Anticipation Support for Aeronautical Planning) le démonstrateur de concept industriel de Thales Avionics. 36 pilotes civils commerciaux participèrent enfin à son évaluation en simulateur. / Civil aviation pursues the objective of moving people or goods through the air with an optimal level of safety. For more than thirty years, despite a stricter and stricter regulatory framework and highly reliable automation, the ratio between performance and acceptable risk is not improving anymore.Human factors are a major action lever to break this glass floor. In the constrained context of aviation, designing tools aiming at assisting pilots’ cognition is thus a promising direction. Anticipation has been identified central in the process of cognitive resources management. In a human factors engineering approach, we undertook the design of an anticipation support tool involving pilots at each step of the development.From an activity analysis performed on the basis of in-cockpit recordings and interviews we constructed a model of the actual pilots’ activity during the descent and approach phases on Rio de Janeiro airport. The state of the art highlighted the key elements related to anticipation which could take benefit of a preliminary experiment. Experimental results brought together with our hypotheses about how anticipation works completed the requirements of the functional core of our anticipation support tool. A dynamic planning algorithm was then designed and implemented within ASAP (Anticipation Support for Aeronautical Planning), Thales Avionics’ proof of concept. 36 commercial pilots took part to its evaluation in a simulated environment.

<p dir="ltr">Cyber-physical-human systems (CPHSs) integrate human cognitive capabilities into the decision and control processes of complex dynamical systems. While artificial intelligence (AI) has shown promise in controlling such systems, it often encounters challenges such as conflict with human behavior and brittleness. Moreover, even successful AI implementations may lead to negative impacts on humans, such as the degradation of manual skills and diminished situation awareness, thereby weakening humans' ability to effectively monitor and intervene in off-nominal conditions as the final decision-makers of the systems. To address these unique challenges within CPHSs, this dissertation proposes three key approaches. First, human behavior modeling approaches are proposed to enhance understanding and prediction of human behavior from the perspective of AI. Accurate modeling enables better calibration of AI's expectations regarding human teammates' intentions and skill-levels. Second, a novel shared control approach is developed to expedite human training for complex dynamic control tasks. An assistant agent supports human novices in emulating human experts by leveraging human behavior models to gauge the human's skill-levels and provide tailored assistance to help improve one's skill. Lastly, human-autonomy teaming (HAT) design is addressed from a resource allocation perspective. A systematic computational simulation approach is proposed to optimize function and attention allocation to manage trade-offs in performance, situation awareness, workload, and other considerations. The proposed frameworks are demonstrated via examples in drone applications. Numerical and experimental results, utilizing simulation platforms and human subjects, validate the efficacy of the proposed approaches. This dissertation presents significant progress in the design and implementation of CPHSs in that it offers insights and methodologies to enhance collaborative interactions between humans and autonomous systems in complex environments.</p>

Current studies done using a learning test for children have problems as they only make evaluations of Physically and Neurologically Impaired (PNI) children who can succeed in the test and can be considered as a PASS/FAIL test. This pilot study takes a holistic view of cognitive testing of PNI children using a user-test-device triad model and provides a framework using non-PNI children and adults as controls. Comparisons using adapted off-the-shelf novel interfaces to the computer, in particular, an Electroencephalograph (EEG) head-set, an eye-tracker and a head-tracker and a common mouse were carried out. In addition, two novel multi-modal technologies were developed based on the use of brain-waves and eye-tracking as well as head-tracking technologies to support the study. The devices were used on three tests with increasing cognitive complexity. A self-developed measure based on success streaks (consecutive outcomes) was introduced to improve evaluations of PNI children. A theoretical model regarding a fit of ability to devices was initially setup and finally modified to fit the view of the empirical model that emerged from the outcomes of the study. Results suggest that while multi-modal technologies can address weaknesses of the individual component modes, a compromise is made between the user’s ability for multi-tasking between the modes and the benefits of a multi-modal device but the sample size is very small. Results also show children failing a test with a mouse but passing it subsequently when direct communication is used suggesting that a device can affect a test for children who are of a developing age. This study provides a framework for a more meaningful conversation between educational psychologists as well as other professionals and PNI parents because it provides more discrimination of outcomes in cognitive tests for PNI children. The framework provides a vehicle that addresses scientifically the concerns of parents and schools.