Clemson University
Gesture-Based Icon Messages: Examining the Effects of a Nonverbal Transparency Strategy for Supporting Situation Awareness in Human-Autonomy Communication
Abstract
dc:description.abstractAutomated systems continue to transform tasks that were once manual, introducing new challenges for operators to maintain situation awareness (SA). This research examines gesture-based icon messages (GIMs) as a transparency strategy to address challenges present in human-autonomy communication (HAC). Drawing from Endsley’s (1995) three-level model of SA, GIMs were designed to convey different types of information: perception, comprehension, and projection. The goal of this work was to understand whether GIMs could be distinguished by operators, and whether they support SA under conditions that reflect the divided attention demands that are common in operational settings. Study 1 focused on assessing whether participants could differentiate between GIMs based on the intended SA level, while Study 2 and Study 3 tested how GIMs influence SA and performance in a low fidelity driving task. Findings from Study 1 showed that participants were able to distinguish between GIMs designed for perception, comprehension, and projection, supporting the idea that these messages can target specific information categories. In Study 2 and Study 3, comprehension level GIMs provided higher SA benefits under multitasking conditions than projection level GIMs, suggesting that message complexity may play a role in operator performance. Text-based messages outperformed GIMs at the projection level, which highlights the importance of considering message format and information type in transparency design. Overall, this research contributes to our understanding of how nonverbal communication strategies can be applied to support SA in HAC, and underscores the need to tailor message design to the demands of the operational context.
Degree
thesis:*- Name thesis:degree_name
- Doctor of Philosophy (PhD)
- Level thesis:degree_level
- Dissertation
- Discipline thesis:degree_discipline
- Human Factors Psychology
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Watkins, Heather
Subjects
dc:subject × 1Identifiers
dc:identifier.*- Repository record dc:identifier
- https://open.clemson.edu/all_dissertations/4024