Back to search

Clemson University

Gesture-Based Icon Messages: Examining the Effects of a Nonverbal Transparency Strategy for Supporting Situation Awareness in Human-Autonomy Communication

Abstract

dc:description.abstract

Automated systems continue to transform tasks that were once manual, introducing new challenges for operators to maintain situation awareness (SA). This research examines gesture-based icon messages (GIMs) as a transparency strategy to address challenges present in human-autonomy communication (HAC). Drawing from Endsley’s (1995) three-level model of SA, GIMs were designed to convey different types of information: perception, comprehension, and projection. The goal of this work was to understand whether GIMs could be distinguished by operators, and whether they support SA under conditions that reflect the divided attention demands that are common in operational settings. Study 1 focused on assessing whether participants could differentiate between GIMs based on the intended SA level, while Study 2 and Study 3 tested how GIMs influence SA and performance in a low fidelity driving task. Findings from Study 1 showed that participants were able to distinguish between GIMs designed for perception, comprehension, and projection, supporting the idea that these messages can target specific information categories. In Study 2 and Study 3, comprehension level GIMs provided higher SA benefits under multitasking conditions than projection level GIMs, suggesting that message complexity may play a role in operator performance. Text-based messages outperformed GIMs at the projection level, which highlights the importance of considering message format and information type in transparency design. Overall, this research contributes to our understanding of how nonverbal communication strategies can be applied to support SA in HAC, and underscores the need to tailor message design to the demands of the operational context.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (PhD)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Human Factors Psychology

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Watkins, Heather

Subjects

dc:subject × 1

Identifiers

dc:identifier.*
Repository record dc:identifier
https://open.clemson.edu/all_dissertations/4024

Chain of custody

source
Harvested from
Clemson University
Base URL
open.clemson.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Watkins, Heather. Gesture-Based Icon Messages: Examining the Effects of a Nonverbal Transparency Strategy for Supporting Situation Awareness in Human-Autonomy Communication. Dissertation thesis, https://open.clemson.edu/all_dissertations/4024