Back to search

Boston University

Eye-hand coordination: factors influencing gaze patterns during fingerspelling perception in American Sign Language

Abstract

dc:description.abstract

Sign languages such as American Sign Language (ASL) unfold dynamically over time, requiring perceivers to make real-time decisions about where to direct their gaze to capture linguistic information as it occurs and before it disappears. While skilled deaf signers look mostly at the face during sign perception, gaze is sometimes directed to the hands when fingerspelling occurs. I conducted three experiments to explore how different features of the input (familiarity, predictability) and cues from the sign producer (mouthing and indexing to the fingerspelling hand) impact looks to the hands during fingerspelling perception. In Study 1, I compare the role of sign type (lexical signs vs. fingerspelled words) and familiarity (novel vs. familiar) on deaf signers’ gaze patterns while perceiving single sign video clips, finding that sign perceivers look more at the hands when viewing fingerspelled words and novel items. In Study 2, I explore how cues from the sign producer (mouthing and indexing, when the sign producer looks at and points to their own hand during fingerspelling) impact gaze patterns, finding that, while mouthing results in more looks to the face, indexing does not increase looks to the hands. In Study 3, I explore the role of prediction on gaze patterns within a sentence context, finding that signers make anticipatory looks when they expect fingerspelling to occur but are unable to predict the specific word that will be produced, such as during the introduction of a name. This dissertation provides evidence that sign perceivers flexibly adapt their gaze based on both the perceptual and linguistic demands of the input. Pairing eye-tracking methodology with the visual modality of ASL offers insight into language processing and prediction, showcasing how language users dynamically attend to certain features of the linguistic input in real-time.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
doctoral
Discipline thesis:degree_discipline
Sargent College of Health and Rehabilitation Sciences
Grantor
Boston University
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gappmayr, Paris
Advisor dc:contributor.advisor
  • Lieberman, Amy M.
ORCID dc:identifier.orcid

Subjects

dc:subject × 8

Rights

dc:rights
Statement dc:rights
  • Attribution 4.0 International
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/2144/52027

Chain of custody

source
Harvested from
Boston University
Base URL
open.bu.edu/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Gappmayr, Paris. Eye-hand coordination: factors influencing gaze patterns during fingerspelling perception in American Sign Language. doctoral thesis, Boston University, 2026. https://hdl.handle.net/2144/52027