{"id":{"repo_id":"bu","oai_identifier":"oai:open.bu.edu:2144/52027"},"canonical_url":"https://search.ndltd.org/etd/bu/oai:open.bu.edu:2144/52027","repository":{"repo_id":"bu","name":"Boston University","base_url":"https://open.bu.edu/oai/request"},"display":{"title":"Eye-hand coordination: factors influencing gaze patterns during fingerspelling perception in American Sign Language","abstract":"Sign languages such as American Sign Language (ASL) unfold dynamically over time, requiring perceivers to make real-time decisions about where to direct their gaze to capture linguistic information as it occurs and before it disappears. While skilled deaf signers look mostly at the face during sign perception, gaze is sometimes directed to the hands when fingerspelling occurs. I conducted three experiments to explore how different features of the input (familiarity, predictability) and cues from the sign producer (mouthing and indexing to the fingerspelling hand) impact looks to the hands during fingerspelling perception. In Study 1, I compare the role of sign type (lexical signs vs. fingerspelled words) and familiarity (novel vs. familiar) on deaf signers’ gaze patterns while perceiving single sign video clips, finding that sign perceivers look more at the hands when viewing fingerspelled words and novel items. In Study 2, I explore how cues from the sign producer (mouthing and indexing, when the sign producer looks at and points to their own hand during fingerspelling) impact gaze patterns, finding that, while mouthing results in more looks to the face, indexing does not increase looks to the hands. In Study 3, I explore the role of prediction on gaze patterns within a sentence context, finding that signers make anticipatory looks when they expect fingerspelling to occur but are unable to predict the specific word that will be produced, such as during the introduction of a name. This dissertation provides evidence that sign perceivers flexibly adapt their gaze based on both the perceptual and linguistic demands of the input. Pairing eye-tracking methodology with the visual modality of ASL offers insight into language processing and prediction, showcasing how language users dynamically attend to certain features of the linguistic input in real-time.","abstract_html":"Sign languages such as American Sign Language (ASL) unfold dynamically over time, requiring perceivers to make real-time decisions about where to direct their gaze to capture linguistic information as it occurs and before it disappears. While skilled deaf signers look mostly at the face during sign perception, gaze is sometimes directed to the hands when fingerspelling occurs. I conducted three experiments to explore how different features of the input (familiarity, predictability) and cues from the sign producer (mouthing and indexing to the fingerspelling hand) impact looks to the hands during fingerspelling perception. In Study 1, I compare the role of sign type (lexical signs vs. fingerspelled words) and familiarity (novel vs. familiar) on deaf signers’ gaze patterns while perceiving single sign video clips, finding that sign perceivers look more at the hands when viewing fingerspelled words and novel items. In Study 2, I explore how cues from the sign producer (mouthing and indexing, when the sign producer looks at and points to their own hand during fingerspelling) impact gaze patterns, finding that, while mouthing results in more looks to the face, indexing does not increase looks to the hands. In Study 3, I explore the role of prediction on gaze patterns within a sentence context, finding that signers make anticipatory looks when they expect fingerspelling to occur but are unable to predict the specific word that will be produced, such as during the introduction of a name. This dissertation provides evidence that sign perceivers flexibly adapt their gaze based on both the perceptual and linguistic demands of the input. Pairing eye-tracking methodology with the visual modality of ASL offers insight into language processing and prediction, showcasing how language users dynamically attend to certain features of the linguistic input in real-time.","abstract_has_math":false,"creators":["Gappmayr, Paris"],"institution":"Boston University","degree_name":"Doctor of Philosophy","degree_level":"doctoral","degree_discipline":"Sargent College of Health and Rehabilitation Sciences","degree_department":null,"school":null,"contributors":[],"advisors":["Lieberman, Amy M."],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026","date_published":"2026","updated_at":"2026-11-18T20:14:44Z","subjects":["Language","Demography","American Sign Language","Deaf","Eye-tracking","Perception","Sign language perception","Visual attention"],"languages":["en_US"],"rights":["Attribution 4.0 International"],"rights_urls":["http://creativecommons.org/licenses/by/4.0/"],"identifier_entries":[],"person_identifier_entries":[{"key":"dc:identifier.orcid","label":"ORCID","values":["0000-0003-0848-7186"],"render_values":[{"text":"0000-0003-0848-7186","href":"https://orcid.org/0000-0003-0848-7186","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/2144/52027","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/2144/52027","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://open.bu.edu/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aopen.bu.edu%3A2144%2F52027","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Lieberman, Amy M."]},{"key":"dc:creator","label":"Author","values":["Gappmayr, Paris"]},{"key":"dc:identifier.orcid","label":"ORCID","values":["0000-0003-0848-7186"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2026-01-15T16:01:06Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2026-01-15T16:01:06Z"]},{"key":"dc:date.issued","label":"Date","values":["2026"]},{"key":"dc:date.updated","label":"Dc Date Updated","values":["2026-01-14T20:06:59Z"]},{"key":"dc:type","label":"Dc Type","values":["Thesis/Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Sargent College of Health and Rehabilitation Sciences"]},{"key":"thesis:degree_level","label":"Degree Level","values":["doctoral"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Boston University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Language","Demography","American Sign Language","Deaf","Eye-tracking","Perception","Sign language perception","Visual attention"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/2144/52027"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["2026"]},{"key":"dc:description.abstract","label":"Abstract","values":["Sign languages such as American Sign Language (ASL) unfold dynamically over time, requiring perceivers to make real-time decisions about where to direct their gaze to capture linguistic information as it occurs and before it disappears. While skilled deaf signers look mostly at the face during sign perception, gaze is sometimes directed to the hands when fingerspelling occurs. I conducted three experiments to explore how different features of the input (familiarity, predictability) and cues from the sign producer (mouthing and indexing to the fingerspelling hand) impact looks to the hands during fingerspelling perception. In Study 1, I compare the role of sign type (lexical signs vs. fingerspelled words) and familiarity (novel vs. familiar) on deaf signers’ gaze patterns while perceiving single sign video clips, finding that sign perceivers look more at the hands when viewing fingerspelled words and novel items. In Study 2, I explore how cues from the sign producer (mouthing and indexing, when the sign producer looks at and points to their own hand during fingerspelling) impact gaze patterns, finding that, while mouthing results in more looks to the face, indexing does not increase looks to the hands. In Study 3, I explore the role of prediction on gaze patterns within a sentence context, finding that signers make anticipatory looks when they expect fingerspelling to occur but are unable to predict the specific word that will be produced, such as during the introduction of a name. This dissertation provides evidence that sign perceivers flexibly adapt their gaze based on both the perceptual and linguistic demands of the input. Pairing eye-tracking methodology with the visual modality of ASL offers insight into language processing and prediction, showcasing how language users dynamically attend to certain features of the linguistic input in real-time."]},{"key":"dc:title","label":"Title","values":["Eye-hand coordination: factors influencing gaze patterns during fingerspelling perception in American Sign Language"]}]}],"canonical_facts":{"dc:contributor.advisor":["Lieberman, Amy M."],"dc:creator":["Gappmayr, Paris"],"dc:date.accessioned":["2026-01-15T16:01:06Z"],"dc:date.available":["2026-01-15T16:01:06Z"],"dc:date.issued":["2026"],"dc:date.updated":["2026-01-14T20:06:59Z"],"dc:description":["2026"],"dc:description.abstract":["Sign languages such as American Sign Language (ASL) unfold dynamically over time, requiring perceivers to make real-time decisions about where to direct their gaze to capture linguistic information as it occurs and before it disappears. While skilled deaf signers look mostly at the face during sign perception, gaze is sometimes directed to the hands when fingerspelling occurs. I conducted three experiments to explore how different features of the input (familiarity, predictability) and cues from the sign producer (mouthing and indexing to the fingerspelling hand) impact looks to the hands during fingerspelling perception. In Study 1, I compare the role of sign type (lexical signs vs. fingerspelled words) and familiarity (novel vs. familiar) on deaf signers’ gaze patterns while perceiving single sign video clips, finding that sign perceivers look more at the hands when viewing fingerspelled words and novel items. In Study 2, I explore how cues from the sign producer (mouthing and indexing, when the sign producer looks at and points to their own hand during fingerspelling) impact gaze patterns, finding that, while mouthing results in more looks to the face, indexing does not increase looks to the hands. In Study 3, I explore the role of prediction on gaze patterns within a sentence context, finding that signers make anticipatory looks when they expect fingerspelling to occur but are unable to predict the specific word that will be produced, such as during the introduction of a name. This dissertation provides evidence that sign perceivers flexibly adapt their gaze based on both the perceptual and linguistic demands of the input. Pairing eye-tracking methodology with the visual modality of ASL offers insight into language processing and prediction, showcasing how language users dynamically attend to certain features of the linguistic input in real-time."],"dc:identifier.orcid":["0000-0003-0848-7186"],"dc:identifier.uri":["https://hdl.handle.net/2144/52027"],"dc:language.iso":["en_US"],"dc:rights":["Attribution 4.0 International"],"dc:rights.uri":["http://creativecommons.org/licenses/by/4.0/"],"dc:subject":["Language","Demography","American Sign Language","Deaf","Eye-tracking","Perception","Sign language perception","Visual attention"],"dc:title":["Eye-hand coordination: factors influencing gaze patterns during fingerspelling perception in American Sign Language"],"dc:type":["Thesis/Dissertation"],"thesis:degree_discipline":["Sargent College of Health and Rehabilitation Sciences"],"thesis:degree_level":["doctoral"],"thesis:degree_name":["Doctor of Philosophy"],"thesis:institution_name":["Boston University"]},"updated_at":"2026-11-18T20:14:44Z"}