Panteion University of Social and Political Sciences
The effect of speech and gesture timing on memory recall on native and second language speakers
Abstract
dc:descriptionThis dissertation investigates the temporal integration of speech and gesture. It focuses on how these modalities are processed as unified communicative events in both native (L1) and second-language (L2) speakers. Grounded in theories of co-speech gesture and crossmodal perception, the research explores how the temporal relationship between auditory input (speech) and visual input (gesture) influences integration and memory recall. This dissertation presents two main experimental studies. The first study investigated the temporal binding of gesture and speech in native speakers, focusing on how semantic congruency modulates audiovisual integration. Two experiments employed the method of constant stimuli, presenting gesture–speech combinations at varied stimulus onset asynchronies (SOAs) to measure perceptual sensitivity to temporal alignment. The second study extended this investigation to L2 speakers by examining how temporal synchrony between gesture and speech affects memory recall. Two further experiments presented gesture–speech stimuli across a range of SOAs, followed by recall tasks that assessed whether audiovisual integration influences memory performance in L2. The results of these studies suggest a robust temporal association between gesture and speech in both native and L2 speakers. These results highlight the complexity of crossmodal integration and suggest that gesture–speech unity may operate similarly across speaker populations under certain task conditions. The research underscores the need to further explore how temporal integration supports communication and learning in diverse language contexts.
Degree
thesis:*- Grantor dc:publisher
- Panteion University of Social and Political Sciences
- Year dc:date
- 2026
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Levantinou, Eleni-Ioanna
- Λεβαντίνου, Ελένη-Ιωάννα
Subjects
dc:subject × 14Rights
- Language dc:language
- eng
Identifiers
dc:identifier.*- Identifier
- 10.12681/eadd/61902