Theories of learning from multimedia suggest that when media include two modal forms (e.g., visual and auditory), learning is improved by activating modally segregated working memory subsystems, thereby expanding the total cognitive resource available for learning (Mayer, 2001; Sweller, 1999). However, a recent meta-analysis suggests that the typical modality effect (use of narrations and diagrams [i.e., multimodal] leads to better learning than use of text and diagrams [i.e., unimodal]) might be limited to situations in which presentations are matched to the time it takes for the narration to play (Ginns, 2005). This caveat can be accounted for by the differences in ways that people process unimodal and multimodal information, but not by the expansion of working memory explanation for modality effects (Tabbers, 2002). In this paper, I propose a framework for conceptualizing how people interact with multimedia instructional materials. According to this approach, learning from multimedia requires (1) creating mental codes to represent to-be-learned information and (2) forming a network of associations among these mental codes to characterize how this information is related. The present research confirms, in two between-subjects experiments, predictions from this model when presentation pace and verbal presentation modality are manipulated to accompany static (Experiment 1) and animated (Experiment 2) diagrams. That is, the data suggest that learning from unimodal presentations improved as presentation pace was slowed, whereas learning from multimodal presentations did not change as presentation pace was slowed. A third experiment also confirmed predicted patterns of eye movement behavior, demonstrating patterns of increasing dwell time on pictures and switches between media as pace was slowed for unimodal presentations but not multimodal presentations. It is concluded that the parallel patterns of learning outcomes and eye-movement behavior support the proposed model and are not predicted by other models of learning from multimedia instructions. This improvement in predictions of the effects of manipulating design elements (e.g., presentation pace and verbal presentation modality) on learning can help designers as they consider what combination of resources (e.g., classroom time or equipment for multimodal presentation) to devote to instructional design.
| Identifer | oai:union.ndltd.org:GATECH/oai:smartech.gatech.edu:1853/22668 |
| Date | 31 March 2008 |
| Creators | Zolna, Jesse S. |
| Publisher | Georgia Institute of Technology |
| Source Sets | Georgia Tech Electronic Thesis and Dissertation Archive |
| Detected Language | English |
| Type | Dissertation |
Page generated in 0.0013 seconds