Return to search

Interactive Multimedia in Digital Courses:  Design and Evaluation of Concept Maps Glossary and Narration Support

Multimedia content, e.g., sound files, interactive demos, and video files, has been widely used in digital courses to provide an easy to use format and to emphasize the ideas. In this work, we address aspects of generating multimedia contents automatically in digital courses. In particular, we focus on two types of automatically generated multimedia: interactive glossaries and sound files. Glossaries play a major role in enhancing students' comprehension of the course core concepts. Glossary terms have complex interrelationship that cannot be fully illustrated by standard approaches, e.g., including all the terms as a linear, alphabetized list. To overcome this limitation, we introduce an interactive design for the glossary terms using concept maps. Glossary terms are visualized as nodes in graphs and their relationships are included on the edges. We implement these concept maps within the OpenDSA e-textbook system. A concept map associated with the selected term is generated on demand. We evaluate the effectiveness of our design by comparing student use of our concept-map based glossary to the traditional alphabetized list. We have designed new exercises that target the comprehension of the glossary terms to make students familiar with the concept maps. Our other work generates sound files automatically to supplement text narration in slide shows. This is made feasible by the widespread availability of text-to-speech generators in web browsers. To this end, we designed an interactive narration tool and integrated it into the OpenDSA library. In this way, all slide shows automatically have their text augmented with narration. / Master of Science / Recently, there has been an increase in the use of multimedia contents in digital courses. Multimedia files, e.g., sound files, interactive demos, and video files, are used in digital courses to provide an easy to use format and to emphasize the ideas. In this work, we address aspects of generating multimedia contents in digital courses. In particular, we focus on two types of automatically generated multimedia: interactive glossaries and sound files. Glossaries play a major role in enhancing students’ comprehension of the core concepts in the courses. In general, glossary terms have complex interrelationship that cannot be fully illustrated by standard approaches, such as the alphabetized list. To overcome this limitation, we introduce an interactive design for the glossary terms using concept maps. In this design, glossary terms are visualized as nodes in graphs and their relationships are included on the edges. We implement these concept maps within the OpenDSA e-textbook system to be generated on demand. We evaluate the effectiveness of our design by comparing student use of our concept-map based glossary to the traditional alphabetized list. We have designed new exercises to make students familiar with the concept maps. Our other work generates sound files automatically to supplement text narration in slide shows. This was motivated by the widespread use of text-to-speech generators in web browsers. To this end, we designed an interactive narration tool and integrated it into the OpenDSA library so that all OpenDSA slide shows can benefit from the narration tool.

Identiferoai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/91386
Date09 July 2019
CreatorsElgendi, Ehsan Sami Ismaiel Ali
ContributorsComputer Science, Shaffer, Clifford A., Fox, Edward A., Seyam, Mohammed Saad
PublisherVirginia Tech
Source SetsVirginia Tech Theses and Dissertation
Detected LanguageEnglish
TypeThesis
FormatETD, application/pdf
RightsIn Copyright, http://rightsstatements.org/vocab/InC/1.0/

Page generated in 0.0027 seconds