Intelligent Tutoring Systems (ITSs) have been shown to significantly improve students' learning in a variety of domains, including physics, mathematics, and thermodynamics. Tutorial dialogues is one of the strategies used by ITSs and has been empirically shown to significantly improve learning. This project investigates how different students interact with the tutorial dialogues in EER-Tutor, using both eye-gaze data and student-system interaction logs. EER-Tutor is a constraint-based ITS that teaches conceptual database design. In order to have a more comprehensive and accurate picture of a user's interactions with a learning environment, we need to know which interface features s/he visually inspected, what strategies s/he used and what cognitive efforts s/he made to complete tasks. Such knowledge allows intelligent systems to be proactive, rather than reactive, to users' actions. Eye-movement tracking is therefore a potential source of real-time adaptation in a learning environment. Our findings indicate that advanced students are selective of the interface areas they visually focus on whereas novices waste time by paying attention to interface areas that are inappropriate for the task at hand. Novices are also unaware that they need help with understanding the domain concepts discussed in the tutorial dialogues. We were able to accurately classify students, for example as novice or advanced students, using only eye-gaze or EER-Tutor log data as well as a combination of EER-Tutor and eye-gaze features. The cost of eye-tracking is justified as classifiers using only eye-gaze features sometimes perform as well as those utilising both EER-Tutor and eye-gaze data and outperform classifiers using only EER-Tutor data. The ability to classify students will therefore allow an ITS to intervene when needed and better guide students' learning if it detects sub-optimal behaviour.

As one of the central problems in the area of Intelligent Tutoring Systems (ITSs), student modelling has been widely used to assist in systems’ decision making and students’ learning. On the one hand, by reasoning about students’ knowledge in the instructional domain, a system is able to adapt its pedagogical actions in order to provide a customized learning environment. These actions may include individualized problem-selection, tailored instructions and feedback, as well as updating the presentation of student models. On the other hand, students can reflect on their own learning progress by viewing individual Open Student Models (OSMs) and enhance their meta-cognitive skills by learning from the system’s estimation of their knowledge levels. It is believed that making the information in the student model available to students can raise students’ awareness of their strengths and weaknesses in the corresponding domain and hence allow them to develop a more effective and efficient way of learning. An OSM has been developed in EER-Tutor. EER-Tutor is a web-enhanced ITS that supports university students in learning conceptual database modelling. Students design Enhanced Entity-Relationship (EER) diagrams and receive different level of feedback in a problem-solving environment. The pedagogical decisions on feedback generation and problem selection are made according to student models. Previously, student models in EER-Tutor are presented to students on request as skill meters. Skill meters have been proved useful in helping students to improve their meta-cognitive skills. However, as the simplest presentation of a student model, skill meters contain very limited information. Some studies show that an OSM with multiple views is more effective since it supports individual preferences and different educational purposes. The focus of our work is to develop a variety of presentations for the OSM in EER-Tutor. For this purposes, we have modified the system to include not only skill meters but also other presentation styles. An evaluation study has been performed after the development. Both subjective and objective results have been collected. This thesis presents the extended EER-Tutor, followed by the analysis of the evaluation study.

Thesis (M. Sc.)--University of Canterbury, 2009. / Typescript (photocopy). "September 2009." Includes bibliographical references (leaves 89-96). Also available via the World Wide Web.