L’adoption des Nouvelles Technologies de l’Information et de la Communication (NTIC) a permis la modernisation des méthodes d’enseignement dans les systèmes d’apprentissage en ligne comme l’e-Learning, les systèmes tutoriels intelligents, etc. Ces derniers assurent une formation à distance qui répond aux besoins des apprenants. Un aspect très important à prendre en considération dans ces systèmes est l’évaluation précoce de l’apprenant en termes d’acquisition des connaissances. En général, trois types d’évaluation et leurs relations sont nécessaires durant le processus d’apprentissage, à savoir : (i) diagnostic qui est exécuté avant l’apprentissage pour estimer le niveau des élèves, (ii) évaluation formative qui est appliquée lors de l’apprentissage pour tester l’évolution des connaissances et (iii) évaluation sommative qui est considérée après l’apprentissage pour évaluer l’acquisition des connaissances. Ces méthodes peuvent être intégrées d’une manière semi-automatique, automatique ou adaptée aux différents contextes de formation, par exemple dans le domaine d’apprentissage des langues (français, anglais, etc.), des sciences fondamentales (mathématiques, physique, chimie, etc.) et langages de programmation (java, python, sql, etc.) Cependant, les méthodes d’évaluation usuelles sont statiques et se basent sur des fonctions linéaires qui ne prennent en considération que la réponse de l’apprenant. Elles ignorent, en effet, d’autres paramètres de son modèle de connaissances qui peuvent divulguer d’autres indicateurs de performance. Par exemple, le temps de résolution d’un problème, le nombre de tentatives, la qualité de la réponse, etc. Ces éléments servent à détecter les traits du profil, le comportement ainsi que les troubles d’apprentissage de l’apprenant. Ces paramètres additionnels sont vus dans nos travaux de recherche comme des traces d’apprentissage produites par l’apprenant durant une situation ou un contexte pédagogique donné. Dans ce cadre, nous proposons dans cette thèse une approche d’évaluation de l’apprenant à base des traces d’apprentissage qui peut être exploitée dans un système d’adaptation de la ressource et/ou de la situation pédagogique. Pour l’évaluation de l’apprenant, nous avons proposé trois modèles génériques d’évaluation qui prennent en considération la trace temporelle, le nombre de tentatives et leurs combinaisons. Ces modèles ont servi, par la suite, comme métrique de base à notre modèle d’adaptation de la ressource et/ou de la situation d’apprentissage. Le modèle d’adaptation est également fondé sur les trois traces susmentionnées et sur nos modèles d’évaluation. Notre modèle d’adaptation génère automatiquement des trajectoires d’apprentissage adaptées en utilisant un modèle d’état-transition. Les états présentent des situations d’apprentissage qui consomment des ressources et les transitions entre situations expriment les conditions nécessaires à remplir pour passer d’une situation à une autre. Ces concepts sont aussi implémentés dans une ontologie du domaine et un algorithme d’adaptation a été également proposé. L’algorithme assure deux types d’adaptation : (i) Adaptation de la situation et (ii) Adaptation des ressources dans une situation. Afin de collecter les traces d’apprentissage pour la mise en œuvre de notre approche d’évaluation de l’apprenant et d’adaptation de ressources et de situations d’apprentissage, nous avons effectué des expérimentations sur deux groupes d’étudiants en Licence Informatique (L2). Un groupe en apprentissage classique et un groupe en apprentissage adapté. Sur la base des traces obtenues des sessions de travail des étudiants, nous avons utilisé nos modèles d’évaluation dont les résultats ont été utilisés pour mettre en œuvre l’adaptation. Après comparaison des résultats de l’apprentissage adapté à ceux obtenus de l’apprentissage classique, nous avons constaté une amélioration des résultats en termes de moyenne générale et d’écart-type des moyennes des apprenants. / The adoption of new Information and Communication Technologies (ICT) has enabled the modernization of teaching methods in online learning systems such as e-Learning, intelligent tutorial systems (ITS), etc. These systems provide a remote training that which meets the learner needs. A very important aspect to consider in these systems is the early assessment of the learner in terms of knowledge acquisition. In general, three types of assessment and their relationships are needed during the learning process, namely : (i) diagnostic which is performed before learning to estimate the level of students, (ii) formative evaluation which is applied during learning to test the knowledge evolution and (iii) summative evaluation which is considered after learning to evaluate learner’s knowledge acquisition. These methods can be integrated into a semi-automatic, automatic or adapted way in different contexts of formation, for example in the field of languages literary learning such as French, English, etc., hard sciences (mathematics, physics, chemistry, etc.) and programming languages (java, python, sql, etc.). However, the usual evaluation methods are static and are based on linear functions that only take into account the learner’s response. They ignore other parameters of their knowledge model that may disclose other performance indicators. For example, the time to solve a problem, the number of attempts, the quality of the response, etc. These elements are used to detect the profile characteristics, behavior and learning disabilitiesof the learner. These additional parameters are seen in our research as learning traces produced by the learner during a given situation or pedagogical context. In this context, we propose in this thesis a learner evaluation approach based on learning traces that can be exploited in an adaptation system of the resource and/or the pedagogic situation. For the learner assessment, we have proposed three generic evaluation models that take into consideration the temporal trace, number of attempts and their combinations. These models are later used as a base metric for our resource adaptation model and/or learning situation. The adaptation model is also based on the three traces mentioned above and on our evaluation models. Our adaptation model automatically generates adapted paths using a state-transition model. The states represent learning situations that consume resources and the transitions between situations express the necessary conditions to pass from one situation to another. These concepts are implemented in a domain ontology and an algorithm that we have developed. The algorithm ensures two types of adaptation : (i) Adaptation of the situation and (ii) Adaptation of resources within a situation. In order to collect traces of training for the implementation of our approaches of learner evaluation and adaptation of resources and learning situations, we conducted experiments on two groups of students in Computer Science (L2). One group in classical training and the other group in adapted training. Based on the obtained traces from the students’ training sessions, we assessed merners based on our evaluation models. The results are then used to implement the adaptation in a domain ontology. The latter is implemented within oracle 11g which allows a rule-based semantic reasoning. After comparing the results of the adapted training with those obtained from the classical one, we found an improvement in the results in terms of general average and standard deviation of the learner averages.

By opening the learner model to both the learner and other peers within an e-learning system, the learner gains control over his or her learner model and is able to reflect on the contents presented in the model. Many current modeling systems translate an existing model to fit the context when information is needed. This thesis explores the observation that information in the model depends on the context in which it is generated and describes a method of generating the model for the specific user and purpose. The main advantage of this approach is that exactly the right information is generated to suit the context and needs of the learner. To explore the benefits and possible downsides of this approach, a learner model Query Tool was implemented to give instructors and learners the opportunity to ask specific questions (queries) of the content delivery system hosting several online courses. Information is computed in real time when the query is run by the instructor, so the data is always up-to-date. Instructors may then choose to allow students to run the query as well, enabling learner reflection on their progress in the course as the instructor has defined it. I have called this process active open learner modelling, referring to the open learner modelling community where learner models are accessible by learners for reflective purposes, and referring to the active learner modelling community which describes learner modelling as a context-driven process. Specific research questions explored in this thesis include "how does context affect the modelling process when learner models are opened to users", "how can privacy be maintained while useful information is provided", and "can an accurate and useful learner model be computed actively".

For many courses, mathematics included, there is an associated interactive e-learning system that provides assessment and tutoring. Some of these systems are classified as Intelligent Tutoring Systems. MyMathLab, Mathzone, and Assessment of LEarning in Knowledge Space (ALEKS) are just a few of the interactive e-learning systems in mathematics. In ALEKS, assessment and tutoring are based on the Knowledge Space Theory. Previous studies in a traditional learning environment have shown ALEKS users to perform equally or better in mathematics achievement than the group who did not use ALEKS. The purpose of this research was to investigate the effect of ALEKS on students’ achievement in mathematics in an online learning environment and to determine the cognitive complexity of mathematical tasks enacted by ALEKS’s initial (pretest) and final (posttest) assessments. The targeted population for this study was undergraduate students in College Mathematics I, in an online course at a private university in the southwestern United States. The study used a quasi-experimental One-Group non-randomized pretest and posttest design. Five methods of analysis and one model were used in analyzing data: t-test, correctional analysis, simple and multiple regression analysis, Cronbach’s Alpha reliability test and Webb’s depth of knowledge model. A t-test showed a difference between the pretest and posttest reports, meaning ALEKS had a significant effect on students’ mathematics achievement. The correlation analysis showed a significant positive linear relationship between the concept mastery reports and the formative and summative assessments reports meaning there is a direct relationship between the ALEKS concept mastery and the assessments. The regression equation showed a better model for predicting mathematics achievement with ALEKS when the time spent learning in ALEKS and the concept mastery scores are used as part of the model. According to Webb’s depth of knowledge model, the cognitive complexity of the pretest and posttest question items used by ALEKS were as follows: 50.5% required application of skills and concepts, 37.1% required recall of information, and 12.4% required strategic thinking: None of the questions items required extended thinking or complex reasoning, implying ALEKS is appropriate for skills and concepts building at this level of mathematics.

By opening the learner model to both the learner and other peers within an e-learning system, the learner gains control over his or her learner model and is able to reflect on the contents presented in the model. Many current modeling systems translate an existing model to fit the context when information is needed. This thesis explores the observation that information in the model depends on the context in which it is generated and describes a method of generating the model for the specific user and purpose. The main advantage of this approach is that exactly the right information is generated to suit the context and needs of the learner. To explore the benefits and possible downsides of this approach, a learner model Query Tool was implemented to give instructors and learners the opportunity to ask specific questions (queries) of the content delivery system hosting several online courses. Information is computed in real time when the query is run by the instructor, so the data is always up-to-date. Instructors may then choose to allow students to run the query as well, enabling learner reflection on their progress in the course as the instructor has defined it. I have called this process active open learner modelling, referring to the open learner modelling community where learner models are accessible by learners for reflective purposes, and referring to the active learner modelling community which describes learner modelling as a context-driven process. Specific research questions explored in this thesis include "how does context affect the modelling process when learner models are opened to users", "how can privacy be maintained while useful information is provided", and "can an accurate and useful learner model be computed actively".

Augmented Reality can visually convey abstract concepts and 3D spatial information in context with real-world objects, which makes it an ideal tool for training and educational purposes. This masters thesis investigates the use of Augmented Reality to assist with training for manual assembly and maintenance tasks. Improving on prior research, this approach combines Augmented Reality with a robust Intelligent Tutoring System to provide a more effective learning experience. After developing a modular software framework, a prototype was created that teaches the user to assemble hardware components on a computer motherboard. A thorough evaluation of the prototype found that the new intelligent approach significantly improves the learning outcome over traditional Augmented Reality training methods that do not employ Intelligent Tutoring Systems.

Thesis (M.S.)--Worcester Polytechnic Institute. / Keywords: Intelligent Tutoring Systems; Model Tracing; Machine Learning; Artificial Intelligence; Programming by Demonstration. Includes bibliographical references.

abstract: Science instructors need questions for use in exams, homework assignments, class discussions, reviews, and other instructional activities. Textbooks never have enough questions, so instructors must find them from other sources or generate their own questions. In order to supply instructors with biology questions, a semantic network approach was developed for generating open response biology questions. The generated questions were compared to professional authorized questions. To boost students’ learning experience, adaptive selection was built on the generated questions. Bayesian Knowledge Tracing was used as embedded assessment of the student’s current competence so that a suitable question could be selected based on the student’s previous performance. A between-subjects experiment with 42 participants was performed, where half of the participants studied with adaptive selected questions and the rest studied with mal-adaptive order of questions. Both groups significantly improved their test scores, and the participants in adaptive group registered larger learning gains than participants in the control group. To explore the possibility of generating rich instructional feedback for machine-generated questions, a question-paragraph mapping task was identified. Given a set of questions and a list of paragraphs for a textbook, the goal of the task was to map the related paragraphs to each question. An algorithm was developed whose performance was comparable to human annotators. A multiple-choice question with high quality distractors (incorrect answers) can be pedagogically valuable as well as being much easier to grade than open-response questions. Thus, an algorithm was developed to generate good distractors for multiple-choice questions. The machine-generated multiple-choice questions were compared to human-generated questions in terms of three measures: question difficulty, question discrimination and distractor usefulness. By recruiting 200 participants from Amazon Mechanical Turk, it turned out that the two types of questions performed very closely on all the three measures. / Dissertation/Thesis / Doctoral Dissertation Computer Science 2015

abstract: Embedded assessment constantly updates a model of the student as the student works on instructional tasks. Accurate embedded assessment allows students, instructors and instructional systems to make informed decisions without requiring the student to stop instruction and take a test. This thesis describes the development and comparison of several student models for Dragoon, an intelligent tutoring system. All the models were instances of Bayesian Knowledge Tracing, a standard method. Several methods of parameterization and calibration were explored using two recently developed toolkits, FAST and BNT-SM that replaces constant-valued parameters with logistic regressions. The evaluation was done by calculating the fit of the models to data from human subjects and by assessing the accuracy of their assessment of simulated students. The student models created using node properties as subskills were superior to coarse-grained, skill-only models. Adding this extra level of representation to emission parameters was superior to adding it to transmission parameters. Adding difficulty parameters did not improve fit, contrary to standard practice in psychometrics. / Dissertation/Thesis / Masters Thesis Computer Science 2015

abstract: Concept maps are commonly used knowledge visualization tools and have been shown to have a positive impact on learning. The main drawbacks of concept mapping are the requirement of training, and lack of feedback support. Thus, prior research has attempted to provide support and feedback in concept mapping, such as by developing computer-based concept mapping tools, offering starting templates and navigational supports, as well as providing automated feedback. Although these approaches have achieved promising results, there are still challenges that remain to be solved. For example, there is a need to create a concept mapping system that reduces the extraneous effort of editing a concept map while encouraging more cognitively beneficial behaviors. Also, there is little understanding of the cognitive process during concept mapping. What’s more, current feedback mechanisms in concept mapping only focus on the outcome of the map, instead of the learning process. This thesis work strives to solve the fundamental research question: How to leverage computer technologies to intelligently support concept mapping to promote meaningful learning? To approach this research question, I first present an intelligent concept mapping system, MindDot, that supports concept mapping via innovative integration of two features, hyperlink navigation, and expert template. The system reduces the effort of creating and modifying concept maps while encouraging beneficial activities such as comparing related concepts and establishing relationships among them. I then present the comparative strategy metric that modes student learning by evaluating behavioral patterns and learning strategies. Lastly, I develop an adaptive feedback system that provides immediate diagnostic feedback in response to both the key learning behaviors during concept mapping and the correctness and completeness of the created maps. Empirical evaluations indicated that the integrated navigational and template support in MindDot fostered effective learning behaviors and facilitating learning achievements. The comparative strategy model was shown to be highly representative of learning characteristics such as motivation, engagement, misconceptions, and predicted learning results. The feedback tutor also demonstrated positive impacts on supporting learning and assisting the development of effective learning strategies that prepare learners for future learning. This dissertation contributes to the field of supporting concept mapping with designs of technological affordances, a process-based student model, an adaptive feedback tutor, empirical evaluations of these proposed innovations, and implications for future support in concept mapping. / Dissertation/Thesis / Doctoral Dissertation Computer Science 2019

The COVID-19 pandemic wiped off decades of educational gains in the developing world and added 24 million more children to 775 million illiterates in the world. To counteract such a huge predicament, human learning agility comes into action. This human characteristic of knowing what to do when one does not know what to do, invokes the Soft System Methodology (SSM) approach to analyze illiteracy as the worst of all pandemics since it infiltrates into generations. After evaluating different effective teaching methods and utilizing the SSM approach, this paper proposes suitable pedagogies to educate deprived students. It examines Massive Online Open Courseware (MOOC) as a viable solution for K-12 students and compares it with a more robust educational technology model of Intelligent Tutoring System (ITS). Using artificial intelligence, the ITS tailors the instructional content framework and teaching strategies after evaluating students' pre-existing knowledge, learning habits, & styles. The ITS engages the student with the lesson with a two-way dialog while providing customized instruction and immediate feedback. An ITS requires no human intervention and could be a suitable replacement for an inadequately qualified teacher or no teacher. Hence it could be a practical tool in tackling the global literacy catastrophe. A comprehensive literature review followed by a meta-analysis reveals the effectiveness of ITS as a feasible intervention. The major purpose of this study is to define the application of educational pedagogy behind AI-based tutoring and cognitive science in this learner-centered approach.