Wie die meisten westlichen Streitkräfte, bewegt sich die Bundeswehr im Spannungsfeld zwischen hohem Personalbedarf und Fachkräftemangel. Durch ein Onlineassessment kann der Bewerbungsprozess dahingehend optimiert werden, dass fähiges Personal schneller gebunden wird. Onlineassessment hat diverse Vorteile, gleichzeitig sind damit jedoch Herausforderungen verbunden. Die wahrscheinlich größte ist es, Betrug zu minimieren, da Onlineassessment in einer weitestgehend unkontrollierten Umgebung stattfindet. Zur Entgegnung dieser Problematik dienen verschiedene Ansätze, wie beispielsweise große Itempools, wodurch einer Verbreitung der Lösung im Internet entgegengewirkt werden kann. Dieser Ansatz ist jedoch mit hohen Kosten verbunden. Automatische Itemgenerierung hingegen ermöglicht es, kostengünstig und zeiteffizient psychometrisch hochwertige Items zu erstellen. Aus diesem Grund wurden in der vorliegenden Arbeit zwei Arbeitsgedächtnistests mit automatischer Itemgenerierung für das Onlineassessment der Bundeswehr entwickelt und evaluiert, mit dem Ziel einer hohen prädiktiven Validität auf die Diagnostik vor Ort. In der ersten Studie (N = 330) wurde gezeigt, dass automatische Itemgenerierung für die entwickelten Arbeitsgedächtnistests eingesetzt werden kann. Hierbei wurden zudem zwei verschiedene zeitliche Varianten untersucht, wobei sich diejenige mit der längeren Stimulusrepräsentationszeit als vorteilhafter erwies. In der zweiten Studie (N = 621) wurden Nachweise für Reliabilität und Validität erbracht. Die Tests zeigten eine gute konvergente und diskriminante Validität. Zudem konnte einer der beiden Tests eine sehr gute prädiktive Validität aufweisen. Unter Gesamtberücksichtigung der Testgütekriterien wurde dieser Test schließlich für das Onlineassessment der Bundeswehr vorgeschlagen. Somit steht der Bundeswehr nun ein wissenschaftlich fundierter Arbeitsgedächtnistest für das Onlineassessment zur Verfügung. / Like most Western armed forces, the Bundeswehr faces both high personnel requirements and a shortage of skilled personnel. Online assessment can optimize the application process to ensure that capable personnel are retained more quickly. Online assessment has various advantages, but also challenges associated with it. Probably the biggest of these challenges is minimizing cheating, as online assessment takes place in a largely unsupervised environment. Various approaches are used to counter this problem, such as large item pools, which can be used to counter the dissemination of solutions on the Internet. However, this approach is associated with high costs. Automatic item generation, on the other hand, makes it possible to create psychometrically high-quality items in a cost-effective and time-efficient manner. For this reason, two working memory tests with automatic item generation for the German Armed Forces’ online assessment were developed and evaluated in the present study, with the aim of matching the high predictive validity of on-site diagnostics. The first study (N = 330) demonstrated that automatic item generation can be used for the developed working memory tests. Two different temporal variants were also investigated, with the longer stimulus presentation time proving to be more beneficial. The second study (N = 621) provided reliability and validity evidence. The tests showed good convergent and discriminant validity. In addition, one of the two tests demonstrated very good predictive validity. Taking into account the overall test quality criteria, this test was ultimately proposed for use in the German Armed Forces’ online assessment. Thus, the Bundeswehr now has a scientifically-grounded working memory test available for its online assessment.

Assessment is an integral part of teaching and learning in higher education. The use of technology in higher education, particularly in the ODL environment, has brought some changes on how we teach and assess students. The traditional assessment practices needed to be reviewed and reconfigured to meet the requirements of the 21st century assessment practices. The purpose of this doctoral study was to design a framework to guide the assessment of an E-portfolio as an alternative assessment approach in an ODL context. The integrated theoretical framework of the learning theories (behaviourism, cognitive and constructivist) and the ODL theories (connectivist, online collaborative and self-directed) underpinned the study. This integrated framework explored lecturer and student experiences in the use of Eportfolio, as an alternative assessment to enhance self-directed learning. In striving to get in-depth insight into this study, the pragmatism paradigm, which calls for the mixed methods research design, was employed for the collection and analysis of data. The sample was drawn from a cohort of six participants and fifty-six respondents in the three colleges of the university. This sequential exploratory mixed methods design employed semi-structured interviews, document analysis for qualitative data collection while a Likert scale of an online questionnaire was used to collect quantitative data. The findings of this research indicated that the E-portfolio can be of greater use as an alternative assessment approach and was able to empower students with higher order thinking skills, critical thinking skills and self-directed learning equipping them with the 21st century skills. Several challenges were experienced during the implementation of the E-portfolio, which included lack of digital literacies and technical assistance, nonsynchronisation of the learning management system for hosting E-portfolio (myUnisa), UNISA’s policies which do not include E-portfolio assessment processes and procedures. In conclusion, the literature study, the findings of the empirical research and the recommendation of this study formed the basis for designing the framework to guide the assessment of an E-portfolio as an alternative assessment strategy for an ODL context. / Curriculum and Instructional Studies / Ph. D. (Curriculum Studies)