M.Ed. (Education) / The purpose of this analytical and evaluative study was to establish why certain items of the std 7 English First Language Item Bank did not discriminate well and to make suggestions to avoid similar item failure in future. To do this the item analysis had to be interpreted and the content validity of the failed items and the entire test had to be established. The literature review emphasized the importance of syllabus analysis, test planning, the setting of objectives, item review before the application of a test and the value of item analysis in the creation of item banks. The std 7 English First Language Core Syllabus was analysed according to linguistic principles, educational objectives and skills ...

The purpose of this research was to explore the coherence and effectiveness of an assessment approach that combined principles of cognitive-based assessment, performance assessment, and the Next Generation Science Standards. By drawing on research on learning progressions and cognition in geoscience to design, implement, and analyze an Earth Science performance assessment at the high school level, I explored the challenges and opportunities inherent in a cognitively-based science performance assessment system. The primary research question for this study was: How do cognitively-based performance assessments promote coherence between students’ understanding, responses, and scoring? Four subquestions allowed me to compare observations of student thinking with written responses and scores across multiple modalities in order to characterize the overall coherence of the assessment system. Using a design study approach, an assessment was developed using a two-phase process. First, a construct map was created that outlined a learning progression for each of four geology subdomains: geologic time & stratigraphy; surface processes; plate tectonics; and geologic maps. Second, the construct map guided the development of interconnected performance assessment tasks intended to elicit and measure student thinking within those geology subdomains. Twenty-two high school students engaged in a think-aloud protocol while completing the performance assessment. Student responses from the performance assessment were scored according to a predetermined scoring procedure that generated scores on individual items as well as holistic scores for each construct. Data from student written responses and think-alouds were quantitatively coded in alignment with the cognitive model for the assessment system. I used these data to examine the correlations between student thinking, written responses, and scores, in both item-by-item and holistic modalities. The strength of these correlations varied by construct, but some overall patterns emerged: (1) The design of this cognitively-based science performance assessment was successful in eliciting thinking about all four levels of each construct, and there were instances where student thinking went beyond the intended bounds of specific items. (2) For comparisons of student thinking to written responses or scores, holistic values captured a similar or better level of correlation than individual items, pointing to the important role of holistic scoring in the interpretation phase of this assessment approach. (3) The performance assessment produced scores for three out of four constructs with statistically significant correlations to student thinking. Together, these results show that fully capturing student thinking remains a formidable challenge for the assessment field, but that cognitively-based science performance assessment tasks have significant potential to reveal the extent and breadth of student thinking beyond traditional assessment approaches. The findings in this study have implications for the ways in which different stakeholders in science education, including classroom teachers, curriculum writers, and education leadership, can harness the power of cognitively-based assessment tools to better measure and support student learning.

The purpose of this research was to identify parental involvement variables which are effective in improving the Reading and Math achievement of children with Attention Deficit Hyperactivity Disorder (ADHD). A conceptual model examining achievement as influenced by background variables and parental involvement variables was hypothesized. Background variables of socio-economic status, ethnicity, gender, child age, and ability were proposed to affect parental involvement variables which were represented by expectations, communication, structure, participation, homework procedures and time, TV time, medication, special education, and the outcome variable, achievement. Parental involvement variables were proposed to have direct affects on achievement. Data from a sample of 208 families with a child diagnosed as having ADHD and attending elementary school (grades Kindergarten through sixth) were subjected to path analytic analyses using multiple regression procedures. Findings were generally inconsistent with much of the previous research on parental involvement within the nonADHD population. Results did suggest some parental involvement variables which had differential, important effects on achievement depending on which criterion was used (Reading or Math grades). It was suggested that these findings were indicative of the behavioral and management problems seen in children with Attention Deficit Disorders, but that there do appear to be certain strategies parents can use to help their ADHD children achieve at a higher level in school. / Ed. D.

published_or_final_version / Education / Master / Master of Education

D.Phil. (Education) / The study-group in this study focus on the education students of the Rand Afrikaans University (RAU) from 1988-1990. All these students completed the diagnostic testing program of RAU as well as the practical course in didactics. The practical mark in didactics were used to distribute the students into three research sub-groups. This mark reflected the students' didactical skills in a simulated classroom situation. The diagnostic data which was utilised to compile a profile of the study-group consisted of tests for intelligence, aptitude, adaptation, personality and study habits, as well as relevant biographical data. The students' academic achievement in matric was determined by the M-score. The three sub-groups were determined by calculating the average of the groups' practical mark and cut-off points of half a standard deviation on either side of the average. This presupposed a less superior didactical group (Group A) versus a superior didactical group (Group B), utilized for statistical purposes. The calculations did not include the middle group. The entire discussion of the career process selection was based on Super's career choice model. This was done to determine the main contributory factors in selecting teaching as a career. A literature study was made of the teacher and teaching as a career, followed by a discussion of the Importance of the attributes of the excellent teacher, which included more than just good academic achievement. Teaching as a career was also discussed, emphasizing a temporary difference between the practical and theoretical aspects of t118 didactics course, in order to identify which specific attributes contributed to the success in the practical component of the course. A discussion based on literature was done to determine the various psychological tests and questionnaires which were utilized in this study, namely NSGT, SAT, 16-PF, PHSF, 19-FII, SSHAas well as supportive biographical data. The aim of this study was to determine certain psychological aspects which contributed to the success in the practical components of a course in didactics. A career choice is usually made during the late adolescence. In discussing a career choice model, Super (1990) explains various determinants which influence career choice including the geographical origin, personality and contributory aspects of an individual's personality...

Da Prüfungen und Tests häufig dazu dienen, den Zugang zu Bildungsprogrammen zu steuern und die Grundlage zur Abschlussvergabe am Ende von Bildungsprogrammen bilden, ist ihre Fairness und Validität von größter Bedeutung. Ein kontrovers diskutierter Aspekt standardisierter Tests ist die Verwendung von Zeitlimits. Unabhängig davon ob eine Testadministration Zeitdruck hervorrufen soll oder nicht, sollten Testentwickler:innen in die Lage versetzt werden, den Zeitdruck einer Testadministrationen explizit gestalten zu können. Zu diesem Zweck schlägt van der Linden (2011a, 2011b) einen Ansatz zur Kontrolle des Zeitdrucks von Tests in der automatisierten Testhefterstellung (ATA) unter Verwendung von Mixed Integer Linear Programming und eines lognormalen Antwortzeitmodells vor. Dabei hat der Ansatz von van der Linden jedoch eine zentrale Limitation: Er ist auf das zwei-parametrische lognormale Antwortzeitmodell beschränkt, das gleiche Geschwindigkeits-Sensitivitäten (d.h. Faktorladungen) für alle Items annimmt. Diese Arbeit zeigt, dass ansonsten parallele Testhefte mit unterschiedlichen Geschwindigkeits-Sensitivitäten für bestimmte Testteilnehmende unfair sind. Darüber hinaus wird eine Erweiterung des van der Linden-Ansatzes vorgestellt, die unterschiedliche Geschwindigkeits-Sensitivitäten von Items in ATA berücksichtigt. Weiter wird diskutiert, wie Testhefte mit identischen, aber unterschiedlich angeordneten Items zu Fairness-Problemen aufgrund von Item-Positionseffekten führen können und wie dies verhindert werden kann. Die vorliegende Arbeit enthält zusätzlich Anleitungen zur Verwendung des R-Pakets eatATA für ATA und zur Verwendung von Stan und rstan für Bayesianische hierarchische Antwortzeitmodellierung. Abschließend werden Alternativen, praktische Implikationen und Grenzen der vorgeschlagenen Ansätze diskutiert und Vorschläge für zukünftige Forschungsthemen gemacht. / As examinations and assessments are often used to control access to educational programs and to assess successful participation in an educational program, their fairness and validity is of great importance. A controversially discussed aspect of standardized tests is setting time limits on tests and how this practice can result in test speededness. Regardless of whether a test should be speeded or not, being able to deliberately control the speededness of tests is desirable. For this purpose, van der Linden (2011a, 2011b) proposed an approach to control the speededness of tests in automated test assembly (ATA) using mixed integer linear programming and a lognormal response time model. However, the approach by van der Linden (2011a, 2011b) has an important limitation, in that it is restricted to the two-parameter lognormal response time model which assumes equal speed sensitivities (i.e., factor loadings) across items. This thesis demonstrates that otherwise parallel test forms with differential speed sensitivities are indeed unfair for specific test-takers. Furthermore, an extension of the van der Linden approach is introduced, which incorporates speed sensitivities in ATA. Additionally, test speededness can undermine the fairness of a test if identical but differently ordered test forms are used. To prevent that the score of test-takers depends on whether easy or difficult items are located at the end of a test form, it is proposed that the same, most time intensive items should be placed at the end of all test forms. The thesis also provides introductions and tutorials on using the R package eatATA for ATA and using Stan and rstan for Bayesian hierarchical response time modeling. Finally, the thesis discusses alternatives, practical implications, and limitations of the proposed approaches and provides an outlook on future related research topics.

The present study sets out to evaluate the effectiveness of a dynamic approach to aptitude testing. It was proposed that it is not always appropriate to use conventional aptitude tests to predict future academic success in the South African context. The study posited the belief that an alternative testing format could be facilitated by using a test-train-test procedure within a learning potential paradigm. The learning potential paradigm as formulated through Vygotskian and Feuersteinian theory is operationalised in the form of a Newtest Battery. The Newtest procedure is in direct contrast to traditional approaches to aptitude testing. The latter approaches both implicitly and explicitly adopt a static view of ability, whereas the Newtest approach focuses on the learning potential of the testee, as well as consequent performance. However, the assessment of learning potential poses problems of its own. Modifications were introduced to ensure that the Newtest format is both appropriate and psychometrically defensible. The construction and evaluation of the Newtest Battery is described. A sample of both advantaged and disadvantaged students were tested on a battery of traditional aptitude tests. This group of students was contrasted with another sample of both advantaged and disadvantaged students who undertook the Newtest Battery in the modified dynamic testing format. The traditional measures of aptitude were found to be invalid predictors of university success. Matric results showed a relationship with academic success for both groups. The Newtest measures enhanced the prediction of academic success for both advantaged and disadvantaged students. The Deductive Reasoning dynamic measure was found to be a valid predictor of university success for the disadvantaged students. The results thus successfully extend the learning potential paradigm into the realm of group aptitude testing. The validity of traditional aptitude test measures has been brought into question by the findings of the study. The study points the way forward to a more equitable and relevant aptitude testing procedure. Finally, it was shown that the testing environment forms part of the socio-educational context. Personnel involved in the administration of aptitude tests are given guidelines \vi th the aim of equalising the test process. / Psychology of Education / D. Ed. (Psychology of Education)

The present study sets out to evaluate the effectiveness of a dynamic approach to aptitude testing. It was proposed that it is not always appropriate to use conventional aptitude tests to predict future academic success in the South African context. The study posited the belief that an alternative testing format could be facilitated by using a test-train-test procedure within a learning potential paradigm. The learning potential paradigm as formulated through Vygotskian and Feuersteinian theory is operationalised in the form of a Newtest Battery. The Newtest procedure is in direct contrast to traditional approaches to aptitude testing. The latter approaches both implicitly and explicitly adopt a static view of ability, whereas the Newtest approach focuses on the learning potential of the testee, as well as consequent performance. However, the assessment of learning potential poses problems of its own. Modifications were introduced to ensure that the Newtest format is both appropriate and psychometrically defensible. The construction and evaluation of the Newtest Battery is described. A sample of both advantaged and disadvantaged students were tested on a battery of traditional aptitude tests. This group of students was contrasted with another sample of both advantaged and disadvantaged students who undertook the Newtest Battery in the modified dynamic testing format. The traditional measures of aptitude were found to be invalid predictors of university success. Matric results showed a relationship with academic success for both groups. The Newtest measures enhanced the prediction of academic success for both advantaged and disadvantaged students. The Deductive Reasoning dynamic measure was found to be a valid predictor of university success for the disadvantaged students. The results thus successfully extend the learning potential paradigm into the realm of group aptitude testing. The validity of traditional aptitude test measures has been brought into question by the findings of the study. The study points the way forward to a more equitable and relevant aptitude testing procedure. Finally, it was shown that the testing environment forms part of the socio-educational context. Personnel involved in the administration of aptitude tests are given guidelines \vi th the aim of equalising the test process. / Psychology of Education / D. Ed. (Psychology of Education)