The present research investigates the use of different question prompts and the discourse they generate in the SLE:OI, an ACTFL-variant second language oral proficiency interview test. One hundred and fifty-two question prompts used to elicit the test task of 'supporting an opinion,' were transcribed from 27 SLE:OI tests administered between July and November, 2000. From this, 30 categories of question prompts were identified by 6 SLE:OI raters acting as judges. Independently, the researcher and the judges determined task difficulty/complexity to be the predominant feature differentiating the categories. Using the 30 categories as a basis, the Question Prompt Complexity Questionnaire was produced and administered to the 6 judges. Analysis of the questionnaire data indicated a clear consensus for 3 categories into 'easy' and 'difficult' groups. Subsequently, candidate responses to 11 question prompts from the easy group, and 10 from the difficult group were transcribed, and discourse analyses were carried out to ascertain response levels of L2 fluency (by type-token ratio; frequency of silent and filled pauses, repetitions, and self-repairs), accuracy (by verb morphology and lexical use), and complexity (by clause subordination). The results demonstrated that those candidates tested with 'easy' and 'difficult' question prompts showed strong, significant differences in two aspects of their response fluency, but no significant differences in the accuracy or complexity of their responses. Based on these findings, several recommendations and implications for rater training were cited.

Thesis (MTech( Education)) -- Cape Technikon, Cape Town, 1996 / Clinical technology as a profession has been part of the rapid development of modem medical technology in South Africa. From the start the training of clinical technologists consisted of practical in-service training at an academic hospital and a theoretical component completed at a technikon. Questions about the standard of training of clinical technologists have often been raised by members of the profession. An initial opinion pole amongst recently qualified clinical technologists about the evaluation of their theoretical knowledge and practical skills showed that they were not certain what they were tested for in the examinations, or what the practical year mark was awarded for at the end of their experiential training. The question thus arose whether the evaluation of theoretical knowledge and practical skills were really appropriate and relevant. In order to investigate validity of the training process, namely the 'evaluation of clinical technology students, three literature studies were conducted. The first was to determine what acceptable evaluation practice is as regards the evaluation of theoretical content and practical skills. It was apparent from the literature that the inclusion of learning objectives should be the norm for effective goal orientated training and evaluation. The second literature study was conducted to determine the validity of the evaluation of clinical technology students. As a result of this literature study a description was made of the task of professions in the USA similar to clinical technology, the health worker in general and the profession of clinical technology specifically. From this task description it was apparent that the evaluation of clinical technologists' skills should not just include knowledge, comprehension and application, but that one should also test for analysis, synthesis and evaluation. The third literature study conducted was to determine whether Bloom's taxonomy for cognitive objectives could be used to provide a measure of the validity of test items. As a result of this literature study a classification of test items from final year papers was done to determine the cognitive level on which questions were formulated. v This analysis of test items showed that questions were mainly formulated on the knowledge level and did not provide for higher order skills as demanded by the task analysis of the clinical technologist. Referring to the evaluation of practical skills an analysis of the methods used by trainers to award the practical yearmark showed that training and evaluation are not being performed in an effective goal orientated manner. The reason is that trainers do not use training objectives for the development of cognitive, psychomotor and affective skills of students. The conclusion is made that performance evaluation of the theoretical content and practical skills of clinical technology students do not satisfy the criteria of validity. To improve the training and evaluation practice, it is recommended that training objectives for theoretical content and practical skills are formulated, that practical performance tests are designed, and that attention is given to the improvement of the training and evaluation skills of trainers and examiners.

No description available.

published_or_final_version / Language Studies / Master / Master of Arts

No description available.

No description available.

No description available.

There is no abstract available for this dissertation.

The underlying purpose of the study was to learn more about how elementary-aged children deal with tests purporting to measure critical thinking skills. This involved four related purposes: (a) development of a testing instrument, (b) analysis and evaluation of the test instrument, (c) to determine the difference of performance between grades, and (d) identification of commonality factors among the tests.

The purpose of this study was to investigate the predictive validity of formal and informal measuring instruments as related to reading achievement test scores at the end of first grade, in sixth grade, and in ninth grade. Second, relationships between first grade reading achievement test scores and those at sixth and ninth grades were sought. Third, the relationships between two visual motor coordination subtests and between the scores of two mental maturity tests were examined. Finally, the relationship between reading test scores for boys and girls was determined at each of these intervals.The initial population consisted of 195 first grade students in Mount Pleasant Community School System in Yorktown, Indiana. The first data were compiled in the Fall of 1968; a second collection was April, 1969; the third June, 1977, at which time 113 of the initial population of students were still enrolled.Instruments used included: (1) a teacher opinion rating scale of student reading potential (TRSS); (2) a form for documenting dates students began formal reading (DBRF); (3) Gates-MacGinitie Reading Readiness Test (GMRRT); (4) Cognitive Abilities Test (CAT); (5) Good-enough-Harris Drawing Test (GHDT), Draw-A-Man subtest; (6) Marianne Frostig Developmental Test of Visual Perception (MFDTVP); (7) Evanston Early Identification Scale (EELS); (8) Gates-MacGinitie Reading Test (GMRT); (9) Iowa Tests of Basic Skills (ITBS), Level 12, Form 5, Vocabulary and Reading Comprehension subtests; (10) Iowa Tests of Educational Development (ITED), Grades 9-12, Form X5, Reading subtest. All of the formal instruments were group-administered to the students by classroom teachers.Variables analyzed included twenty-one scores from the tests and subtests of the above measures. Statistical procedures used to analyze the data were the Pearson product-moment correlations, multiple regression correlations, and the t test. The .05 level was accepted as basis for statistical significance.The variables measured by the readiness test (GMRRT), visual perception test (MFDTVP), intelligence tests (CAT & GH DT), screening test (EELS), and teachers' opinions of students' potential reading abilities (TRSS) were related to reading abilities after eight months in school. The variables designated as listening comprehension, auditory discrimination, visual discrimination, following directions, word recognition, intelligence (CAT), teachers' opinions of students' potential reading abilities, and first grade reading achievement tests were related to reading abilities after five years in school. The variables identified as listening comprehension, auditory discrimination, visual-motor coordination, intelligence (CAT), position in space, teachers' opinions of students' potential reading abilities, and first grade reading achievement tests were related to reading abilities bf students after nine years in school.The intelligence test (CAT) had a high correlation with the sixth grade reading achievement test; the correlation with the first grade achievement test was not as high; the correlation was lowest with the ninth grade achievement test.There was a low, but statistically significant relationship between the two visual, motor coordination subtests (GMRRT & MFDTVP), and between the two inte71lectual measures (CAT & GHDT). Girls scored higher than boys on the first grade reading achievement tests, but the differences were not statistically significant after six and nine years in school.Of the formal and informal instruments administered prior to beginning formal reading only three subtests, Letter Recognition, Word Recognition, and Visual Discrimination, of the GMRRT and the Teacher Rating Scale of Students demonstrated predictive validity as to first grade reading ability. Two subtests, Auditory Blending and Listening Comprehension, of the GMRRT, Cognitive Abilities Test, Figure-Ground subtest of the MFDTVP, and the TRSS demonstrated predictive validity as to reading ability after five years in school. Two subtests, Following Directions and Listening Comprehension, of the GMRRT, TRSS, and DBRF demonstrated predictive validity of reading ability after nine years in school.In predicting first grade reading ability the instruments which were most effective were recommended to be included in a screening procedure. Using the conclusions of this study, the screening procedure should include the Letter Recognition, Word Recognition, and Visual Discrimination subtests of the GMRRT, and the Teacher Rating Scale of Students.