No description available.

Finite state test theory models the response behavior of an examinee and establishes the relationship between the ability of the examinee and the observed responses on a multiple-choice test. In finite state modeling, various assumptions about item characteristics and the examinees’ response strategies are made to estimate an examinee ability, and willingness to guess. Twelve sets of plausible assumptions about identifiability of distractors and examinee guessing strategies were adopted and the corresponding finite state models were actualized. Three consequences of the adoption of the 12 sets of assumptions were investigated: 1) the extent to which the resulting ability estimates rank ordered the examinees similarly, 2) variation in the magnitude of ability estimates and the estimated willingness to guess across the 12 models, and 3) the extent to which conclusions about examinees subgroups would differ according to the model employed. Also, conventional number-right scores were compared with the finite state scores with respect to the three outcomes just listed. All scoring methods rank ordered the examinees essentially the same. The magnitude of the finite state scores varied considerably across models mainly due to differing assumptions about the identifiability of distractors. Differing assumptions about examinee guessing strategy had surprisingly little effect on the magnitude of the ability estimates, though estimates of willingness to guess varied consistently according to the assumed strategies. Conclusions about group differences also varied across the models as a result of differing assumptions about both item characteristics and examinee guessing strategies. / Ph. D.

published_or_final_version / Education / Master / Master of Education

It is hypothesized that useful diagnostic information can reside in the wrong answers of multiple-choice tests, and that properly designed distractors can yield indications of misinformation and missing information in algorithmic reasoning on the part of the test taker. In addition to summarizing the literature regarding diagnostic research as opposed to scoring research, this study proposes a methodology for analyzing test results and compares the findings with those from the research of Birenbaum and Tatsuoka and others. The proposed method identifies the conditions of misinformation and missing information, and it contains a statistical compensation for careless errors. Strengths and weaknesses of the method are explored, and suggestions for further research are offered.

The objectives of this study were to construct and develop a two-tiered multiple-choice test for the measurement of student misconceptions in optics at the level of secondary education in Thailand, as well as to investigate the effects of gender, grade level, and type of school upon levels of student misconceptions. Misconceptions were measured by the Two-Tiered Optics Misconception (TTOM) test instrument developed for this study. Based upon criteria-evidence, the validity or appropriateness, meaningfulness, and usefulness of inferences derived from scores obtained from administration of the instrument was demonstrated at acceptable levels. The TTOM was administered to 932 high school subjects from randomly selected all-male, all-female, and coeducational 10th through 12th grade classes in Bangkok, Thailand. A mixed analysis of variance model was used to investigate the effects of gender, grade level, and type of school upon subject misconception scores in the field of optics. Analysis of the data revealed the following: 1) a paper-pencil test based upon a pattern of two-tiered multiple-choice questions and reasons developed for this study provided a valid and reliable measure of student misconceptions in optics at the level of secondary education in Thailand; 2) gender, grade level, and type of school did not have significant effects upon subject misconception scores among Thai high school students; 3) the subgroup school within type was found to have a significant effect upon subject misconception scores; 4) when fixed grade levels were considered for type of school, there were significant differences in misconceptions among 12th grade subjects from different types of schools; 5) certain consistent misconceptions in the area of optics, related to the properties of a converging lens, images from a plane mirror and a converging lens, light rays, regions of light travel, shadow formation, and lightning flashes, existed among Thai physics students at the level of secondary education. / Graduation date: 1994

The purpose of this study was to develop an instrument to provide valid and reliable measures of misconceptions in the area of photosynthesis and respiration among fourth, fifth, and sixth grade students in Thailand. A 17-item, two-tier multiple-choice test was developed and validated using construct-related evidence to determine the appropriateness of inferences from a set of test scores. The test was administered to 4,346 students in the fourth, fifth, and sixth grades in schools throughout Thailand. The study attempted to identify misconceptions held by Thai elementary students in the area of photosynthesis and respiration, and to examine the effects of grade level and gender on students' understandings of these concepts. A two-way analysis of variance, with grade level and gender as independent variables, was used to analyze test scores. Findings revealed that: (a) The two-tier multiple-choice test was valid and reliable; (b) mean scores among grade levels were significantly different (p=0.001); (c) mean scores between male and female genders were not significantly different (p=0.180); and (d) there was a significant interaction effect between grade level and gender (p=0.005). From these findings, the following was concluded: (a) The two-tier multiple-choice test provided valid and reliable measures of student misconceptions of selected science concepts at the elementary school level in Thailand; (b) most Thai students in grades 4, 5, and 6 held a large number of misconceptions of the selected concepts; (c) a majority of the students answered the content questions correctly, but did not understand the justification for the correct responses; (d) the higher the grade level, the greater the understanding of the concepts; and (e) female and male Thai students in grades 4, 5, and 6 did not differ significantly in their understanding of photosynthesis and respiration. / Graduation date: 1994

Thesis (Ph. D.)--Mississippi State University. Department of Curriculum and Instruction. / Title from title screen. Includes bibliographical references.

Thesis (Ph.D.)--Mississippi State University. Department of Counseling and Educational Psychology. / Title from title screen. Includes bibliographical references.

D.Litt.et Phil. (African Languages) / 1. The aim of the study The primary aim of this study was to ascertain whether or not a multiple-choice test can effectively assess English mother-tongue competence. Because the testing of language is at issue, the study was approached from an applied linguistic perspective. 2. The method of investigation 2.1. Uterature study. A review of the literature relating to the following topics was performed: (i) mother-tongue competence; (ii) language skills and in particular, the skills inherent in reading; (iii) the communicative approach to language teaching and testing; (iv) multiple-choice testing; and (v) test validity. 2.2. Empirical research work. Each of the four South African provincial education departments within the Department of Education and Culture: House of Assembly was called upon to compile three traditional English First Language papers for the trial matriculation examinations. A single item bank test of one hundred and fifty pretested multiple-choice questions was compiled for the same examination period. Pupils from the four provinces wrote the traditional papers which were set for their provinces. In other words, the pupils from each province wrote a separate set of traditional papers. In contrast, the same item bank test was written by all 9456 matriculants involved in the project. . 3. Findings The study revealed that the skills inherent in the four language modes of reading, writing, speaking and listening overlap each other to such an extent that it is virtually impossible to separate them for testing purposes. The validity coefficients of the combined scores of the three traditional papers and the total scores of the item bank test were consistently satisfactory for all four education

This study investigated the effective use of online Multiple-Choice Questions (MCQs) with immediate formative feedback, and the granting of partial credit for correct second or third chance answers when assessing and assisting students’ conceptual learning at higher cognitive levels. The research sample comprised first year engineering science students at the Tshwane University of Technology (TUT), Pretoria campus. The differences between using online MCQ-assessment for problem-solving calculations and using constructed written questions (CRQs)1 in the assessment of problem-solving calculations were explored. Furthermore, the differences between the assessment of problem-solving calculations using online MCQs without immediate formative feedback, and with immediate formative feedback and the granting of partial credit were analysed. The findings revealed that students’ marks were lower when answering problem-solving calculations using online MCQs without immediate formative feedback than when answering the same questions using CRQs. This clearly indicates that using online MCQs without immediate formative feedback is not effective in assessing scientific problem-solving calculations. Alternatively, online MCQs proved effective in assessing problem-solving calculations when immediate formative feedback and partial credit were employed. The statistical analysis showed that students performed significantly better when immediate formative feedback was given and partial credit was granted for correct second or third attempts. This was due to online MCQs utilising immediate formative feedback, which made it possible to grant partial credit when students chose the correct answers after feedback. This showed that online MCQs with immediate formative feedback and partial credit being granted can be an effective assessment tool for scientific problem-solving calculations. It increases performance and supports learning from assessment. Students can thus correct their calculations whilst in the process of doing them. / Science and Technology Education / M. Ed. (Science Education)