Thesis (Ph.D.)--University of Delaware, 2006. / Principal faculty advisor: Ratna Nandakumar, School of Education. Includes bibliographical references.

The most recent development in the field of Item Response Theory (IRT) has been the evaluation of IRT models as multilevel models, known as Multilevel IRT models (MLIRT). These models offer several statistical and practical advantages over ordinary IRT models. However, models such as 2-PL MLIRT models have not been studied yet. This dissertation consists of two studies, a simulation and a substantiation for an urban school district dataset. The simulation study tested the performance of twoparameter (2-PL) MLIRT models with predictor variables under various conditions that included 3 test lengths (15, 30, and 60 items), 4 sample sizes (200, 500, 1000, and 2000), 2 correlation conditions between the predictor variable and the ability (or attitude) parameter (rpb=.35 and .8), and 4 binomial distributions of the predictor variable (p=0.1, 0.25, 0.4, and 0.5). The bias and Root Mean Square Deviation (RMSD) values of the item parameters indicated that the distribution of the predictor variable and the correlation between the predictor and the ability (or attitude) parameter did not affect the estimates of 2-PL MLIRT models. These models performed well for sample sizes as low as 500 and test lengths as low as 15 which is lower than the required sample size for ordinary IRT models. Even for a sample size of 200, sufficiently accurate estimates were obtained with more than 300 iterations. The second study investigated the characteristics of the items that measured urban teachers’ perceptions of cultural awareness and beliefs about teaching African American children and tested whether these perceptions were influenced by the teachers’ gender, ethnicity, or teaching experience. Teacher beliefs about teaching African American students, culturally responsive management, and cultural awareness factors were influenced by the ethnicity of the teachers. Culturally responsive management, home and community support, and curriculum and instructional strategies factors were influenced by the teaching experience of the teachers. Items that were biased based on ethnicity or teaching experience were identified. None of the items exhibited gender bias. The study identified items that could be used over other items when the need for a shorter instrument or more informative categories arises.

Thesis (Ph. D.)--Virginia Polytechnic Institute and State University, 1991. / Vita. Abstract. Includes bibliographical references (leaves 79-83). Also available via the Internet.

Thesis (Ph.D.)--Michigan State University. Measurement and Quantitative Methods, 2008. / Title from PDF t.p. (viewed on July 21, 2009) Includes bibliographical references (p. 111-120). Also issued in print.

Thesis (Ph. D.)--University of Florida, 1989. / Description based on print version record. Typescript. Vita. Includes bibliographical references (leaves 121-127).

Thesis (Ph. D.)--Washington State University, May 2010. / Title from PDF title page (viewed on July 15, 2010). "Department of Educational Leadership & Counseling Psychology." Includes bibliographical references (p. 67-73).

This thesis explores the implications for language test validation of developments in language teaching and testing methodology, test validity and computer-based delivery. It identifies a range of features that tests may now exhibit in novel combinations, and concludes that these combinations of factors favour a continuing process of validation for such tests. It proposes such a model designed around a series of cycles drawing on diverse sources of data. The research uses the Five Star test, a private commercial test designed for use in a specific cultural context, as an exemplar of a larger class of tests exhibiting some or all of these features. A range of validation activities on the Five Star test is reported and analysed from two quite different sources, an independent expert panel that scrutinised the test task by task and an analysis of 460 test results using item-response theory (IRT). The validation activities are critically evaluated for the purpose of the model, which is then applied to the Five Star test. A historical overview of language teaching and testing methodology reveals the communicative approach to be the dominant paradigm, but suggests that there is no clear consensus about the key features of this approach or how they combine. It has been applied incompletely to language testing, and important aspects of the approach are identified which remain problematic, especially for the assessment of spoken language. They include the constructs of authenticity, interaction and topicality whose status in the literature is reviewed and determinability in test events discussed. The evolution of validity in the broader field of educational and psychological testing informs the development of validation in language testing and a transition is identified away from validity as a one-time activity attaching to the test instrument towards validation as a continuing process that informs the interpretation of test results. In test delivery, this research reports on the validation issues raised by computer-based adaptive testing, particularly with respect to test instruments such as the Five Star test that combine direct face-to-face interaction with computer-based delivery. In the light of the theoretical issues raised and the application of the model to the Five Star test, some implications of the model for use in other test environments are presented critically and recommendations made for its development.

No description available.

No description available.

No description available.