In this dissertation, a DIF detection method for testlet-based data was developed and evaluated. The proposed DIF model is an extension of a bi-factor multidimensional IRT model for testlets. Unlike other IRT-based DIF detection models, the proposed model is capable of taking LID due to testlets into account and thus estimating DIF magnitude more accurately when a test is composed of testlets. A fully Bayesian estimation method was adopted for parameter estimation. Estimating parameters for the proposed DIF detection model with traditional MLE methods is computationally expensive since the MLE methods adopt approximation methods such as Gaussian quadrature. An MCMC estimation method implemented in this study does not have such a limitation. The proposed DIF model was evaluated by comparing parameter recovery with an IRT-based DIF model with simulated data. Simulation factors in this study were a) magnitude of testlet effect, b) magnitude of DIF, and c) magnitude of item discrimination. Three different levels were considered for the first simulation factor, while the other two factors had two levels. As a result, there were 12 simulation conditions in this study. For each simulation condition, simulation was replicated 100 times. Evaluation criteria were bias, SE, and RMSE of each parameter in the proposed DIF model, as well as DIF detection rate and DIF detection error rate. The proposed DIF model was also applied to a statewide assessment dataset to confirm the utility of the model. Educational implications and limitations of this study were also discussed. / A Dissertation submitted to the Department of Educational Psychology and Learning Systems in partial fulfillment of the requirements for the degree of Doctor of
Philosophy. / Spring Semester, 2009. / February 17, 2009. / Differential Item Functioning, A Bi-factor Multidimensional Item Response Theory, Testlets / Includes bibliographical references. / Akihito Kamata, Professor Directing Dissertation; Fred Huffer, Outside Committee Member; Betsy Becker, Committee Member; Yanyun Yang, Committee Member.
| Identifer | oai:union.ndltd.org:fsu.edu/oai:fsu.digital.flvc.org:fsu_182516 |
| Contributors | Fukuhara, Hirotaka, 1978- (authoraut), Kamata, Akihito (professor directing dissertation), Huffer, Fred (outside committee member), Becker, Betsy (committee member), Yang, Yanyun (committee member), Department of Educational Psychology and Learning Systems (degree granting department), Florida State University (degree granting institution) |
| Publisher | Florida State University, Florida State University |
| Source Sets | Florida State University |
| Language | English, English |
| Detected Language | English |
| Type | Text, text |
| Format | 1 online resource, computer, application/pdf |
| Rights | This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). The copyright in theses and dissertations completed at Florida State University is held by the students who author them. |
Page generated in 0.0026 seconds