Return to search

Detecting cluster bias in a multilevel item response model: A Monte Carlo evaluation of detection methods and consequences of ignoring cluster bias

Cluster bias in a multilevel item response model can be investigated by testing whether the within-level item discriminations are equal to the between-level item discriminations. However, in most multilevel item response model applications, the possibility of cluster bias is often ignored. Cluster bias detection methods using a multilevel item response model (the likelihood ratio test, Wald test, AIC, BIC, and saBIC) and the consequences of ignoring cluster bias are illustrated and discussed. Simulation results showed that all criteria performed well in detecting global cluster bias except the BIC with small sample sizes and high ICCs when some portion of the items exhibited cluster bias. For item cluster bias, the AIC outperformed the other criteria in the presence of partial cluster bias. When cluster bias was ignored, accuracy of item discrimination estimates and standard errors was mainly problematic. Implications of the findings and limitations are discussed.

Identiferoai:union.ndltd.org:VANDERBILT/oai:VANDERBILTETD:etd-03152016-150627
Date22 March 2016
CreatorsLee, Woo-yeol
ContributorsSonya K. Sterba, Kristopher J. Preacher, Sun-Joo Cho
PublisherVANDERBILT
Source SetsVanderbilt University Theses
LanguageEnglish
Detected LanguageEnglish
Typetext
Formatapplication/pdf
Sourcehttp://etd.library.vanderbilt.edu/available/etd-03152016-150627/
Rightsrestricted, I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to Vanderbilt University or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report.

Page generated in 0.0019 seconds