Return to search

A Comparison of Methods for Detecting Differential Distractor Functioning

This study examined the effectiveness of the odds-ratio method (Penfield, 2008) and the multinomial logistic regression method (Kato, Moen, & Thurlow, 2009) for measuring differential distractor functioning (DDF) effects in comparison to the standardized distractor analysis approach (Schmitt & Bleistein, 1987). Students classified as participating in free and reduced-price lunch programs served as the focal group and students not participating in these programs served as the reference group. The comparisons were conducted in such a way as to provide insight into two research questions: 1) whether the magnitude and pattern of the DDF effect is constant across all methods, and 2) whether the pattern of DDF effects support differential item functioning (DIF) findings. Measures of effect size are reported. In addition, the relationship between item characteristics and DIF and DDF effects were explored for patterns. Comparisons of three methods for detecting DDF were conducted in this study. The standardized distractor analysis and odds-ratio methods for detecting DDF were found to have very highly related results, with regard to both the magnitude and pattern of DDF effects. The multinomial logistic regression DDF results also were highly related to the standardized distractor analysis approach, but yielded slightly different patterns across distractors. The odds ratio and multinomial logistic regression methods are easily implemented with available software, such as the SPSS software package used in this study, unlike the standardized distractor analysis method which must be programmed. Despite these and the other discussed differences, all three methods present a viable option for use in improving test items included in statewide assessment programs. / A Dissertation submitted to the Department of Educational Psychology and Learning Systems in partial fulfillment of the
requirements for the degree of Doctor of Philosophy. / Spring Semester, 2010. / March 16, 2010. / Multinomial Logistic Regression, Standardization, Odds Ratio, Differential Distractor Functioning, Differential Item Functioning / Includes bibliographical references. / Betsy Jane Becker, Professor Co-Directing Dissertation; Akihito Kamata, Professor Co-Directing Dissertation; Adrian Barbu, University Representative; Jeannine Turner, Committee Member; Yanyun Yang, Committee Member.

Identiferoai:union.ndltd.org:fsu.edu/oai:fsu.digital.flvc.org:fsu_254099
ContributorsKoon, Sharon, 1966- (authoraut), Becker, Betsy Jane (professor co-directing dissertation), Kamata, Akihito (professor co-directing dissertation), Barbu, Adrian (university representative), Turner, Jeannine (committee member), Yang, Yanyun (committee member), Department of Educational Psychology and Learning Systems (degree granting department), Florida State University (degree granting institution)
PublisherFlorida State University, Florida State University
Source SetsFlorida State University
LanguageEnglish, English
Detected LanguageEnglish
TypeText, text
Format1 online resource, computer, application/pdf
RightsThis Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). The copyright in theses and dissertations completed at Florida State University is held by the students who author them.

Page generated in 0.0107 seconds