Back to search

North Texas State University

A Comparison of Three Methods of Detecting Test Item Bias

Abstract

dc:description

This study compared three methods of detecting test item bias, the chi-square approach, the transformed item difficulties approach, and the Linn-Harnish three-parameter item response approach which is the only Item Response Theory (IRT) method that can be utilized with minority samples relatively small in size. The items on two tests which measured writing and reading skills were examined for evidence of sex and ethnic bias. Eight sets of samples, four from each test, were randomly selected from the population (N=7287) of sixth, seventh, and eighth grade students enrolled in a large, urban school district in the southwestern United States. Each set of samples, male/female, White/Hispanic, White/Black, and White/White, contained 800 examinees in the majority group and 200 in the minority group. In an attempt to control differences in ability that may have existed between the various population groups, examinees with scores greater or less than two standard deviations from their group's mean were eliminated. Ethnic samples contained equal numbers of each sex. The White/White sets of samples were utilized to provide baseline bias estimates because the tests could not logically be biased against these groups. Bias indices were then calculated for each set of samples with each of the three methods. Findings of this study indicate that the percent agreement between the Linn-Harnish IRT method and the chisquare and transformed difficulties methods is similar to that found in previous studies comparing the latter approaches with other IRT methods requiring large minority samples. Therefore, it appears that the Linn-Harnish IRT approach can be used in lieu of other more restrictive IRT methods. Ethnic bias appears to exist in the two tests as measured by the large mean bias indices for the White/Hispanic and White/Black samples. Little sex bias was found as evidenced by the low mean bias indices of the male/ female samples and the fact that the male/female mean bias indices were lower than those of the White/White in 33% of the samples.

Degree

thesis:*
Grantor dc:publisher
North Texas State University
Year dc:date
1985

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Monaco, Linda Gokey
Contributors dc:contributor
  • Thomas, L. Fred (Lawrence Fred)
  • Poirot, James L., 1939-
  • Curry, John F.
  • Brookshire, William K.

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Public
  • Monaco, Linda Gokey
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: 1002779391-Monaco
call-no: 379 N81d no. 2344
untcat: b1885832
oclc: 13026108
ark: ark:/67531/metadc331416

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Monaco, Linda Gokey. A Comparison of Three Methods of Detecting Test Item Bias. North Texas State University, 1985. https://digital.library.unt.edu/ark:/67531/metadc331416/