Back to search

University of North Texas

A Comparison of Three Item Selection Methods in Criterion-Referenced Tests

Abstract

dc:description

This study compared three methods of selecting the best discriminating test items and the resultant test reliability of mastery/nonmastery classifications. These three methods were (a) the agreement approach, (b) the phi coefficient approach, and (c) the random selection approach. Test responses from 1,836 students on a 50-item physical science test were used, from which 90 distinct data sets were generated for analysis. These 90 data sets contained 10 replications of the combination of three different sample sizes (75, 150, and 300) and three different numbers of test items (15, 25, and 35). The results of this study indicated that the agreement approach was an appropriate method to be used for selecting criterion-referenced test items at the classroom level, while the phi coefficient approach was an appropriate method to be used at the district and/or state levels. The random selection method did not have similar characteristics in selecting test items and produced the lowest reliabilities, when compared with the agreement and the phi coefficient approaches.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
1988

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Lin, Hui-Fen
Contributors dc:contributor
  • Young, Jon I.
  • Yang, Chao-Chih
  • Wilson, Michael J.
  • Beyerlein, Michael Martin
  • Moore, Alan D.

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • Public
  • Lin, Hui-Fen
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: 1002714779-Lin
call-no: 379 N81d no.2884
untcat: b1986805
ark: ark:/67531/metadc332327

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Lin, Hui-Fen. A Comparison of Three Item Selection Methods in Criterion-Referenced Tests. University of North Texas, 1988. https://digital.library.unt.edu/ark:/67531/metadc332327/