University of North Texas
A Comparison of Three Item Selection Methods in Criterion-Referenced Tests
Abstract
dc:descriptionThis study compared three methods of selecting the best discriminating test items and the resultant test reliability of mastery/nonmastery classifications. These three methods were (a) the agreement approach, (b) the phi coefficient approach, and (c) the random selection approach. Test responses from 1,836 students on a 50-item physical science test were used, from which 90 distinct data sets were generated for analysis. These 90 data sets contained 10 replications of the combination of three different sample sizes (75, 150, and 300) and three different numbers of test items (15, 25, and 35). The results of this study indicated that the agreement approach was an appropriate method to be used for selecting criterion-referenced test items at the classroom level, while the phi coefficient approach was an appropriate method to be used at the district and/or state levels. The random selection method did not have similar characteristics in selecting test items and produced the lowest reliabilities, when compared with the agreement and the phi coefficient approaches.
Degree
thesis:*- Grantor dc:publisher
- University of North Texas
- Year dc:date
- 1988
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Lin, Hui-Fen
- Contributors dc:contributor
-
- Young, Jon I.
- Yang, Chao-Chih
- Wilson, Michael J.
- Beyerlein, Michael Martin
- Moore, Alan D.
Subjects
dc:subject × 5Rights
dc:rights- Statement dc:rights
-
- Public
- Lin, Hui-Fen
- Copyright
- Copyright is held by the author, unless otherwise noted. All rights reserved.
- Language dc:language
- English
Identifiers
dc:identifier.*- Identifier
-
local-cont-no: 1002714779-Lin
call-no: 379 N81d no.2884
untcat: b1986805
ark: ark:/67531/metadc332327