University of North Texas
Influence of Item Response Theory and Type of Judge on a Standard Set Using the Iterative Angoff Standard Setting Method
Abstract
dc:descriptionThe purpose of this investigation was to determine the influence of item response theory and different types of judges on a standard. The iterative Angoff standard setting method was employed by all judges to determine a cut-off score for a public school district-wide criterion-reformed test. The analysis of variance of the effect of judge type and standard setting method on the central tendency of the standard revealed the existence of an ordinal interaction between judge type and method. Without any knowledge of p-values, one judge group set an unrealistic standard. A significant disordinal interaction was found concerning the effect of judge type and standard setting method on the variance of the standard. A positive covariance was detected between judges' minimum pass level estimates and empirical item information. With both p-values and b-values, judge groups had mean minimum pass levels that were positively correlated (ranging from .77 to .86), regardless of the type of information given to the judges. No differences in correlations were detected between different judge types or different methods. The generalizability coefficients and phi indices for 12 judges included in any method or judge type were acceptable (ranging from .77 to .99). The generalizability coefficient and phi index for all 24 judges were quite high (.99 and .96, respectively).
Degree
thesis:*- Grantor dc:publisher
- University of North Texas
- Year dc:date
- 1992
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Hamberlin, Melanie Kidd
- Contributors dc:contributor
-
- Schumacker, Randall
- Anderson, Gary Weldon
- McCallon, Earl
- Haynes, Jack R.
Subjects
dc:subject × 6Rights
dc:rights- Statement dc:rights
-
- Public
- Hamberlin, Melanie Kidd
- Copyright
- Copyright is held by the author, unless otherwise noted. All rights reserved.
- Language dc:language
- English
Identifiers
dc:identifier.*- Identifier
-
local-cont-no: 1002717561-Hamberlin
call-no: 379 N81d no.3595
oclc: 28574212
untcat: b1700168
ark: ark:/67531/metadc332675