Back to search

University of North Texas

Influence of Item Response Theory and Type of Judge on a Standard Set Using the Iterative Angoff Standard Setting Method

Abstract

dc:description

The purpose of this investigation was to determine the influence of item response theory and different types of judges on a standard. The iterative Angoff standard setting method was employed by all judges to determine a cut-off score for a public school district-wide criterion-reformed test. The analysis of variance of the effect of judge type and standard setting method on the central tendency of the standard revealed the existence of an ordinal interaction between judge type and method. Without any knowledge of p-values, one judge group set an unrealistic standard. A significant disordinal interaction was found concerning the effect of judge type and standard setting method on the variance of the standard. A positive covariance was detected between judges' minimum pass level estimates and empirical item information. With both p-values and b-values, judge groups had mean minimum pass levels that were positively correlated (ranging from .77 to .86), regardless of the type of information given to the judges. No differences in correlations were detected between different judge types or different methods. The generalizability coefficients and phi indices for 12 judges included in any method or judge type were acceptable (ranging from .77 to .99). The generalizability coefficient and phi index for all 24 judges were quite high (.99 and .96, respectively).

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
1992

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Hamberlin, Melanie Kidd
Contributors dc:contributor
  • Schumacker, Randall
  • Anderson, Gary Weldon
  • McCallon, Earl
  • Haynes, Jack R.

Subjects

dc:subject × 6

Rights

dc:rights
Statement dc:rights
  • Public
  • Hamberlin, Melanie Kidd
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: 1002717561-Hamberlin
call-no: 379 N81d no.3595
oclc: 28574212
untcat: b1700168
ark: ark:/67531/metadc332675

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Hamberlin, Melanie Kidd. Influence of Item Response Theory and Type of Judge on a Standard Set Using the Iterative Angoff Standard Setting Method. University of North Texas, 1992. https://digital.library.unt.edu/ark:/67531/metadc332675/