Back to search

Michigan State University

A novel approach to evaluate item pools : the Item Pool Utilization Index

Abstract

dc:description

In this study, an index to quantify the adequacy of an item pool of an adaptive test for a given set of test specifications and examinee population is introduced. This index is called the Item Pool Utilization Index (IPUI). The IPUI ranges from 0 to 1, with values close to 1 indicating the item pool can provide optimum items to examinees throughout the test. This index can be used to compare different item pools or diagnose the deficiencies of a given item pool by quantifying the amount of deviation from a perfect item pool. Simulation studies were conducted to evaluate the capacity of this index for detecting the inadequacies of both simulated and operational item pools. The added value of this index was compared to the existing methods of evaluating the quality of computerized adaptive tests (CAT). Results of the study showed that the IPUI can detect even slight deviations of the item pools from an optimal item pool. It can uncover the shortcomings of an item pool that other outcomes of CAT cannot detect. Additionally, it can be used to diagnose the weaknesses of the item pool and guide test developers to improve their item pools.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gönülateş, Emre
Contributors dc:contributor
  • Reckase, Mark D.
  • Konstantopoulos, Spyros
  • Houang, Richard T.
  • Nye, Christopher D.

Subjects

dc:subject × 2

Rights

dc:rights
Statement dc:rights
  • In Copyright
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
etd:3479
isbn:9781339297415
isbn:1339297418
oclc:945891093
umi:3739198
local:Gonulates_grad.msu_0128D_14186

Chain of custody

source
Harvested from
Michigan State University
Base URL
d.lib.msu.edu/oai
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Gönülateş, Emre. A novel approach to evaluate item pools : the Item Pool Utilization Index. 2015. https://doi.org/doi:10.25335/hzva-6262