Back to search

Georgia Institute of Technology

Impact of composite population priors on computer adaptive test proficiency estimates

Abstract

dc:description.abstract

Testing has existed for thousands of years and has evolved from all examinees receiving the same test to adaptive testing, in which the test is tailored to the individual examinee. These adaptive testing designs have shown to be improvements over fixed-length, conventional tests in terms of proficiency measurement, reduced testing time, and faster scoring. A popular method of test administration is computer adaptive testing (CAT) using expected a posteriori (EAP) estimation. This Bayesian estimation approach utilizes previous information known about the examinee to obtain more precise estimates of the individual’s ability. An appropriate prior will generally increase estimation precision, decrease outlier influences, and provide an estimate for all possible response patterns. An inappropriate prior, however, may result in biased estimates (Embretson & Reise, 2000). Previous studies have used collateral information (i.e., additional information) concerning the examinee, such as demographic variables, age, grade, or previous test scores, to aid in estimation. Several studies have used previous test scores (Matteucci & Veldkamp, 2013; Veldkamp & Matteucci, 2013; van der Linden, 1999), but none have looked directly at priors based on group membership. This study examined the influence of various group priors, such as composite priors (i.e., priors created from combining groups) and individual priors (i.e., priors specific to the group), on estimation in CAT designs. Results of the study show group-specific priors perform best; however, it is impossible to know true group membership. Thus, results of the study support the use of priors based on the population because priors based on demographics may adversely impact some high ability groups.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Psychology
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2017

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Morrison, Kristin M.
Advisor dc:contributor.advisor
  • Embretson, Susan E.
Committee members dc:contributor.committeemember
  • Roberts, James S.
  • Spieler, Daniel
  • Templin, Jonathan
  • Thomas, Rick

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/58555

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Morrison, Kristin M.. Impact of composite population priors on computer adaptive test proficiency estimates. Doctoral thesis, Georgia Institute of Technology, 2017. http://hdl.handle.net/1853/58555