Back to search

South Dakota State University

A Psychometric Evaluation of Innovative Item Types Added to the National Certification Examination for Certified Registered Nurse Anesthetists

Abstract

dc:description.abstract

Problem. Innovative items were added as scored items to the Certification Examination for Nurse Anesthetists (NCE) in 2010 and no studies to date have evaluated the psychometric impact of adding innovative items to the examination. Participants. Examination data were taken from all examinees who had graduated from an accredited nurse anesthesia program (N=1257) and items (N=992) from August 1, 2010 to January 10, 2011 to analyze ability estimates, response times, and discrimination differences with innovative items. First time, recent examinee data from August through December of 2008 (N=1071), 2009 (N=1039), and 2010 (N=994) were compared for pass rate and score distribution. Finally, an experimental pool of items (N=248) was analyzed for unidimensionality. Methodology. Candidate ability was estimated for both innovative items and multiple-choice questions (MCQs) utilizing three tests: a t-test comparison between the ability estimate means, a t-score comparison between individual candidates utilizing a pooled standard deviation, and a Pearson correlation between the ability estimates. Response times were evaluated with ANOVA and post hoc Tukey tests. A comparison of pass rates over three years was accomplished with pairwise z-tests with Bonferroni correction. Score distributions were analyzed with ANOVA. Item discrimination was analyzed with a t-test comparison of MCQs and innovative items and ANOVA analysis of discrimination in individual item types. Bifactor analysis and the Bayesian information criterion were used to analyze the unidimensionality of the innovative items. Findings. Candidates had a significantly higher ability estimate in innovative items (2.688) than in MCQs (2.580) (t=-6.819, p=0) and 84 candidates (6.7%) performed significantly differently in innovative items. The ability estimates correlated at r=.58. Items were significantly different in response times (F=5234, p=0). A significant difference was found in the pass rate comparison of 2008 to 2010 (z=3.354, p=.001). Innovative items discriminated to a higher degree than MCQs (t=-2.527, p=.012). The innovative items exhibited unidimensionality to the same degree at MCQs and the BIC confirmed the Rasch model as acceptable for scoring. Implications. The increased time required to respond to innovative items may become problematic as more items are added to the examination. The higher discrimination of the innovative items improves the NCE as a measurement tool. The BIC supports the continued use of the unidimensional model.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (PhD)
Level thesis:degree_level
Dissertation - University Access Only
Discipline thesis:degree_discipline
Graduate Nursing

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Krogh, Mary Anne
Contributors dc:contributor
  • Thomas Stenvig
  • Sandra Bunkers

Subjects

dc:subject × 1

Rights

Language dc:language
English

Identifiers

dc:identifier.*
Repository record dc:identifier
https://openprairie.sdstate.edu/etd/5295

Chain of custody

source
Harvested from
South Dakota State University
Base URL
openprairie.sdstate.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Krogh, Mary Anne. A Psychometric Evaluation of Innovative Item Types Added to the National Certification Examination for Certified Registered Nurse Anesthetists. Dissertation - University Access Only thesis, https://openprairie.sdstate.edu/etd/5295