Back to search

Virginia Commonwealth University

How to Score Situational Judgment Tests: A Theoretical Approach and Empirical Test

Abstract

dc:description.abstract

The purpose of this dissertation is to examine how the method used to a score situational judgment test (SJT) affects the validity of the SJT both in the presence of other predictors and as a single predictor of task performance. To this end, I compared the summed score approach of scoring SJTs with item response theory and multivariate items response theory. Using two samples and three sets of analyses, I found that the method used to score SJTs influences the validity of the test and that IRT and MIRT show promise for increasing SJT validity. However, no individual scoring method produced the highest amount of validity across all sets of analyses. In line with previous research, SJTs added incremental validity in the presence of GMA and personality and, again, the method used to score the SJT affected the incremental validity. A relative weights analysis was performed for each scoring method across all the sets of analyses showing that, depending on the scoring method, SJT score may account for more criterion variance than either GMA or personality. However, it is likely that the samples were influenced by range restriction present in the incumbent samples.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Management

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Whelpley, Christopher E.
Contributors dc:contributor
  • Michael A. McDaniel
  • S. Douglas Pugh
  • Frank A. Bosco
  • Jeffry A. Weekley

Subjects

dc:subject × 5

Rights

dc:rights
Statement dc:rights
  • © The Author

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Virginia Commonwealth University
Base URL
scholarscompass.vcu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Whelpley, Christopher E.. How to Score Situational Judgment Tests: A Theoretical Approach and Empirical Test. Dissertation thesis, https://doi.org/10.25772/E5Z9-3A87