In an effort to demonstrate the usefulness of personality tests as predictors of job performance, it is common practice to draw a validation sample consisting of individuals who are currently employed on the job in question. It has long been assumed that the results of such a study are appropriately generalized to the setting wherein job candidates respond to personality inventories as an application requirement. The purpose of this manuscript was to critically evaluate the evidence supporting the presumed interchangeability of present-employees and job applicants. Existing research on the use of personality tests in occupational settings is reviewed. Theoretical reasons to anticipate differential response processes and self-report personality profiles according to test-taking status (present employees versus job applicants) are reviewed, as is empirical research examining relevant issues. The question of sample type substitutability is further probed via a quantitative review (meta-analysis) of the criterion-related validity of seven personality constructs (Neuroticism, Extraversion, Openness to Experience, Agreeableness, Conscientiousness, Optimism, and Ambition). Further, the meta-analytic correlations among these personality constructs are estimated. Test-taking status is examined as a moderator of the criterion-related validities as well as the personality construct inter-correlations. Meta-analytic correlation matrices are then constructed on the basis of the job incumbent and the job applicant subgroup results. These correlation matrices are utilized in a simulation study designed to estimate the potential degree of error when job incumbents are used in place of job applicants in a validation study for personality tests.
The results of the meta-analyses and the subsequent simulation study suggest that the moderating effect of sample type on criterion-related validity estimates is generally small. Sample type does appear to moderate the criterion-related validity of some personality constructs, but the direction of the effect is inconsistent: in some cases, incumbent validities are larger than applicant validities. Alternatively, incumbent validities sometimes are smaller than applicant validities. Personality construct inter-correlations yield almost no evidence of moderation by sample type. Further, where there are between group differences in the personality construct inter-correlations, these differences have little bearing on the regression equation relating personality to job performance. Despite a few caveats that are discussed, the results are supportive of the use of incumbent samples in personality-test validation research. / Ph. D.
| Identifer | oai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/11052 |
| Date | 30 October 2003 |
| Creators | Bradley, Kevin Michael |
| Contributors | Psychology, Hauenstein, Neil M. A., Finney, Jack W., Donovan, John J., Foti, Roseanne J., Carlson, Kevin D. |
| Publisher | Virginia Tech |
| Source Sets | Virginia Tech Theses and Dissertation |
| Detected Language | English |
| Type | Dissertation |
| Format | ETD, application/pdf |
| Rights | In Copyright, http://rightsstatements.org/vocab/InC/1.0/ |
| Relation | bradley_dissertation_final.pdf |
Page generated in 0.0019 seconds