Return to search

Rating errors and accuracy as a function of rater training and rating use

Role-playing performance appraisal simulations were used to test the effects of rater training on rating accuracy, psychometric rating errors, and accuracy-error relationships under different rating use conditions. Introductory psychology students ($N$ = 135) rated videotaped vignettes for simulated productivity improvement or legal defensibility performance appraisal (rating use) programs after receiving rater accuracy or rater error training (RAT or RET; Pulakos, 1984). RET reduced correlational halo, rating use information significantly improved accuracy, and rater training and rating use effects varied among dimensions. Inconsistent and contradictory results were found between correlational (differential) accuracy measured against mean expert ratings, desirable rating characteristics (Saal, Downey & Lahey, 1980), and traditional correlational halo. No manipulation effects were found for overall performance or rating accuracy confidence ratings, but rating use information appeared to redefine specific dimensions. Neither consistent rater training generalizations for different rating uses nor consistent error-accuracy inferences were supported. A motivational rather than cognitive processing explanation for rating accuracy and error effects appears to be supported by the results / acase@tulane.edu

  1. tulane:24750
Identiferoai:union.ndltd.org:TULANE/oai:http://digitallibrary.tulane.edu/:tulane_24750
Date January 1987
ContributorsRoth, Lawrence (Author), Sulzer, Jefferson L (Thesis advisor)
PublisherTulane University
Source SetsTulane University
LanguageEnglish
Detected LanguageEnglish
RightsAccess requires a license to the Dissertations and Theses (ProQuest) database., Copyright is in accordance with U.S. Copyright law

Page generated in 0.0024 seconds