Back to search

University of Washington

Assessing the Accuracy of Provider Profiling Methods for Classification

Abstract

dc:description.abstract

Provider profiling as a means to describe and compare performance of health care professionals has gained great momentum in the past decade. The implications of profiling, which can drive provider incentives and guide health policy, call for precise and accurate statistical methods. We used a simulation study to compare the performance of three commonly used methods for estimating provider performance (ranking) and for identifying high performing providers (classifying). We evaluated classification performance based on sensitivity and specificity and ranking performance based on mean squared error. We found that when between-provider variability in performance was low, all three methods performed poorly, with low accuracy for identifying top performers and high mean squared error for ranking. We then demonstrated the performance of these methods in an application to data on satisfaction with mental health care providers. Based on these findings, we caution against the use of any classification method in the setting of low between-provider variability and recommend the use of risk-adjusted methods, which take into account variation in characteristics of providers' patients, when the ratio of between-provider variability to within-provider variability is high.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Ding, Victoria
Advisor dc:contributor.advisor
  • Hubbard, Rebecca A

Subjects

dc:subject × 2

Rights

dc:rights
Statement dc:rights
  • Copyright is held by the individual authors.
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1773/20754

Chain of custody

source
Harvested from
University of Washington
Base URL
digital.lib.washington.edu/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Ding, Victoria. Assessing the Accuracy of Provider Profiling Methods for Classification. 2012. http://hdl.handle.net/1773/20754