Back to search

University of Saskatchewan

A pilot study of a multi-source feedback process for hospital/healthcare- system pharmacists in Saskatchewan

Abstract

dc:description.abstract

Multisource feedback (MSF) is a promising tool for assessing healthcare professionals’ competencies, including pharmacists. Despite its potential, gaps remain in understanding pharmacists’ readiness for and the validity and reliability of the MSF process. This study investigated MSF’s application among hospital/healthcare-system pharmacists, evaluating its validity, reliability, feasibility, and acceptability. Participants (ratees) were hospital/healthcare-system pharmacists in Saskatchewan, Canada. They completed a self-assessment and recruited eight peer and eight non-peer raters (raters) to complete an assessment of them utilizing an online questionnaire. Ratees were provided with an anonymized collated report of their ratings and then participated in a facilitated discussion to review the report. Ratees and raters completed a survey to assess perceptions of the process’s validity, reliability, acceptability, and feasibility. Validity was assessed through multiple sources: content validity was supported by a focus group and literature review; construct validity was examined by comparing mean rating scores from ratees, peers, and non-peers with previous MSF studies; and response process validity was evaluated by analyzing the frequency of "unable to assess" responses. Reliability was assessed using Cronbach's alpha for peer and non-peer ratings, and free-text responses in the survey underwent structured tabular thematic analysis. Nine ratees completed the MSF process (response rate 2.5%). Recruiting the desired number of raters was a challenge; one out of nine participants recruited 16 raters. Despite these challenges, the MSF process demonstrated acceptable content, construct, and response process validity. Only one out of 18 questions had an "unable to assess" response rate greater than 20%, indicating strong response process validity. Internal validity was supported by Cronbach's alpha of 0.87 for non-peer and 0.89 for peer rating items. Ratees generally viewed the feedback as constructive, particularly regarding communication, collaboration, and professionalism competencies. The MSF process took a mean of 22 minutes for ratee self-assessment, 14.5 minutes for peer raters, and 10.3 minutes for non-peers; ratees and peers found the time burdensome, while non-peers did not. This study highlights the potential of MSF to enhance pharmacist competencies while identifying challenges prior to wider implementation Further research is recommended to strengthen MSF's impact on pharmacy practice and patient care.

Degree

thesis:*
Name thesis:degree_name
Master of Science (M.Sc.)
Level thesis:degree_level
Masters
Discipline thesis:degree_discipline
Pharmacy
Department thesis:degree_department
Pharmacy and Nutrition
Grantor
University of Saskatchewan
Year dc:date.issued
2025

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Herbert, Jeff D
Committee members dc:contributor.committeemember
  • Shevchuk, Yvonne
  • Gerwing, Shauna
  • Halpape, Katelyn
  • Wenghofer, Elizabeth
ORCID person:identifier.orcid

Subjects

dc:subject × 9

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/10388/16637

Chain of custody

source
Harvested from
University of Saskatchewan
Base URL
harvest.usask.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Herbert, Jeff D. A pilot study of a multi-source feedback process for hospital/healthcare- system pharmacists in Saskatchewan. Masters thesis, University of Saskatchewan, 2025. https://hdl.handle.net/10388/16637