Thesis (MPhil)--University of Stellenbosch, 2011. / Introduction: Objective Structured Clinical Examination (OSCE) examiner training is widely employed to address some of the reliability and validity issues that accompany the use of this assessment tool. An OSCE skills course was developed and implemented at the Stellenbosch Faculty of Health Sciences and the influence thereof on participants (clinicians) was evaluated. Method: Participants attended the OSCE skills course which included theoretical sessions concerning topics such as standard-setting, examiner influence and assessment instruments, as well as two staged OSCEs, one at the beginning and the other at the end of the course. During the latter, each participant examined a student role-player performing a technical skill while being video recorded. Participants‟ behaviour and assessment results from the two OSCEs were evaluated, as well as the feedback from participants regarding the course and group interviews with student role players. Results: There was a significant improvement in inter-rater reliability as well as a slight decrease in inappropriate examiner behaviour, such as teaching and prompting during assessment of students. Furthermore, overall feedback from participants and perceptions of student role-players was positive. Discussion: In this study, examiner conduct and inter-rater reliability was positively influenced by the following interventions: examiner briefing; involvement of examiners in constructing assessment instruments as well as viewing (on DVD) and reflection, by examiners, of their assessment behaviour. Conclusion: This study proposes that the development and implementation of an OSCE skills course is a worthwhile endeavour in improving validity and reliability of the OSCE as an assessment tool.

Examinations administered by the Royal Conservatory of Music (RCM) play a major role in the musical education of many individuals across Canada. The evaluative process needs to be a constructive one in order to ensure its positive impact on students’ musical education. Examiners who are confident and comfortable in their roles as assessors are more likely to provide this ideal environment for the students. Individuals at the dawn of their examining careers are prone to lower confidence and comfort levels due to their inexperience. Yet all music students deserve an optimal examination situation, even from new examiners. Ensuring that an examiner receives proper training will help to increase their confidence and comfort levels while assessing students. This study examined the elements of an examiner’s education, experience and preparation which contributed to higher confidence and comfort levels as they participated in the RCM evaluative process. Ten individuals participated in surveys and interviews. Seven were recent apprentices of the examiner training program and three were senior examiners. Their experiences and insights given in a narrative form shed light on which elements of their background and training benefited them as examiners. According to the participants, varied and extensive pedagogical training, taking exams as students and intensive performance education gave them the most advantages during their early careers as examiners. Regarding the examiner apprenticeship program, participants felt that they would have benefited from more practical experience during the early classroom seminar, additional opportunities to observe students at varying performing levels and more time for discussion with their mentors. These recommendations for background preparation and enhanced training are intended to give examiners greater confidence in their evaluative roles early in their careers, enabling them to provide constructive and effective assessments for students and their teachers.

Examinations administered by the Royal Conservatory of Music (RCM) play a major role in the musical education of many individuals across Canada. The evaluative process needs to be a constructive one in order to ensure its positive impact on students’ musical education. Examiners who are confident and comfortable in their roles as assessors are more likely to provide this ideal environment for the students. Individuals at the dawn of their examining careers are prone to lower confidence and comfort levels due to their inexperience. Yet all music students deserve an optimal examination situation, even from new examiners. Ensuring that an examiner receives proper training will help to increase their confidence and comfort levels while assessing students. This study examined the elements of an examiner’s education, experience and preparation which contributed to higher confidence and comfort levels as they participated in the RCM evaluative process. Ten individuals participated in surveys and interviews. Seven were recent apprentices of the examiner training program and three were senior examiners. Their experiences and insights given in a narrative form shed light on which elements of their background and training benefited them as examiners. According to the participants, varied and extensive pedagogical training, taking exams as students and intensive performance education gave them the most advantages during their early careers as examiners. Regarding the examiner apprenticeship program, participants felt that they would have benefited from more practical experience during the early classroom seminar, additional opportunities to observe students at varying performing levels and more time for discussion with their mentors. These recommendations for background preparation and enhanced training are intended to give examiners greater confidence in their evaluative roles early in their careers, enabling them to provide constructive and effective assessments for students and their teachers.