Back to search

National and Kapodistrian University of Athens

The impact of oral examiners’ conduct on candidates’ performance: the case of the KPG exam in english

Abstract

dc:description

The present research aims at describing the role examiners play in speaking tests by focusing on the ways in which they get involved in the candidates’ oral performance and examining the potential effects such involvement may have on the assessment of this performance. Since the assessment of oral proficiency has been characterised as a real challenge in the field of foreign language testing and assessment; and since the examiners have been recognised as one of the many variables which affect candidate performance and the assessment of it; investigation into the way examiners enact their role as interlocutors is inextricably linked with the demand for rigorous examiner training and monitoring of their practices, this aiming at increasing fairness in speaking test procedures. Drawing data from the speaking test of a relatively new foreign language examination battery, the KPG exams in English, at levels B2 (Independent User) and C1 (Proficient User), the present study has utilised three different types of methodology to attain the goals it set. Observation of actual examinations has yielded a list of types of examiner involvement and the frequency of their occurrence. It has also shed light into some types of candidate action or non-action causing such involvement as well as effects of different types of involvement on the candidate performance. A combined method of Discourse and Conversation Analysis of transcribed simulated speaking tests was then used to thoroughly study examples of examiner involvement, identify their causes and evaluate their effect on the candidate linguistic output; while systematicity of co-occurrence of specific types of causes-involvement-effects was also sought and recorded. Finally, written protocols by raters who assessed the simulated speaking tests were obtained with a view to revealing ways in which examiner involvement may influence the rating procedure. Although it has remained unclear how raters internalised examiner involvement in their assessment, they did appear to observe it and comment on it quite frequently. Finally, a model was derived depicting how examiners may be embedded in the candidates’ performance and potentially in the rating of this performance.Since the demand for coherence and transparency in language certification have been repeatedly accentuated and especially emphasised with the introduction of the CEFR, the present research provides valuable findings about the role of the examiner in the speaking test procedure and methodological ideas, which may and should be exploited in the training of oral examiners and the improvement of the testing procedure of the KPG exams as well as the monitoring and development of various oral tests, all of which pursue increased validity in examiner performance and inter- and intra-examiner reliability.

Degree

thesis:*
Grantor dc:publisher
National and Kapodistrian University of Athens
Year dc:date
2014

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Delieza, Xeni
  • Δελίεζα, Ξένη

Subjects

dc:subject × 6

Rights

Language dc:language
eng

Identifiers

dc:identifier.*
Identifier
10.12681/eadd/47738

Chain of custody

source
Harvested from
Greek National Archive of PhD Theses
Base URL
phdtheses.ekt.gr/eadd_oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Delieza, Xeni; Δελίεζα, Ξένη. The impact of oral examiners’ conduct on candidates’ performance: the case of the KPG exam in english. National and Kapodistrian University of Athens, 2014. http://hdl.handle.net/10442/hedi/47738