This explorative research paper looks at the attitudes and experiences of four EFL teachers towards assessment of English as a foreign language. The study was carried out using qualitative research with semi-structured interviews. The paper discusses factors that impact attitudes towards assessment. Our findings show that assessment is affected by a variety of factors, including colleagues, the head teacher and guiding documents. Furthermore, this paper identifies the need for more teacher education regarding the process of assessment, specifically formative assessment.

The purpose of this study is to examine the validity and reliability of summative assessment of EFL student writing in a Swedish context. Three teachers have assessed the same four student essays from the English 6 course in Swedish upper secondary school. In addition to grading each essay, the teachers have indicated the extent of conformity to the grading criteria in terms of flow, structure, cohesion, adaptation to purpose, clarity, and variation. The analyzed data show a variation in assessment criteria interpretation, affecting assessment validity and reliability, and questioning the assessment equivalence of the Swedish criterion-referenced gradingsystem. / Syftet med denna studie är att undersöka validiteten och reliabiliteten hos summativa bedömningar av studentuppsatser ur ett svenskt perspektiv. Tre lärare har bedömt samma fyra studentuppsatser från engelska 6. Förutom att betygsätta varje uppsats har lärarna angett graden av överensstämmelse med betygskriterierna: flöde, struktur, sammanhållning, anpassning till syfte, tydlighet och variation. De analyserade data visar en variation i tolkning av betygskriterier, vilket påverka rbedömningens validitet och reliabilitet och ifrågasätter bedömningslikvärdigheten i det svenska mål-relaterade betygssystemet.

No description available.

In this study, we examine how teachers in compulsory school for pupils with ID describes their knowledge assessment process and knowledge assessment practices. The purpose of the study is to contribute knowledge about knowledge assessment as an ideological practice in compulsory school for pupils with ID. Schiro´s (2013) teaching ideologies serve as the theoretical perspective in the analysis of the data. The study is a qualitative interview study conducted through ten semi-structured interviews with teachers working in compulsory school for pupils with ID. The study is based on the following research questions: • How do teachers describe the assessment practice in compulsory school for pupils with ID focusing on syllabus in subjects? • How do teachers describe the assessment process? • What traces of teaching ideologies are visible in the teachers' descriptions of knowledge assessment? From the study´s three research questions, the results shows that knowledge assessment is a cyclical process where several aspects interact and influence how the assessment is conducted and understood by the teachers. It is a complex and significant task for teachers to carry out, contributing to both students´ knowledge progression and the development of teaching. For the special education profession, knowledge assessment and grading are key areas highlighted in the degree ordinance. The special education teacher is also expected to serve as a qualified dialogue partner on matters related to learning and knowledge development for students with intellectual disabilities. / I den här studien undersöks hur lärare inom anpassad grundskola beskriver sin kunskapsbedömningsprocess och kunskapsbedömningspraktik. Syftet med studien är att bidra med kunskap om kunskapsbedömning som ideologisk praktik i anpassad grundskola. Som teoretiskt perspektiv i studien används Schiros (2013) undervisningsideologier i analysen av empirin. Studien är en kvalitativ intervjustudie som genomförts genom tio semistrukturerade intervjuer med lärare som arbetar i anpassad grundskola. Studien utgår ifrån följande frågeställningar: • Hur beskriver lärare bedömningspraktiken i anpassad grundskolas inriktning ämne? • Hur beskriver lärare bedömningsprocessen? • Vilka spår av undervisningsideologierna synliggörs i lärarnas beskrivningar av kunskapsbedömning? Utifrån studiens tre frågeställningar visar resultatet att kunskapsbedömning är en cyklisk process där flera aspekter samverkar och påverkar hur kunskapsbedömningen bedrivs och förstås av lärarna. Det är en komplex och betydelsefull arbetsuppgift för lärare att genomföra,som bidrar till både elevernas kunskapsprogression och undervisningens utveckling. För speciallärarprofessionen är kunskapsbedömning och betygsättning en av de punkter som återfinns i examensförordningen. Specialläraren ska även agera som en kvalificerad samtalspartner när det handlar om lärande och kunskapsutveckling för elever med en intellektuell funktionsnedsättning.

The objective of the research was to investigate an improvement in job performance when role-play is used as a training and assessment tool in a sales call centre environment. The research was conducted by means of a competence assessment used at different stages (Quality Assurance Performance Management Questionnaire). The final stage was two weeks after the learners who had qualified to be sales agents had entered a real working environment. At this final stage, calls were retrieved and rated against the Quality Assurance Performance Management Questionnaire (QAPMQ). A sample of 40 novice sales agents (learners) were selected and randomly divided into the control and experimental groups. The research findings indicated that if planned well, role-play can be an effective training and assessment tool. / Industrial & Organisational Psychology / M.Comm. (Industrial & Organisational Psychology)

Au cours des dernières années, les pratiques de l’évaluation comme aide à l’apprentissage (c’est-à-dire l’auto-évaluation, l’évaluation par les pairs, la rétroaction) dans la salle de classe ont été de plus en plus considérées comme des éléments essentiels (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). Cependant, dans le domaine de l’apprentissage d’une langue seconde la recherche sur ce sujet est plutôt limitée. En nous fondant sur les études de Colby-Kelly et Turner (2007) et de Lyster et Ranta (1997), nous avons mené une recherche exploratoire visant à combler ce besoin. L’objectif général était de comprendre comment l’évaluation formative se réalise dans deux cours d’anglais intermédiaire à l’Université de Montréal, et de comparer comment ces pratiques sont perçues et vécues par la professeure et ses étudiants. Trois questions de recherche étaient posées: 1. Quelle est la nature de l’évaluation formative dans une salle de classe d’anglais langue seconde? 2. Est-ce que les pratiques de la professeure reflètent ce qu’elle pense de l’évaluation formative? 3. Quels sont les correspondances et différences entre les croyances de la professeure et les perceptions de ses étudiants quant aux bénéfices de l’évaluation formative pour l’apprentissage de l’anglais langue seconde? La collecte de données comprend des observations en classe, des entrevues auprès de la professeure et des questionnaires pour les étudiants. Pour répondre à notre première question de recherche, nous avons analysé la rétroaction donnée par la professeure pendant une production orale réalisée par ses étudiants à partir de la typologie de feedback et de uptake de l’étude de Lyster et Ranta (1997). En ce qui a trait à la deuxième question de recherche, nous avons fait des entrevues avec la professeure en vue d’expliciter ses perceptions relativement à l’évaluation formative. À la fin du trimestre, nous avons comparé ses réponses avec sa pratique à partir des enregistrements vidéo produits en classe. Finalement, pour répondre à notre dernière question de recherche nous avons comparé les réponses données par la professeure aux entrevues avec les réponses des étudiants à un questionnaire adapté à partir de celui de Colby-Kelly et Turner. Finalement, nous présentons et discutons les résultats les plus significatifs obtenus dans cette étude qualitative Nous concluons cette thèse en proposant de avenues pour des recherches futures. / During the last twenty years, assessment practices for improving student learning (i.e., self-assessment, peer assessment, feedback) in the classroom has been considered as essential (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). In the field of second language learning, however, research in this area is quite limited. In order to address this gap, an exploratory research , based on Colby-Kelly and Turner’s (2007) and Lyster and Ranta’s (1997)studies has been conducted . The general objective was to understand how formative assessment is practiced in two Intermediate Oral English courses at the Université de Montréal and to compare how these practices are perceived and performed by the teacher and the students. Three research questions were pursued: 1. What is the nature of formative assessment in a second language classroom setting? 2. Do the teacher’s assessment practices reflect what she thinks about formative assessment? 3. What are the coincidences and differences between teacher’s perceptions and her students’ perceptions regarding the benefits of formative assessment for learning English? Data collection instruments consist of teacher interview guidelines, students’ questionnaire and classroom observation grids. In order to answer the first question, the feedback given by the teacher during the students’ oral performance has bee analysed using the types of feedback and uptake in Lyster and Ranta’s (1997) report. For the second research question, I interviewed the teacher at the beginning of each session and I elicited her beliefs about classroom-based formative assessment practice. At the end of the session I the teacher’s answers have beeb compared and contrasted with her actual performance, which was videotaped during the course. Finally, regarding the third question, teacher’s answers in the interviews have been compared with students’ answers on a questionnaire – adapted from Colby-Kelly and Turner’s one. The most significant results of this qualitative research are presented and discussed. In the conclusion, directions for future research are proposed

Genomförda undersökningar visar att formativ bedömning förbättrar elevers inlärning och förståelse. Den svenska läroplanen från 2011 ger tydliga indikationer på att formativ bedömning ska inkluderas i undervisningen. Vår diskussion i denna uppsats är därför aktuell och den visar hur forskare artikulerar fenomenet formativ bedömning. Litteraturstudien inkluderar information om vad formativ bedömning innebär och förslag på hur man kan arbeta utifrån ett sådant arbetssätt. Vår studie visar att de viktigaste komponenterna inom formativ bedömning är att tydliggöra målen, återkoppling samt själv- och kamratbedömning. Beskrivningarna av dessa resulterar i en analys där vi diskuterar det formativa arbetssättet. Både positiva och negativa aspekter tas upp. Vårt syfte med denna uppsats är att införskaffa djupare kunskaper om formativ bedömning likväl för oss själva som för redan aktiva lärare. Vi har en föraning om att många lärare inte har tillräckliga kunskaper kring ämnet och vår förhoppning är att denna uppsats kan fungera som ett verktyg för lärare som arbetar med eller skulle vilja arbeta med formativ bedömning. / Previous research shows that formative assessments improve pupils’ learning and understanding. Also, the Swedish Curriculum 2011 gives clear guidance that formative assessment should be included in school. Our discussion in this essay is therefore needed and it deals with how researchers articulate the phenomenon formative assessment. The study includes information about what formative assessment means and suggestions for how to work with it are given. The main parts within formative assessment are to clarify learning goals, feedback and self- and peer assessment. The information about these main parts ends in an analysis where a discussion about formative assessment and its positive and negative effects takes place.   Furthermore, the purpose of this essay is to inherit deeper knowledge about formative assessment as well for ourselves as for teachers already on duty. We anticipate that many teachers do not have sufficient knowledge about formative assessment and our expectation is that this essay can function as a tool for teachers who work or would like to work with formative assessment.

Au cours des dernières années, les pratiques de l’évaluation comme aide à l’apprentissage (c’est-à-dire l’auto-évaluation, l’évaluation par les pairs, la rétroaction) dans la salle de classe ont été de plus en plus considérées comme des éléments essentiels (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). Cependant, dans le domaine de l’apprentissage d’une langue seconde la recherche sur ce sujet est plutôt limitée. En nous fondant sur les études de Colby-Kelly et Turner (2007) et de Lyster et Ranta (1997), nous avons mené une recherche exploratoire visant à combler ce besoin. L’objectif général était de comprendre comment l’évaluation formative se réalise dans deux cours d’anglais intermédiaire à l’Université de Montréal, et de comparer comment ces pratiques sont perçues et vécues par la professeure et ses étudiants. Trois questions de recherche étaient posées: 1. Quelle est la nature de l’évaluation formative dans une salle de classe d’anglais langue seconde? 2. Est-ce que les pratiques de la professeure reflètent ce qu’elle pense de l’évaluation formative? 3. Quels sont les correspondances et différences entre les croyances de la professeure et les perceptions de ses étudiants quant aux bénéfices de l’évaluation formative pour l’apprentissage de l’anglais langue seconde? La collecte de données comprend des observations en classe, des entrevues auprès de la professeure et des questionnaires pour les étudiants. Pour répondre à notre première question de recherche, nous avons analysé la rétroaction donnée par la professeure pendant une production orale réalisée par ses étudiants à partir de la typologie de feedback et de uptake de l’étude de Lyster et Ranta (1997). En ce qui a trait à la deuxième question de recherche, nous avons fait des entrevues avec la professeure en vue d’expliciter ses perceptions relativement à l’évaluation formative. À la fin du trimestre, nous avons comparé ses réponses avec sa pratique à partir des enregistrements vidéo produits en classe. Finalement, pour répondre à notre dernière question de recherche nous avons comparé les réponses données par la professeure aux entrevues avec les réponses des étudiants à un questionnaire adapté à partir de celui de Colby-Kelly et Turner. Finalement, nous présentons et discutons les résultats les plus significatifs obtenus dans cette étude qualitative Nous concluons cette thèse en proposant de avenues pour des recherches futures. / During the last twenty years, assessment practices for improving student learning (i.e., self-assessment, peer assessment, feedback) in the classroom has been considered as essential (Black & Wiliam, 1998; Harlen & Winter, 2004; van de Watering & van der Rijt, 2006). In the field of second language learning, however, research in this area is quite limited. In order to address this gap, an exploratory research , based on Colby-Kelly and Turner’s (2007) and Lyster and Ranta’s (1997)studies has been conducted . The general objective was to understand how formative assessment is practiced in two Intermediate Oral English courses at the Université de Montréal and to compare how these practices are perceived and performed by the teacher and the students. Three research questions were pursued: 1. What is the nature of formative assessment in a second language classroom setting? 2. Do the teacher’s assessment practices reflect what she thinks about formative assessment? 3. What are the coincidences and differences between teacher’s perceptions and her students’ perceptions regarding the benefits of formative assessment for learning English? Data collection instruments consist of teacher interview guidelines, students’ questionnaire and classroom observation grids. In order to answer the first question, the feedback given by the teacher during the students’ oral performance has bee analysed using the types of feedback and uptake in Lyster and Ranta’s (1997) report. For the second research question, I interviewed the teacher at the beginning of each session and I elicited her beliefs about classroom-based formative assessment practice. At the end of the session I the teacher’s answers have beeb compared and contrasted with her actual performance, which was videotaped during the course. Finally, regarding the third question, teacher’s answers in the interviews have been compared with students’ answers on a questionnaire – adapted from Colby-Kelly and Turner’s one. The most significant results of this qualitative research are presented and discussed. In the conclusion, directions for future research are proposed

Online examinations are an integral component of many online learning environments and a high-stake process for students, teachers and educational institutions. They are the target of many security threats, including intrusion by hackers and collusion. Collu-sion happens when a student invites a third party to impersonate him/her in an online test, or to abet with the exam questions. This research proposed a profile-based chal-lenge question approach to create and consolidate a student's profile during the learning process, to be used for authentication in the examination process. The pro-posed method was investigated in six research studies using a usability test method and a risk-based security assessment method, in order to investigate usability attributes and security threats. The findings of the studies revealed that text-based questions are prone to usability issues such as ambiguity, syntactic variation, and spelling mistakes. The results of a usability analysis suggested that image-based questions are more usable than text-based questions (p < 0.01). The findings identified that dynamic profile questions are more efficient and effective than text-based and image-based questions (p < 0.01). Since text-based questions are associated with an individual's personal information, they are prone to being shared with impersonators. An increase in the numbers of chal-lenge questions being shared showed a significant linear trend (p < 0.01) and increased the success of an impersonation attack. An increase in the database size decreased the success of an impersonation attack with a significant linear trend (p < 0.01). The security analysis of dynamic profile questions revealed that an impersonation attack was not successful when a student shared credentials using email asynchronously. However, a similar attack was successful when a student and impersonator shared information in real time using mobile phones. The response time in this attack was significantly different when a genuine student responded to his challenge questions (p < 0.01). The security analysis revealed that the use of dynamic profile questions in a proctored exam can influence impersonation and abetting. This view was supported by online programme tutors in a focus group study.

The objective of the research was to investigate an improvement in job performance when role-play is used as a training and assessment tool in a sales call centre environment. The research was conducted by means of a competence assessment used at different stages (Quality Assurance Performance Management Questionnaire). The final stage was two weeks after the learners who had qualified to be sales agents had entered a real working environment. At this final stage, calls were retrieved and rated against the Quality Assurance Performance Management Questionnaire (QAPMQ). A sample of 40 novice sales agents (learners) were selected and randomly divided into the control and experimental groups. The research findings indicated that if planned well, role-play can be an effective training and assessment tool. / Industrial and Organisational Psychology / M.Comm. (Industrial & Organisational Psychology)