In the assessment, each student was marked by two raters, assigned at random to the student from a pool of 200 raters. These raters had undergone a series of instructional programs and training prior to the job. Each of the two raters gave seven scores to the script. As there was no minimum number of words as required in the writing assessment, a general belief would be generated that if there was insufficient content (as evidenced by a low score in "content") and poor organization (low score in "organization"), then the student would have written so few words that the chance of making mistakes in "vocabulary" (the 6th score) and in "punctuation" (the 7 th score) would be relatively small. In order to rectify the deficiency in marking, this study used three different methods to apply weights on the "vocabulary" score and on the "punctuation" score. For each method, the GENOVA program was used to calculate the reliability of the assessments. After due comparison, it was found that each of the methods used was able to raise the reliabilities of the assessments under investigation, and the most recommended method was to use students' scores in "content and in structure" as weights. / In writing assessment, there are quite a number of factors influencing the marking stability and the reliability of the assessment such as the attitude towards marking and consistency of markers, the physical environment, the design of the items, and marking rubrics. Even the methods to train markers have effects on the reliability of the assessment. Generalizability Theory was used in this research to analyze the Chinese writing assessment of the Territory-wide System Assessment (TSA) so as to improve the reliability of the assessment. / On the one hand, the study has examined the present mode of marking of the writing assessment in the TSA. This gives opportunity for improving the item-setting and the script-marking procedures of the assessment with a view to raising its reliability and giving valuable feedbacks to teaching and learning. On the other hand, the favourable results of applying weights to sub-scores will serve to provide a good example on improving marking rubrics in large-scale standardized tests of writing assessment in Chinese Language. vi / This study was a post-mortem analysis of the raw scores from a sample of 6,000 students who participated in TSA 2006. As there were three sub-papers, the sample consisted of 2,000 students from each sub-paper. Brennan's GENOVA program (1983) was used to calculate the reliabilities of the assessments. / TSA is a standardized test administered centrally by the Hong Kong Examinations and Assessment Authority every year. The target groups are students from Primary 3, Primary 6 and Secondary 3. TSA focuses on assessing students' basic competency on the three core subjects, Chinese Language, English Language and Mathematics. In contrast to the traditional Chinese writing assessment, there was no requirement on the minimum number of words produced by the student. An analytical approach was adopted to assess students' writing tasks. As a result of this measure, students who did well in some particular marking criteria would end up with a good overall performance. / 林玲芝. / Adviser: Kit Tai Hau. / Source: Dissertation Abstracts International, Volume: 73-02, Section: A, page: . / Thesis (Ph.D.)--Chinese University of Hong Kong, 2010. / Includes bibliographical references (p. 84-98). / Electronic reproduction. Hong Kong : Chinese University of Hong Kong, [2012] System requirements: Adobe Acrobat Reader. Available via World Wide Web. / Electronic reproduction. [Ann Arbor, MI] : ProQuest Information and Learning, [201-] System requirements: Adobe Acrobat Reader. Available via World Wide Web. / Abstracts in Chinese and English. / Lin Lingzhi.
| Identifer | oai:union.ndltd.org:cuhk.edu.hk/oai:cuhk-dr:cuhk_344868 |
| Date | January 2010 |
| Contributors | 林玲芝., Chinese University of Hong Kong Graduate School. Division of Education., Lin, Lingzhi. |
| Source Sets | The Chinese University of Hong Kong |
| Language | Chinese, English |
| Detected Language | English |
| Type | Text, theses |
| Format | electronic resource, microform, microfiche, 1 online resource (x, 111 p. : ill.) |
| Coverage | China, Hong Kong, China, Hong Kong, China, Hong Kong |
| Rights | Use of this resource is governed by the terms and conditions of the Creative Commons “Attribution-NonCommercial-NoDerivatives 4.0 International” License (http://creativecommons.org/licenses/by-nc-nd/4.0/) |
Page generated in 0.0028 seconds