The College English Test (CET) in China is the largest language test in the world. The number of CET test-takers has steadily increased from 100,000 for its first administration in 1987 to 13 million in 2006. CET scores are used to draw inferences about the test-takers’ English as a foreign language proficiency as well as their specific skills in listening, speaking, reading, and writing. To justify the inferences drawn from test scores, evidence from a variety of sources should be constantly collected (Cronbach & Meehl, 1955; Messick, 1992; Chapelle, 1998; Bachman, 2000; Weir, 2005). Despite the large-scale and high-stakes nature of the CET and the importance of test validation, studies on the quality of the CET are scarce. This study aims to examine the construct validity of the reading comprehension section of the CET by modeling the internal relationships between test-takers’ scores on the CET reading section and their underlying reading abilities. Six components have been chosen as observed variables of the latent variable of reading ability, namely, word recognition efficiency, working memory, semantic knowledge, syntactic knowledge, discourse knowledge, and metacognitive reading skills. A pseudowords identification task programmed by the DMDX computer software, a revised version of Daneman & Carpenter’s (1980) sentence reading span working memory test, Meara & Milton’s (2002) Yes/No vocabulary tests, the syntactic test used in Shiotsu & Weir’s (2007) study, Abeywickrama’s (2007) discourse knowledge test, and a revised version of Phakiti’s (2008) strategy use questionnaire were utilized to measure these six observed variables. A total of 181 Chinese undergraduates participated in the study. With a baseline confirmatory factor model of reading ability and the CET scores, a structural model was analyzed. The results indicated that the path from reading ability to test performance was .75 and the squared regression coefficient of test performance was .56, which implied that participants’ test performance was strongly underlined by their actual reading ability. Therefore, the scores on the CET reading section are largely justifiable for use in drawing inferences about participants’ reading ability. Implications for validation research and reading instruction were also explored. / text

This study examined motivation, anxiety, global awareness, and linguistic confidence, and their relation to language test performance within the context of Chinese university students taking the College English Test Band 4(CET-4) in China. Using a mixed methods approach, through survey and interview inquiries, this study explored whether and how the selected psychological factors contributed to students’ CET performance. Results from exploratory factor analysis revealed that Chinese university students displayed three types of instrumental motivation (i.e., mark orientation, further-education orientation, and job orientation), two types of anxiety (i.e., language anxiety and test anxiety), and two types of confidence (i.e., linguistic confidence and test confidence). The results of confirmatory factor analysis led to a modified socio-educational model of motivation with some context-specific concepts (i.e., new instrumental orientations, global awareness, and linguistic confidence) that more accurately represented the characteristics of the Chinese university students. The results of structural equation modelling confirmed that attitude toward the learning situation and integrative orientation were two strong indicators of motivation, which in turn influenced language achievement and confidence. The negative impact of anxiety on language achievement was confirmed. Certain group differences were found in comparing male students with female students, high achievers with low achievers, students from the Arts programs with those from the Science programs, and students who started to learn English before Grade 7 with those iii who did so after Grade 7. The interview findings indicated stronger instrumental orientations than integrative orientations. External influences, including influences from society, teachers, and peers, were also identified. Students expressed their mixed feelings toward the CET-4, indicating that this test had both positive and negative influences in promoting their English learning. Testing well-developed motivation and anxiety models in the Chinese context enriched and expanded our knowledge in theory development in English language education in China. The implications of this study point to the importance of understanding language test-takers’ characteristics in their macro and micro learning contexts, as well as the importance of establishing the relevance of English language learning to language teaching, and testing in English as Foreign Language contexts. / Thesis (Ph.D, Education) -- Queen's University, 2009-12-30 22:08:41.138