published_or_final_version / Education / Master / Master of Education

In this research, I investigated the extent to which language versions (English, French and Arabic) of the same science test were comparable in terms of item difficulty and demands. I used PISA science 2006 data from three countries (respectively, UK, France and Jordan). I argued that language was an intrinsic part of the scientific literacy construct, be it intended or not by the examiner. The tight relationship between the language element and the scientific knowledge makes the language variable inextricable from the construct. This argument has considerable implications on methodologies used to address this question. I also argued that none of the available statistical or qualitative techniques were capable of teasing out the language variable and answering the research question. In this thesis, I adopted a critical evaluation and empirical methods, using literature from various fields (cognitive linguistics, psychology, measurement and science education) to analyse the test development and design procedures. In addition, I illustrated my claims with evidence from the technical reports and examples of released items. I adopted the same class of models employed in PISA, the Rasch model, as well as differential item functioning (DIF) techniques to address my question empirically. General tests of fit suggested an overall good fit of the data to the model with eleven items out of 103 showing strong evidence of misfit. Various violations to the requirements of the Rasch model were highlighted. The DIF analysis indicated that 22% of the items showed bias in the selected countries, but bias balanced out at test level. Limitations of the DIF analysis to identify the source of bias were discussed. Qualitative approaches to investigating question demands were examined and issues with their usefulness in international settings were discussed. A way forward incorporating cognitive load theory and computational linguistics is proposed.

The purpose of this case study was to explore the quality enhancement plan (QEP) process and its influence on student learning of critical thinking and the institutional environment from the perspective of key stakeholders at two community colleges accredited by the Southern Association of Colleges and Schools Commission on Colleges (the Commission). Key stakeholders were defined as faculty, staff, and administrators who had direct and continuous involvement with the development and/or implementation of the QEP. This was accomplished through document reviews and analysis of interviews. The study was guided by intertwined quality assurance systems accountability, accreditation, and assessment, and six of Deming’s (1986) total quality management principles. These principles are: (1) customer, (2) training and development, (3) teamwork, (4) measurement, (5) improvement, and (6) leadership (Bosner, 1992; Deming, 1986; Marchese, 1991; Sallis, 2002). / Includes bibliography. / Dissertation (Ph.D.)--Florida Atlantic University, 2015. / FAU Electronic Theses and Dissertations Collection