Students entering academic programmes are frequently overwhelmed by the demand for extensive reading and comprehension of information derived from multiple and contrasting sources. This entails both careful and expeditious reading. The latter has been generally neglected in research and has not been the focus of many tests. Both types of reading were investigated in this study through a validation process of the summative English reading test for academic purposes taken at the end of the Foundation Programme in Oman. In particular, context validity was established through focusing on the interaction between the linguistic demands and task setting parameters and also the cognitive processes through which the students engaged with the test tasks. To establish the context validity of the test, this study adopted Khalifa and Weir’s (2009) model which not only embraced the complex and multi-componential nature of reading but also provided a workable validation framework. A multi-strategy approach was adopted. A natural experiment utilising Verbal Protocol Analysis captured the cognitive processes through which students engaged in reading. Automated analysis software and opinions of expert judges were used to compare test passages with text extracts drawn from first year academic courses. Correlation tests and factor analysis revealed these cognitive processes and established the robustness of the Khalifa and Weir (2009) model, which was thus validated in a second language context. Passages in the foundation tests were found to be generally representative of academic texts although certain features such as abstractness were under-represented.

Students entering academic programmes are frequently overwhelmed by the demand for extensive reading and comprehension of information derived from multiple and contrasting sources. This entails both careful and expeditious reading. The latter has been generally neglected in research and has not been the focus of many tests. Both types of reading were investigated in this study through a validation process of the summative English reading test for academic purposes taken at the end of the Foundation Programme in Oman. In particular, context validity was established through focusing on the interaction between the linguistic demands and task setting parameters and also the cognitive processes through which the students engaged with the test tasks. To establish the context validity of the test, this study adopted Khalifa and Weir’s (2009) model which not only embraced the complex and multi-componential nature of reading but also provided a workable validation framework. A multi-strategy approach was adopted. A natural experiment utilising Verbal Protocol Analysis captured the cognitive processes through which students engaged in reading. Automated analysis software and opinions of expert judges were used to compare test passages with text extracts drawn from first year academic courses. Correlation tests and factor analysis revealed these cognitive processes and established the robustness of the Khalifa and Weir (2009) model, which was thus validated in a second language context. Passages in the foundation tests were found to be generally representative of academic texts although certain features such as abstractness were under-represented. / Government of the Sultanate of Oman, represented by the Ministry of Manpower

Schema acquisition processes comprise an essential source of cognitive demands in learning situations. To shed light on related mechanisms and influencing factors, this study applied a continuous multi-measure approach for cognitive load assessment. In a dual-task setting, a sample of 123 student participants learned visually presented symbol combinations with one of two levels of complexity while memorizing auditorily presented number sequences. Learners’ cognitive load during the learning task was addressed by secondary task performance, prosodic speech parameters (pauses, articulation rate), and physiological markers (heart rate, skin conductance response). While results revealed increasing primary and secondary task performance over the trials, decreases in speech and physiological parameters indicated a reduction in the overall level of cognitive load with task progression. In addition, the robustness of the acquired schemata was confirmed by a transfer task that required participants to apply the obtained symbol combinations. Taken together, the observed pattern of evidence supports the idea of a logarithmically decreasing progression of cognitive load with increasing schema acquisition, and further hints on robust and stable transfer performance, even under enhanced transfer demands. Finally, theoretical and practical consequences consider evidence on desirable difficulties in learning as well as the potential of multimodal cognitive load detection in learning applications.