This study is aimed to unpack the ‘black box’ that connects the grade-3 test-based retention policy with students’ academic outcomes. I theorized that the policy effects on teaching and learning may be modified by instructional capacity, but are unlikely to occur through enhancing teachers’ capability to teach. Analyzing the Early Childhood Longitudinal Study Kindergarten cohort (ECLS-K) dataset, I first explored the relationship between the test-based retention policy and instructional capacity as indicated by teacher expectations of students’ learning capability and then investigated whether and how the expectations moderated the policy effects on instructional time reallocation, student academic performance, and student self-perceived academic competence and interests. To remove the selection bias associated with the non-experimental data, I applied a novel propensity score-based causal inference method, the marginal mean weighting through stratification (MMW-S) method and extended it to a causal analysis that approximates a randomization of schools to the test-based retention policy followed by a randomization of classes to teachers with different levels of expectations. Consistent with my theory, I found that the test-based retention policy had no effects on teacher expectations. Although the policy uniformly increased the time allocated to math instruction, it produced no significant changes in students’ overall performance and overall self-perception in math. In addition, I found that students responded differently to the test-based retention policy depending on the expectations they received from the grade-3 teachers. The results suggested some benefits of positive expectations over negative and indifferent expectations in moderating the policy effects, including more access to advanced content, higher learning gains of average-ability students, and more resilient student learning over a long term. However, the results also showed that having positive expectations alone is not sufficient for academic improvement under the high-stakes policy. If implemented by a positive-expectation teacher, the policy could be detrimental to students’ learning in the nontested subject or to their learning of basic reading/math skills. It would as well place the bottom-ability students at a disadvantage. The findings have significant implications for the ongoing high-stakes testing debate, for school improvement under the current accountability reform, and for research of teacher effectiveness.

This study is aimed to unpack the ‘black box’ that connects the grade-3 test-based retention policy with students’ academic outcomes. I theorized that the policy effects on teaching and learning may be modified by instructional capacity, but are unlikely to occur through enhancing teachers’ capability to teach. Analyzing the Early Childhood Longitudinal Study Kindergarten cohort (ECLS-K) dataset, I first explored the relationship between the test-based retention policy and instructional capacity as indicated by teacher expectations of students’ learning capability and then investigated whether and how the expectations moderated the policy effects on instructional time reallocation, student academic performance, and student self-perceived academic competence and interests. To remove the selection bias associated with the non-experimental data, I applied a novel propensity score-based causal inference method, the marginal mean weighting through stratification (MMW-S) method and extended it to a causal analysis that approximates a randomization of schools to the test-based retention policy followed by a randomization of classes to teachers with different levels of expectations. Consistent with my theory, I found that the test-based retention policy had no effects on teacher expectations. Although the policy uniformly increased the time allocated to math instruction, it produced no significant changes in students’ overall performance and overall self-perception in math. In addition, I found that students responded differently to the test-based retention policy depending on the expectations they received from the grade-3 teachers. The results suggested some benefits of positive expectations over negative and indifferent expectations in moderating the policy effects, including more access to advanced content, higher learning gains of average-ability students, and more resilient student learning over a long term. However, the results also showed that having positive expectations alone is not sufficient for academic improvement under the high-stakes policy. If implemented by a positive-expectation teacher, the policy could be detrimental to students’ learning in the nontested subject or to their learning of basic reading/math skills. It would as well place the bottom-ability students at a disadvantage. The findings have significant implications for the ongoing high-stakes testing debate, for school improvement under the current accountability reform, and for research of teacher effectiveness.

A study was undertaken to explore what constitutes instructional capacity in the teaching and learning of mathematics (TLM), with a focus on how schools (as institutions of teaching and learning) integrate resources for a particular configuration of capacity to promote high achievement levels of Grade 12 students in mathematics. Data were collected in ten public secondary schools, mostly in a disadvantaged context, in the Vhembe District in Limpopo Province, South Africa. The study explores strategies for constructing, organising and replenishing instructional capacity in TLM. Five low- and five high-performing schools were selected, based on the pass rate in mathematics in high stakes examinations. The researcher observed lessons and interviewed ten Grade 12 mathematics teachers, ten principals, five curriculum advisors and a sample of forty Grade 12 mathematics students. The research revealed that the capacity to encourage the new curriculum reform practices in TLM within different schools is often inadequate, and largely fails to compensate for organisational effects and arrangements that shape the capacity to create quality instruction in mathematics. However, high-performing schools were somewhat ahead of low-performing schools in terms of encouraging reform-oriented teaching and learning in mathematics. Recommendations include: Principals should initiate the development and implementation of a school-based clinical supervision programme through collaborative decision-making to promote a sense of ownership by all mathematics teachers. Such a supervision programme would enhance commitment and ensure that all efforts are unified towards improving the quality of TLM. There is a need for the DoE in Limpopo Province to coordinate teacher professional development workshops, where effective practising mathematics teachers model how they teach mathematics in the classroom, while other teachers observe. Context-based strategies to enhance student outcomes in mathematics should be devised, such as modelling good practice by effective teachers in terms of: lesson preparation; subject knowledge; pedagogic approach; assessment and monitoring of classroom practice, including direct observation of teaching by HoDs and principals. It is proposed that attention to these issues, amongst others, would limit the impact of an unpromising context on student achievement levels in mathematics in high stakes examinations in the Vhembe District and elsewhere. / Mathematics Education / D. Phil. (Mathematics, Science and Technology Education)

A study was undertaken to explore what constitutes instructional capacity in the teaching and learning of mathematics (TLM), with a focus on how schools (as institutions of teaching and learning) integrate resources for a particular configuration of capacity to promote high achievement levels of Grade 12 students in mathematics. Data were collected in ten public secondary schools, mostly in a disadvantaged context, in the Vhembe District in Limpopo Province, South Africa. The study explores strategies for constructing, organising and replenishing instructional capacity in TLM. Five low- and five high-performing schools were selected, based on the pass rate in mathematics in high stakes examinations. The researcher observed lessons and interviewed ten Grade 12 mathematics teachers, ten principals, five curriculum advisors and a sample of forty Grade 12 mathematics students. The research revealed that the capacity to encourage the new curriculum reform practices in TLM within different schools is often inadequate, and largely fails to compensate for organisational effects and arrangements that shape the capacity to create quality instruction in mathematics. However, high-performing schools were somewhat ahead of low-performing schools in terms of encouraging reform-oriented teaching and learning in mathematics. Recommendations include: Principals should initiate the development and implementation of a school-based clinical supervision programme through collaborative decision-making to promote a sense of ownership by all mathematics teachers. Such a supervision programme would enhance commitment and ensure that all efforts are unified towards improving the quality of TLM. There is a need for the DoE in Limpopo Province to coordinate teacher professional development workshops, where effective practising mathematics teachers model how they teach mathematics in the classroom, while other teachers observe. Context-based strategies to enhance student outcomes in mathematics should be devised, such as modelling good practice by effective teachers in terms of: lesson preparation; subject knowledge; pedagogic approach; assessment and monitoring of classroom practice, including direct observation of teaching by HoDs and principals. It is proposed that attention to these issues, amongst others, would limit the impact of an unpromising context on student achievement levels in mathematics in high stakes examinations in the Vhembe District and elsewhere. / Mathematics Education / D. Phil. (Mathematics, Science and Technology Education)