This study is aimed to unpack the ‘black box’ that connects the grade-3 test-based retention policy with students’ academic outcomes. I theorized that the policy effects on teaching and learning may be modified by instructional capacity, but are unlikely to occur through enhancing teachers’ capability to teach. Analyzing the Early Childhood Longitudinal Study Kindergarten cohort (ECLS-K) dataset, I first explored the relationship between the test-based retention policy and instructional capacity as indicated by teacher expectations of students’ learning capability and then investigated whether and how the expectations moderated the policy effects on instructional time reallocation, student academic performance, and student self-perceived academic competence and interests. To remove the selection bias associated with the non-experimental data, I applied a novel propensity score-based causal inference method, the marginal mean weighting through stratification (MMW-S) method and extended it to a causal analysis that approximates a randomization of schools to the test-based retention policy followed by a randomization of classes to teachers with different levels of expectations. Consistent with my theory, I found that the test-based retention policy had no effects on teacher expectations. Although the policy uniformly increased the time allocated to math instruction, it produced no significant changes in students’ overall performance and overall self-perception in math. In addition, I found that students responded differently to the test-based retention policy depending on the expectations they received from the grade-3 teachers. The results suggested some benefits of positive expectations over negative and indifferent expectations in moderating the policy effects, including more access to advanced content, higher learning gains of average-ability students, and more resilient student learning over a long term. However, the results also showed that having positive expectations alone is not sufficient for academic improvement under the high-stakes policy. If implemented by a positive-expectation teacher, the policy could be detrimental to students’ learning in the nontested subject or to their learning of basic reading/math skills. It would as well place the bottom-ability students at a disadvantage. The findings have significant implications for the ongoing high-stakes testing debate, for school improvement under the current accountability reform, and for research of teacher effectiveness.
| Identifer | oai:union.ndltd.org:TORONTO/oai:tspace.library.utoronto.ca:1807/32737 |
| Date | 21 August 2012 |
| Creators | Hong, Yihua |
| Contributors | Hong, Guanglei |
| Source Sets | University of Toronto |
| Language | en_ca |
| Detected Language | English |
| Type | Thesis |
Page generated in 0.0019 seconds