A school district in Utah implemented an instructional coaching program intended to increase student achievement in reading and mathematics. Program administrators wished to determine the degree to which certain elements of instructional coaching (time, activities, context, and content) affected student achievement. Student achievement data were collected using state reading and math assessments; coaching data were collected using coaching time logs; other data were obtained from the district.
Data were analyzed to determine which predictors could appropriately be included in a hierarchical linear model (HLM) predicting student achievement. A threelevel fully unconditional model was applied to determine the relative effect of grouped factors at the student, class, and school levels. Approximately 90% of the total variance in student achievement (both explained and unexplained by the model) was observed at the student level. Unconditional growth models were constructed to determine whether student-level factors varied significantly across classes and whether class-level factors varied significantly across schools. Each identified factor was included (as random or fixed) in one of eight explanatory HLMs to measure the effect of specific coaching factors on predicted student achievement. Noncoaching factors were included in the models to reduce extraneous variance and strengthen the models’ ability to describe the effect of coaching factors. Inclusion of factors reduced unexplained student-level variance by approximately 45% in the language arts models and 54% in the math models.
There was no evidence that coaching time had a direct effect on student achievement. Some of the coaching activities, contexts, and contents did affect predicted achievement significantly. This report outlines those observed effects in detail. The most notable finding was that students in classrooms where coaches spend more time conferencing with teachers about student achievement data had higher predicted scores. Due to the nature of the dependent variable (achievement) and inherent methodological challenges associated with measuring the effect of class-level interventions, effect sizes observed in this study were relatively small.
The resulting recommendations for practice were that coaches focus less on the quantity of time they spend with teachers and more on selecting activities, context, and content that are likely to yield the greatest results.
| Identifer | oai:union.ndltd.org:UTAHS/oai:digitalcommons.usu.edu:etd-2168 |
| Date | 01 May 2012 |
| Creators | Toone, Logan Thomas |
| Publisher | DigitalCommons@USU |
| Source Sets | Utah State University |
| Detected Language | English |
| Type | text |
| Format | application/pdf |
| Source | All Graduate Theses and Dissertations |
| Rights | Copyright for this work is held by the author. Transmission or reproduction of materials protected by copyright beyond that allowed by fair use requires the written permission of the copyright owners. Works not in the public domain cannot be commercially exploited without permission of the copyright owner. Responsibility for any use rests exclusively with the user. For more information contact Andrew Wesolek (andrew.wesolek@usu.edu). |
Page generated in 0.0021 seconds