The current study investigated the reliability and validity of using short observations with an observation tool designed to measure implementation of small group interventions. Intervention lessons for eight instructional groups from two schools were video recorded for nine weeks, and post-test assessments of reading decoding were administered to 31 at-risk kindergarten students. Videos of intervention instruction from weeks two, five, and eight, each representing a phase in the intervention period, were used within this study for measuring implementation. Each video was divided into three ten-minute segments representing the beginning, middle, and end of each intervention lesson. Video segments were coded for implementation using the Quality of Intervention Delivery and Receipt tool (QIDR; Harn, Forbes-Spear, Fritz, & Berg, 2012). Overall, the results of this study indicate that a) reliability can be achieved when using 10-minute observations, b) QIDR scores obtained from 10-minute segments are strongly correlated with scores obtained from full-length observations, c) there is no statistical difference in scores obtained from full-length observations and those obtained in 10-minute segments, and d) QIDR scores obtained from both full-length and 10-minute segments accounted for group differences in student outcomes, with lesson segments obtained from the end of lessons accounting for the most variance. Implications for research and practice are discussed, including the importance of thorough training and calibration to maintain reliability, as well as the feasibility and utility of providing frequent observation and feedback through shorter observations.
| Identifer | oai:union.ndltd.org:uoregon.edu/oai:scholarsbank.uoregon.edu:1794/20698 |
| Date | 21 November 2016 |
| Creators | Fritz, Ronda |
| Contributors | Harn, Beth |
| Publisher | University of Oregon |
| Source Sets | University of Oregon |
| Language | en_US |
| Detected Language | English |
| Type | Electronic Thesis or Dissertation |
| Rights | All Rights Reserved. |
Page generated in 0.0017 seconds