In the current era of high stakes testing, educators use curriculum-based measures (CBMs) and large-scale benchmark assessments to inform instruction and monitor student performance. The Elementary and Secondary Education Act, The No Child Left Behind Act, and Race to the Top all require annual testing in grades 3 through 8 in mathematics and reading. Therefore, educators need appropriate assessments to make valid inferences about instruction and students' current level of performance as well as risk. Consequently, construct validity is essential for both CBMs and large-scale tests to ensure they appropriately identify students' current level of performance in reading and math, particularly in making inferences about proficiency (Adequate Yearly Progress). This study of third grade students explored the construct validity of a state math test by correlating it with both math and reading CBMs and determining the sensitivity and specificity of the CBM in predicting performance on the state test. Results indicated a positive correlation and predictive relation between both CBM math and reading with the Oregon statewide benchmark assessment in mathematics at third grade. Regression analysis showed the strength of the predictive relation of CBM in the identification of students' current level of performance increased with the addition of CBM reading to the CBM math. A receiver operator characteristics analysis indicated that CBM math and CBM reading (passage reading fluency and vocabulary) consistently predicted students who were on target to meet grade-level benchmarks on the statewide assessment. The study adds to the construct validity research on math and reading CBMs. The results may inform assessment development and accommodations needed to assess math content without the reading construct interfering with the interpretation of the results. In addition, it may be useful for educators seeking to identify students who are "at risk" for making grade level progress in mathematics.

Purpose: The purpose of this study was to examine the concurrent and predictive validity of the CUBED Narrative Language Measures Listening and Reading subtests to evaluate their psychometric properties as defined by Deno (2003). Method: Evidence of concurrent validity for the NLM Listening and Reading subtests was examined using data from 1,146 preschool through third grade students. The NLM subtests were compared to similar subtests from other assessments administered at approximately the same time. Evidence of predictive validity was examined using data from these same NLM subtests from 1,512 kindergarten through third grade students, including 71 third grade students for the examination of sensitivity and specificity. This was accomplished by examining how the students' NLM assessment scores related to their future performance on tests measuring similar constructs. Sensitivity and specificity were determined by examining how the well the NLM subtests identified students performing at or below grade level according to state proficiency tests. Measures used to determine concurrent and predictive validity included the following: curriculum-based assessment for writing, narrative language sample, expository language, Clinical Evaluation of Language Fundamentals 2 (CELF-P 2), Renfrew Bus Story, Measures of Academic Progress (MAP), and Wyoming Proficiency subtests for Wyoming Students (PAWS). Results: Results indicate that the NLM Listening and NLM Reading had moderate to strong correlations with all criterion measures for concurrent validity. Results also indicated the NLM Listening and NLM reading, separately and combined, accounted for meaningful variance in criterion measures used for predictive validity. Combined, the NLM Listening and Reading had fair to excellent sensitivity and specificity for criterion measures, with 77% sensitivity and 100% specificity for end-of-year state reading assessment performance. This study provides evidence that the NLM Listening and Reading can accurately measure and predict oral language and reading outcomes in students preschool through third grade, indicating it as a useful curriculum-measure as defined by Deno (2003). Future research should examine the extent to which the entire CUBED assessment, including the decoding and dynamic assessment subtests, have concurrent and predictive evidence of validity.

Early identification practices in assessment are crucial to preventing academic failure as well as identifying students at-risk for later learning disabilities. The PAM Early Numeracy Screening is a set of subscales designed to measure early numeracy in kindergarten students in a group setting. Given that the existing early numeracy measures are individually administered, the purpose of the current study was to explore the psychometric properties of the PAM Early Numeracy Screening. Correlational analysis was the primary research design used to investigate the evidence of reliability, criterion-related validity, and construct validity of the PAM Early Numeracy Screening. Criterion measures included the KeyMath-3 Diagnostic Assessment, Metropolitan Achievement Tests, Eighth Edition, Early Math Measures Study Teacher Rating of Students’ Math Proficiency, and the Early Numeracy Indicators. The sample consisted of 97 kindergarten students from a school district in the Greater New Orleans Metropolitan Area. Results support the PAM Early Numeracy Screening as a promising group administered measure of early numeracy in kindergarten. Implications for future research include investigating the internal structure of the subscales and exploring evidence of predictive validity of the subscales, specifically the Quantity Discrimination subscale to independently predict later math achievement.

Piecewise latent class growth analysis (LCGA) was used to examine growth patterns in reading comprehension and passage reading fluency on easyCBM, a popular formative assessment system. Unlike conventional growth modeling, LCGA takes into account the heterogeneity of growth and may provide reliable predictions for later development. Because current methods for classifying students are still questionable, this modeling technique could be a viable alternative classification method to identifying students at risk for reading difficulty. Results from this study suggested heterogeneity in reading development. The latent classes and growth trajectories from the LCGA models were found to align closely with easyCBM's risk rating system. However, results from one school district did not fully generalize across another. The implications for future research on examining growth in reading are discussed.

Writing assessments have taken two primary forms in the past two decades: direct and indirect. Irrespective of type, either form needs to be anchored to making decisions in the classroom and predicting performance on high-stakes tests, particularly in a high-stakes environment with serious consequences. In this study, 11th-grade students were given a classroom assessment in which they had 1 minute to think and 3 minutes to write. Student work was scored for correct word sequence (CWS), total words written (TWW), and correct minus incorrect word sequence (CIWS). Students were also given a high-stakes state test to determine eligibility for graduation. This study focuses on the relation between performance on the classroom assessment and the state tests, with comparisons made between the performance of students receiving special education services (SPED) and students in general education. In an age of accountability, test validity has become an increasingly complicated topic. The social consequences of assessments impact students and their educational experience.

This study examined the effect of a parent-implemented reading intervention on children's reading fluency. Five elementary school students identified as at-risk for reading failure participated in the study with their mothers. Baseline data for each student was collected before parents were trained by the researcher in implementation of the intervention procedure. Parents implemented the intervention four times per week for five weeks, while the researcher continued to collect assessment data twice per week. Follow-up data were then collected for each student two weeks after the intervention ended. The effects of the intervention were evaluated using a multiple baseline across participants design. Reading fluency was measured using Curriculum-Based Measurement of reading fluency (CBM-R) Results showed that three students had decreasing trends during baseline, but showed increases in reading fluency scores during the intervention and follow-up phases. A fourth student's scores during intervention and follow-up showed improvement over baseline scores, but with decreasing trends. The fifth student showed little change between baseline and intervention phases. Treatment integrity and social validity data also were collected. Integrity data indicated some variability in parents' implementation of the intervention, while social validity data revealed that parents and students liked the intervention program and found it helpful.

abstract: The No Child Left Behind Act of 2001 has had significant ramifications across public education. Due to reporting mandates, schools and districts are being held publicly accountable for the academic performance and progress of all students. Since implementation of the law, much attention has been focused on the "achievement gap," that is, any differences in performance between groups of students. Students associated with the achievement gap typically come from certain demographics: minorities, low-income families, students with disabilities, and students with limited English proficiency (English Language Learners). The purpose of this study was to examine the effect of using curriculum-based measures (CBMs) on math achievement, particularly ELL students. Eight elementary schools in northwestern New Mexico, divided into two groups (control and experimental) of four schools each, used the same state-approved, core math curriculum, were compared using a quasi-experimental research design. In addition to the regular core curricular materials, the experimental schools were provided with weekly CBMs, containing sample questions developed from the state's performance standards. Each weekly CBM included at least one question from each of the five broad math strands: number and operations, algebra, geometry, measurement, and data and probability. Fourth (N = 283) and fifth grade (N = 294) students who had continuous enrollment for the duration of the experiment served as subjects. Successive regular administrations of the New Mexico Standards Based Assessment math subtest served as the pre- and posttest measures. Analysis of covariance tests, with the pretest as the covariate, revealed no significant treatment effects for either the fourth or fifth grade students through the use of CBMs as a supplement to the core math curriculum. The significant effects, supported by previous research, were the school and, especially, the teacher for both grades. In this study, the effects of the classroom teacher were of more importance to student achievement than either the school a child attended or what curriculum program or process a given school employed. / Dissertation/Thesis / Ed.D. Educational Administration and Supervision 2011

xiii, 92 p. : ill. A print copy of this thesis is available through the UO Libraries. Search the library catalog for the location and call number. / In recent years, state and national policy created the need for higher accountability standards for student academic performance. This increased accountability creates an imperative to have a formative assessment system reflecting validity in inferences about the effectiveness of instruction and performance on statewide large-scale assessments. Curriculum-based measurement (CBM) satisfies both functions. However, research shows the predictive power of oral passage reading fluency (PRF) diminishes in middle and high school. Because of the decreased predictive validity of PRF in the upper grade levels, additional reading CBMs should be explored. This study compares PRF and Vocabulary CBM data for all sixth grade students in a school district using two statistical procedures: correlation and regression. The correlation coefficients were moderately high among PRF, Vocabulary CBM, and the Reading test in Oregon Assessment of Knowledge and Skills (OAKS). A regression analysis indicated that the Vocabulary CBM explained more variance than PRF in predicting reading performance on OAKS. A second multiple regression analysis introduced three non-performance indicators (Gender, Attendance, and NCLB At-Risk), along with the two CBMs (Vocabulary and PRF). The second regression results revealed that Vocabulary again was more predictive than PRF, Gender, Attendance, or NCLB At-Risk. At-Risk status was the only non-performance indicator that was significant. All the findings have been discussed within the context of understanding reading skills using CBMs and their relation to performance on a large-scale test used for accountability. The findings have been framed as part of an information system that allows schools and districts to better tailor staffing, instruction, and schedules to student needs. Suggestions for future research also have been discussed, particularly in enhancing the predictions on large-scale test outcomes using a variety of CBMs. / Committee in charge: Gerald Tindal, Chairperson, Educational Methodology, Policy, and Leadership; Paul Yovanoff, Member, Educational Methodology, Policy, and Leadership; Keith Hollenbeck, Member, Educational Methodology, Policy, and Leadership; Jean Stockard, Outside Member, Planning Public Policy & Mgmt

The purpose of this study was to analyze the relationship between oral reading fluency (ORF) and Maze, two common Curriculum-Based Measures (CBMs), and the statewide large-scale assessment of reading in Oregon, the Oregon Assessment of Knowledge and Skills- Reading (OAKS-R). A sample of three cohorts of eighth-grade students in an Oregon school district was used to examine concurrent validity, predictive validity, and the relation between demographic characteristics, disability status, and socio-economic status and the ability to predict performance on the OAKS-R. Findings of the concurrent validity analysis revealed a moderately strong positive correlation between the OAKS-R and both ORF and Maze measures, with ORF demonstrating a slightly stronger correlation with the OAKS-R. Multiple regression analyses were used to analyze the predictive relationship between ORF and Maze and scores on the eighth-grade OAKS-R. Both ORF and Maze were statistically significant predictors of OAKS-R, demonstrating moderately positive relationships with scores on the state reading test. Although no interaction effect was found between disability classification or eligibility for free or reduced-price meals and the different CBMs, in relation to the OAKS-R, student disability status was negatively related to performance on the OAKS-R. The relationship between OAKS-R performance and low socio-economic status, as measured by eligibility for free or reduced-price lunch status, was not consistent across the cohorts. This finding is promising, as it indicates that there may be factors that schools can take advantage of to ameliorate the relationship between poverty and reading outcome measures for eighth-grade students. In light of study results, suggestions for future research, as well as implications for the field, are discussed. This study adds to the research literature documenting that ORF and Maze assessments provide schools with valuable information to predict student performance on statewide large-scale assessments of reading. With CBM data available early in the school year, schools can provide additional intervention as needed, potentially leading to improved end-of-year student performance on the OAKS-R.

Educators need clear, actionable data to help them understand students' current levels of performance and students' probable trajectory toward college- and career-readiness in math if they are to make informed programmatic decisions to shape that trajectory. This study explored the relation between CBM-math in Grade 7 as a one-point, teacher accessible measure of student math skill and the students' performance on the Grade 8 EXPLORE-math test, a large-scale achievement test linked to one set of college- and career-readiness benchmarks. Results indicated that a moderate positive correlation and predictive relation exist between CBM-math and EXPLORE-math. Information was disaggregated by gender and for subgroups, including students eligible for special education, free or reduced meals, and English language development services. No difference in means for male and female students on either measure was identified, but eligibility for special education or for free or reduced lunch was associated with lower performance on both measures. Insufficient numbers of ELD students hindered detailed analysis, but none of the ELD students included in the study achieved the EXPLORE benchmark or the CBM normalized cut score based on the 40th percentile. An ROC analysis showed that easyCBM consistently predicted students who did not meet the EXPLORE benchmark, although results indicated that a higher cut score on easyCBM may be a more consistent predictor. The study adds to validity research on CBM and may be useful for educators seeking to identify students at risk of missing achievement benchmarks and make programmatic decisions to ensure students are on track to be college- and career-ready in math.