Back to search

University of North Texas

Mixed Development and Validation of an Authentic Assessment for Middle School Mathematics

Abstract

dc:description

In response to concerns about using only standardized multiple-choice assessments, some school districts have moved to using alternative ratings of student achievement with authentic assessments. However, such assessments are often limited in terms of the psychometric validity data supporting their use. The present study mixed quantitative and qualitative methods to examine the validity, development, and refinement of an authentic rating approach currently in use in middle school mathematics classes from a large suburban school district in the Southwest United States. A sample of teachers (n = 14), rated students (n = 110) using a pilot rubric of 187 items. Analyses resulted in a 32-item rubric with 20 themes and 9 factors. Results from a G-study revealed the facet that best explained variance in student scores was the interaction between raters and assessment units, as well as students and assessment units. As part of the development of the assessment, a content validity exercise revealed 18% of the rubric items as below average quality. Findings highlight the need to enhance contextualization of rubrics, use a strategy of assessment that includes contextualized and decontextualized assessment, and to investigate the role of utilization deficiency in explaining low student scores.

Degree

thesis:*
Grantor dc:publisher
University of North Texas
Year dc:date
2020

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Raadt, Jay Schyler
Contributors dc:contributor
  • Hull, Darrell
  • Combes, Bertina
  • Tashakkori, Abbas
  • Middlemiss, Wendy

Subjects

dc:subject × 8

Rights

dc:rights
Statement dc:rights
  • Public
  • Raadt, Jay Schyler
  • Copyright
  • Copyright is held by the author, unless otherwise noted. All rights Reserved.
Language dc:language
English

Identifiers

dc:identifier.*
Identifier
local-cont-no: submission_2161
https://digital.library.unt.edu/ark:/67531/metadc1707388/
ark: ark:/67531/metadc1707388

Chain of custody

source
Harvested from
University of North Texas
Base URL
digital.library.unt.edu/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Raadt, Jay Schyler. Mixed Development and Validation of an Authentic Assessment for Middle School Mathematics. University of North Texas, 2020. https://doi.org/10.12794/metadc1707388