Back to search

University of San Francisco

Measuring Cogency in Argument in the Seventh-Grade English Classroom

Abstract

dc:description.abstract

Constructing a cogent argument that addresses real-world problems aids students in the development of critical thinking and requires students to present multiple perspectives in a credible manner. Yet, rubrics do not always measure students’ reasoning. The purpose of this study was to create a valid and reliable instrument to measure cogency in argument. I created a Teacher Designed Rubric Measuring Cogency (TDRMC) based on Toulmin’s model of argument for its emphasis on context-specific warrants, and I used Wilson’s framework for assessment to operationalize the construct of cogency. I compared the TDRMC to the current standardized assessment rubric for the Common Core, the Smarter Balanced Assessment Consortium (SBAC). A mixed methods design with a convenience sample of 73 essays from seventh-grade students from a public middle school in northern California addressed three primary questions about the TDRMC: What is the reliability of the TDRMC, and how does it compare to the reliability of the SBAC? Are scores generated from the TDRMC more variable than scores generated from the SBAC? How does the TDRMC correlate to other established measures of writing and academic ability, such as grades, various SBAC scores, and grade point average (GPA), and how do these correlations compare with those of SBAC Writing and established measures of writing and academic ability? Students’ essays were scored by a committee of four middle school English teachers. Both percent agreement and Cronbach’s alpha showed that the TDRMC was more reliable than the SBAC. The TDRMC did not statistically capture more variability than the SBAC; however, visual inspection of the distribution suggests the TDRMC produced more variability in scores. The TDRMC significantly correlated with a range of external measures of academic ability. These correlations were comparable to those between SBAC and the established measures of writing and academic ability. Several nonsignificant trends suggest that the TDRMC was more highly correlated with sixth- and seventh-grade grade point average and SBAC English language arts than the SBAC. Overall results hint that the TDRMC is better at assessing the construct of cogency and is more highly correlated with academic performance measures than the SBAC.

Degree

thesis:*
Name thesis:degree_name
Doctor of Education (Ed.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Learning and Instruction

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Gonzalez-Balsam, Millie
Contributors dc:contributor
  • Nicola McClung
  • Matthew Mitchell
  • Helen Maniates

Subjects

dc:subject × 8

Identifiers

dc:identifier.*
Repository record dc:identifier
https://repository.usfca.edu/diss/436

Chain of custody

source
Harvested from
University of San Francisco
Base URL
repository.usfca.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Gonzalez-Balsam, Millie. Measuring Cogency in Argument in the Seventh-Grade English Classroom. Dissertation thesis, https://repository.usfca.edu/diss/436