Back to search

Virginia Commonwealth University

Teachers' Perceptions of the Broad Validity of a High Stakes English Language Proficiency Test

Abstract

dc:description.abstract

The No Child Left Behind Act of 2001 mandated that the English acquisition of all students identified as English learners be assessed annually using high-stakes standardized English language proficiency tests, and the Every Student Succeeds Act of 2015 continues this testing mandate. The WIDA ACCESS for ELLs® has been used for this and other purposes since 2005, and has been adopted by 40 State Education Agencies, including the Virginia Department of Education. However, despite the long-standing and widespread use of this assessment, no comprehensive independent evaluations of the test have been conducted. This mixed-methods study is a conceptual replication of a previous study evaluating the validity of a similar high-stakes standardized English language proficiency test. Using a Broad Validity Framework that considered the test’s reliability, criterion validity, and consequential validity, the study surveyed and interviewed Virginia teachers of English as a second language on their perspectives on the test. Findings suggest that while some teachers believe some sort of test is warranted for accountability and informing decisions, there are many threats to the validity of decisions based on test scores, including potential sources of construct-irrelevant variance, issues with technology associated with the online version of the test, the lapse of time between test administration and the receipt of scores, and questions regarding student motivation and test-taking effort. Furthermore, the study suggests the test has unintended consequences, including negative emotional impacts for teachers and students and a loss of instructional time. Because of questions raised regarding the reliability and validity of the test, study findings suggest the use of multiple measures in high-stakes decision-making for English learners. Furthermore, findings affirm the value of a consideration of teacher input in test evaluations.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Education

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Waters, Carolyn N.
  • <p><a href="https://orcid.org/0000-0003-4880-7922">0000-0003-4880-7922</a></p>
Contributors dc:contributor
  • Valerie J. Robnolt, Ph.D.
  • Jesse Senechal, Ph.D.
  • Hillary Parkhouse, Ph.D.
  • Laura Kuti, Ph.D.

Subjects

dc:subject × 3

Rights

dc:rights
Statement dc:rights
  • © The Author

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Virginia Commonwealth University
Base URL
scholarscompass.vcu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Waters, Carolyn N.; <p><a href="https://orcid.org/0000-0003-4880-7922">0000-0003-4880-7922</a></p>. Teachers' Perceptions of the Broad Validity of a High Stakes English Language Proficiency Test. Dissertation thesis, https://doi.org/10.25772/S2G6-Q709