Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 22 for “"Consequential validity"”.
-
Exploring a Framework for Consequential Validity for Performance-Based Assessments
… framework for understanding elements of validity, specifically for performance assessments that are administered within specific and dynamic contexts. The adoption of edTPA is a good empirical case for examining the concept of consequential validity because this assessment has been …
-
Investigating the Process of Consequential Validity with the Ambassador Questionnaire
Validity in psychometrics refers to the degree to which evidence and theory supports the interpretations drawn from a test, and Messick’s Contemporary Validity Theory (1994) includes several facets with well-established evidence collection methods. However, there is a lack of consensus on …
-
Consequential Validity and Social Studies Education: An Examination of Standards, Assessment Policies, and Teacher Preparation
… of social studies in several unanticipated ways. Consequential validity suggests that assessments should include value implications and relevance (Messick, 1989). While assessment research examines the disciplines of mathematics, science, and language arts in a more holistic manner, the few social …
-
Washback effects of the IELTS test: views and experiences of Chinese students in the context of a Sino-UK joint programme with English as the medium of instruction
… students’ perspectives. I investigated, within a consequential validity framework, how the high-stakes and high predictability aspects of the IELTS test in my research context can shape the washback of the test on students’ learning activities and their affective factors. <br/><br/>This research …
-
Design and Validation of an Evaluation Checklist for Organizational Readiness for Evaluation Capacity Development
… by five experts to obtain face and content validity evidences, with emphasis on relevance and clarity of the items and how well the items fit the corresponding component; (c) a pretesting about the appropriateness of the wording of the items and format of the ORECD checklist by a sample of …
-
The Generalizability of Proposed Theoretical Factor Models for Common Assessments for Specific Learning Disability in Reading Using a Community Sample
… sample include improved ecological and consequential validity (e.g., fewer diagnostic exclusion criteria, regional sampling differences). Additionally, the theoretical factor structure for the WJ-IV-A and WISC-V have been criticized in the literature through secondary analyses on the …
-
Language Ideology in the ACTFL Speaking Proficiency Guidelines
… language ideologies in the guidelines may impact consequential validity. The results from this analysis are a description of language ideologies found in the guidelines, including ideologies about standard language and native speakers. From these findings, I make recommendations for how knowledge …
-
Construct Validation of an Integrated, Process-Oriented, and Computerized English for Academic Purposes (Eap) Placement Test: A Mixed Method Approach
A validity table is presented to summarize the positive and negative attributes of six research questions investigated in this study: predictive validity, convergent and discriminant validity, improved essay quality, consequential validity, test fairness, and authenticity. Arguments in favor of the …
-
CONTENT ISSUES IN CHILD HEALTH STATUS AND QUALITY OF LIFE INSTRUMENTS: ADDRESSING THE CHALLENGES WITH NEW METHODS
… inconsistently and this impacts upon content validity. Additionally, the repercussions of conceptual inconsistencies have an important effect on consequential validity in child health.</p>
-
The development and initial validation of the Daily Experiences of Pleasure, Productivity and Restoration Profile
… (PPR Profile) (Atler, 2008) and reports the validity evidence of the PPR Profile as examined in two studies. Cognitive interviewing was used in the first study to examine validity evidence based on test content, response processes, and the consequences of completing the instrument. The study …
-
Using Universal Screening Measures to Accurately Predict Middle School Students’ Reading Skill Status on a High-stakes State Test: An Investigation of the Psychometric Properties of Vocabulary, Comprehension, and Fluency Measures
… of false negative results and therein improve consequential validity. This study utilized correlational, logistic regression, predicted probabilities and ROC curve analysis toward this end. Findings of this study provide similar psychometric results reported from prior research (Denton et al., …
-
Validating the Canadian Academic English Language Assessment for Diagnostic Purposes From Three Perspectives: Scoring, Teaching, and Learning
… Argument (AUA) makes explicit these internal and consequential validity questions through a two-stage validation argument (Bachman & Palmer, 2010). This research adopted the AUA to examine the appropriateness of the Canadian Academic English Language (CAEL) Assessment for diagnostic purposes, by …
-
Teachers' Perceptions of the Broad Validity of a High Stakes English Language Proficiency Test
… replication of a previous study evaluating the validity of a similar high-stakes standardized English language proficiency test. Using a Broad Validity Framework that considered the test’s reliability, criterion validity, and consequential validity, the study surveyed and interviewed Virginia …
-
Does intercultural sensitivity cross cultures? : an investigation of validity issues involved in porting instruments across languages and cultures
This study examined the validity of data obtained using a Japanese translation of version one of the Intercultural Development Inventory (IDI) (Bennett & Hammer, 1998) and, by extension, some assumptions surrounding the cross-cultural transferability of the Developmental Model of Intercultural …
-
Enhancing Ability Estimation with Test-taking Strategies
… O’Neil, Sugrue & Baker, 1995), and reduce the consequential validity of the ability estimates (McKnight, McKnight, Sidani & Figueredo, 2007). Most large-scale assessment programs measure ability with correct/incorrect scores, but theory and the broader literature on measuring ability indicate …
-
'Backwash' effects of high-stake degree level HE assessment on teaching practices
… and Messick's (1989) conceptualisation of consequential validity, the research critically examined the nature and degree of assessment driven effects on learning and pedagogy. This research challenged claims by scholars such as White (2009) that argue higher education assessments are less …
-
Comparing Validity Evidence of Two ECERS-R Scoring Systems
… therefore, was to compare the differences of validity evidence based on the two scoring systems in the context of a state’s QRIS. Utilizing a state representative early childcare sample collected in 2013-2015, I evaluated the descriptive differences between the two scoring methods and compared …
-
Assessment of student learning in a business internship
… effect on learning, contributing to its consequential validity. Such learning included students' increased awareness of the important competencies required in the workplace and how such competencies contribute to effective performance. In addition, the self-assessed nature of the model …
-
A holistic psychometric analysis of the individual recovery outcomes counter : balancing user needs in the use of personal outcome measures
… to investigate structural, convergent, face and consequential validity, internal consistency and test-retest reliability. A systematic review of nine personal recovery measures was used to set a series of benchmarks against which I.ROC is evaluated.<br/><br/><b>Results</b><br/>I.ROC is consistent …
-
The validity of judgment : can the assessor learn to outperform the equation?
… reveal, time and again, that the predictive validity of information combined in the mind of the assessor ("clinical data combination") is smaller than the predictive validity when the information is combined using an equation or actuarial table ("mechanical data combination"). Therefore, …
Page 1 of 2