Return to search

Performance Variations Across Response Formats on Reading Comprehension Assessments

Findings of recent studies suggest variations in performance across reading comprehension tests may be a product of differences among assessment dimensions (e.g., response format, genre) or child skills (e.g., Francis, Fletcher, Catts, & Tomblin, 2005; Keenan, 2013). The purpose of the current study was to investigate sources of variation in reading comprehension for three response formats (i.e., open-ended questions, multiple choice, retell) in relation to text genres and child skills. Participants included 79 fourth graders recruited from six classrooms within one elementary school. All participants read six passages (including three narrative and three expository texts) from the Qualitative Reading Inventory-Fifth Edition (QRI-5; Leslie & Caldwell, 2011) and completed a brief comprehension assessment, each of a varying response format. In addition, measures of word reading, linguistic and cognitive skills, and learning strategies were administered to each student across two 60-min testing sessions. Item-response crossed random effects models revealed statistically significant differences between open-ended and multiple-choice questions. Moreover, across the three response formats, five covariates were statistically significant predictors of reading comprehension: (a) genre, (b) listening comprehension, (c) working memory, (d) attention, and (e) word recognition. Further exploratory analyses identified three two-way interactions between: (a) Response Format (i.e., open-ended and multiple-choice questions) × Genre, (b) Response Format × Listening Comprehension, and (c) Response Format × Attention. Results of this study offer evidence to suggest the use of different response formats may lead to variations in student performance across reading comprehension tests. Given these findings, directions for future research and implications for using comprehension tests in research, policy, and practice are discussed.

Identiferoai:union.ndltd.org:VANDERBILT/oai:VANDERBILTETD:etd-03192015-153652
Date02 April 2015
CreatorsCollins, Alyson Alexander
ContributorsDonald L. Compton, Ph.D., Marcia A. Barnes, Ph.D., Douglas Fuchs, Ph.D., Lynn S. Fuchs, Ph.D.
PublisherVANDERBILT
Source SetsVanderbilt University Theses
LanguageEnglish
Detected LanguageEnglish
Typetext
Formatapplication/pdf
Sourcehttp://etd.library.vanderbilt.edu/available/etd-03192015-153652/
Rightsrestrictsix, I hereby certify that, if appropriate, I have obtained and attached hereto a written permission statement from the owner(s) of each third party copyrighted matter to be included in my thesis, dissertation, or project report, allowing distribution as specified below. I certify that the version I submitted is the same as that approved by my advisory committee. I hereby grant to Vanderbilt University or its agents the non-exclusive license to archive and make accessible, under the conditions specified below, my thesis, dissertation, or project report in whole or in part in all forms of media, now or hereafter known. I retain all other ownership rights to the copyright of the thesis, dissertation or project report. I also retain the right to use in future works (such as articles or books) all or part of this thesis, dissertation, or project report.

Page generated in 0.0023 seconds