No description available.

This study examines the effectiveness of traditional admissions criteria, including prior GPA, SAT, GRE, and TOEFL in predicting undergraduate and graduate academic success for American and international students at a large public university in the southwestern United States. Included are the admissions and enrollment data for 25,017 undergraduate American, 509 undergraduate international, 5,421 graduate American, and 1,733 graduate international students enrolled between 2005 to 2009.Person product-moment correlation, multiple regression, and user-determined stepwise regression were applied to the data. Results show high school GPA is the most predictive of first-year college GPA for both undergraduate American and international students. SAT has a medium correlation with first-year college GPA for American students and a large correlation for international students. High school GPA and SAT together explain one fourth of the variance in first-year college GPA for American students and over one half of the variance for international students. TOEFL has a medium correlation with first-year GPA for undergraduate international students but is not a significant predictor of first-year GPA when SAT is included in multiple regression. Unlike the results for undergraduate students, the traditional admissions criteria (undergraduate GPA and GRE) for graduate admissions explain a small portion of variance in first-year graduate GPA. Undergraduate GPA, GRE Verbal, and Quantitative together explain 6.3% of variance in first-year graduate GPA for American students and 3.1% for international students. The GRE Subject Tests are the best predictor of first-year graduate GPA for students who had taken the GRE Subject Tests. TOEFL has a small correlation with first-year graduate GPA for international students, and it is not a significant predictor of graduate GPA when GRE-Verbal is included. These findings have implications for undergraduate and graduate admissions, standardized admissions tests, university curriculum, and students' academic success.

Thesis advisor: Walt Haney / Migration is now a major component of globalization. The combination of better economic opportunities and lower fertility rates in developed nations suggests that the current migratory wave will last for many decades to come (United Nations Population Fund, 2007). In the U.S., immigration over the last thirty years has significantly changed the face of the workforce and the classroom. At the state level, Massachusetts has been one of the top immigrant-receiving states in the Union. Since the 1990's, Massachusetts has been implementing a policy of standardized testing for accountability and graduation. The Massachusetts Comprehensive Assessment System (MCAS) is a set of standardized, norm-referenced tests administered to comply with the test-based accountability provisions of the 1993 No Child Left Behind federal legislation (NCLB). Used today for high-stakes decisions such as NCLB accountability as well as high school graduation requirements, MCAS has raised a number of validity concerns. Differential item functioning analysis, a technique to statistically identify potentially biased in tests, has not been used to challenge the validity of the tests, although it can provide new insights into test bias that were not previously available. This dissertation investigates the presence of differential item functioning in MCAS between native students and immigrant students. It identifies one test, the 2008 Grade 3 MCAS Mathematics test, as having a significant number of items exhibiting differential functioning and compares the original test version to a purified test version with these items removed. The purified test version results in larger test score improvements for immigrants as well as other non-mainstream students. These alternative test scores are sufficiently large to affect the determination of NCLB-based performance status for many schools and districts that are comparatively poorer and more diverse than the average. While the lack of more precise data on immigrants and other characteristics of the data set reduce the definiteness of the results, there is ample cause for concern about the presence of differential item functioning-based bias on MCAS and the need to further study this phenomenon as NCLB-based accountability determinations impact a growing number of schools, districts and communities. / Thesis (EdD) — Boston College, 2011. / Submitted to: Boston College. Lynch School of Education. / Discipline: Educational Research, Measurement, and Evaluation.

Few constituencies exist where it is more important to produce information literate individuals than teacher candidates, yet rarely is it suggested that practitioners entering the field are adequately prepared to teach and model information literacy to their students. As a result, information literacy has been established as a key outcome by a number of teacher education accrediting bodies and professional associations. Corollary to this initiative is the effort to develop valid instruments that assess information literacy skills. Yet, at the time of this dissertation, no rigorously reviewed instruments were uncovered that measure the information literacy skills levels of teacher candidates. The study describes the development and validation of the Beile Test of Information Literacy for Education (B-TILED). Funded in part by the Institute for Library and Information Literacy Education and the Institute of Museum and Library Services, the study is part of a national initiative spear-headed by the Project for the Standardized Assessment of Information Literacy Skills (SAILS). Test content is based on nationally recognized standards from the International Society for Technology in Education and the Association of College and Research Libraries. Procedures designed to enhance the scale's validity were woven throughout its development. 172 teacher education students at a large, metropolitan university completed a protocol consisting of 22 test items and 13 demographic and self-percept items. This instrument can be used to inform curricular and instructional decisions and to provide evidence of institutional effectiveness for program reviews.

There is an abundance of literature that focuses on the standardized test score difference between minority and non-minority students. Within this literature, socio-economic factors, parental influences, and school-level resources have been used to explain the difference in test scores. The purpose of this study is to identify the variables that are thought to significantly influence test score achievement. The data come from the Florida Department of Education and the US Census. Linear regression analyses results are used to examine the relationship between the independent and the dependent variables. The results showed that overall economic factors are more closely related to FCAT scores than race. More specifically, the percent of students receiving free lunch was negatively correlated with FCAT scores.

Today's focus on high-stakes standardized tests has had a massive impact on education throughout America, and standardized test preparation is one of the ugly, open secrets of education. Ever since 2001 when President Bush signed into law No Child Left Behind (NCLB), a bipartisan reauthorization of Johnson's landmark Elementary and Secondary Education Act of 1965, students have been bombarded with standardized tests from the earliest grades. Politicians believe these measures are the only way to remedy the perceived weaknesses in the education system because "stringent accountability mandates… [provide] vital levers of change, inclusiveness, and transparency of results" (Education Week, 2011, para. 15). Yet as time progresses, the quantity and importance of the exams increase to such proportions that, by the time students are in high school, their performance dictates whether they will graduate or attend college. While proponents of such exams say that they only test the skills that students ought to be learning anyway, the reality tends to be that teachers start to focus only on the specific questions the test will cover, and thereby lose the ability to provide full, comprehensive education. "Teaching to the test" is the much-maligned experience of most high schools. In order to combat the pressure students feel to perform and teachers feel to shortchange the learning experience, a "Build Your Own Adventure" manual designed around research-based principles demonstrated to improve student learning gains will allow students to focus on the key areas needed to improve test performance, demystify the test itself, and thus help students obtain score improvement. In so doing, students will not only perform better on standardized assessments, but ultimately be able to attend more elite colleges.

No description available.

Thesis advisor: Dr. Marilyn Cochran-Smith / A healthy democratic society requires citizens with both the knowledge to understand the problems it faces and the dispositions to solve them. Yet recent studies have shown that citizens in the United States are losing the democratic habits required to solve social problems. Moreover, results on standardized assessments in United States history including the National Assessment of Educational Progress bear out the fact that the historical knowledge of typical American high school graduates is woefully lacking (Gaudelli, 2002; Shenkman, 2008). Some blame teachers for failing to teach students meaningful content, and others counter that students' poor performance signals a problem with the test's construction rather than with teachers. This dissertation was designed to inform the debate through a systematic study of the orientations of history and social studies teachers in Massachusetts, the skills and constructs measured by the MCAS-US history test, and the relationship between the two. This study considered the complex relationship between teachers' orientations and the skills and constructs measured on the MCAS-US test via two research designs. First, a survey of Massachusetts history and social studies teachers was conducted to analyze the orientations from which teachers approach the subject. Second, a content analysis of the MCAS-US test was conducted to identify the skills and constructs assessed on the test. Both the survey and the content analysis were carried out through the theoretical lens of democratic pragmatism, and both employed the same framework for understanding the varied ways that history and social studies is taught. Findings point to a very clear misalignment between orientations of history and social studies teachers and the skills and constructs measured by the MCAS-US test. This conjures up an image of a three-legged race where the two participants appear to work against one another. The dissertation concludes with a discussion of the implications of the study, including ways that test developers and history and social studies teachers can make progress toward the shared goal of improving civic knowledge and participation. / Thesis (PhD) — Boston College, 2010. / Submitted to: Boston College. Lynch School of Education. / Discipline: Teacher Education, Special Education, Curriculum and Instruction.

L'évaluation d'un objet est intrinsèquement liée à la définition que l'on pose de celui-ci. Si à un certain niveau de généralité, ce qu'est comprendre un texte semble aller de soi, une recension des travaux en psychologie cognitive, du développement, en didactique, en sociolinguistique, montre au contraire le caractère polymorphe de cet objet qu'on peine à définir. Dès lors, comment évaluer ce que l'on peine à circonscrire, même par exclusion ? Toujours dans le but de cerner ce qu'on entend par compréhension, nous avons mené quatre enquêtes. La première repose sur des entretiens avec des enseignants autour d'une épreuve (texte + questions), en vue de décrire leur manière de se représenter la compréhension et ses difficultés. La deuxième, centrée sur l'analyse des questions repose sur la constitution et une première analyse d'un corpus d'environ 200 questions proposées lors d'évaluations nationales sur la compréhension de textes narratifs. Analyser les questions ne pouvant se faire sans prendre en compte l'activité de réponse, nous avons proposé ensuite deux expériences. La première procède d'une sorte de raisonnement par « l'absurde »: peut-on répondre à des questionnaires de compréhension sans le texte y afférant ? La seconde a pour but de cerner les spécificités des épreuves, en proposant aux mêmes élèves quatre tâches (rappel, reconnaissance, jugement d'importance et QCM) sur deux textes différents. Ces analyses convergent pour montrer que chaque tâche donne un portrait différent de la compréhension et que l'on passe parfois rapidement d'une compréhension d'un texte à la compréhension de textes. / The evaluation of an object is intrinsically linked to the way one defines it. In seeking to define narrative texts comprehension, we have educed multiple facets of this process: cognitiv psychology, psychology of development, didactics, sociolinguistics, which each in their way clarifies an aspect of texts comprehension. This being the case, how can an object so polymorphous be evaluated? To properly understand the functioning of MCQs, the most common method for evaluating texts comprehension, we have undertaken four separate investigations. The first was based on interviews with teachers about a given examination (text plus questions), with the aim of being able to formulate how one depicts texts comprehension and its difficulties. The second investigation, centered on the analysis of questions, was based on the constitution of a corpus of about 200 questions used in nationwide tests of narrative texts comprehension , and a first-level analysis. Analyzing questions necessitates taking into consideration the activity of replying to questions, so we developed two further experiments. The first proceeded from a sort of "reasoning by the absurd": can one reply to questions without cognizance of the corresponding text? The second aimed to identify the specificities of tests, by proposing to the same students four tasks (recall, recognition, relative importance judgments and QMCs) for two different texts. These analyses converge to demonstrate that each kind of task generates a specific profile view of texts comprehension, and that sometimes one passes rapidly from the comprehension of a given text to the general texts comprehension reading competencies.

Policy guidelines of the Education Quality and Accountability Office (EQAO) state that accommodations and participation decisions on the Ontario Secondary School Literacy Test (OSSLT) do not threaten validity. However, these issues are contentious in American large-scale testing. New approaches integrate test access, administration, accommodation and participation within a unified fairness and validity construct. The current study, based on demographic and outcome data for the entire population of OSSLT-eligible students from 2006 to 2009, demonstrates changing patterns in accommodations and participation decisions across schools and years. In particular, English language learners are found to be considerably underrepresented among students receiving special needs accommodations. This has implications for the valid interpretation and fair use of test scores. Recommendations are proposed for improving fairness, consistency, and validity in administering accommodations and participation.