Yes / This paper introduces the concept of user validity and provides a new perspective on the validity of interpretations from tests. Test interpretation is based on outputs such as test scores, profiles, reports, spread-sheets of multiple candidates’ scores, etc. The user validity perspective focuses on the interpretations a test user makes given the purpose of the test and the information provided in the test output. This innovative perspective focuses on how user validity can be extended to content, criterion and to some extent construct-related validity. It provides a basis for researching the validity of interpretations and an improved understanding of the appropriateness of different approaches to score interpretation, as well as how to design test outputs and assessments which are pragmatic and optimal.

This work expanded on previous research on school effectiveness by developing and testing hypotheses about the specific relationships between school characteristics---including aggregated student and classroom characteristics---and student academic performance. The work used data from the "Early Childhood Transitions Project," a study of intensive social and educational services in a suburban school system, to identify and test the effect of a limited set of school-level characteristics on test score gains made by individual students on the Metropolitan Achievement Test (MAT) between the second and third grade. The analyses found that there are differences in the size of schools, the percent of low performing students, and the percent of students who are non-English speaking across the schools in the sample. Test score gains are affected by concentrations of these types of students at the schools. Students at schools in this sample with high concentrations of non-English speaking students or high concentrations of Hispanic students achieve lower test score gains than students in other schools. Another "concentration effect" emerged from the analysis of high-performing students in the sample. In particular, female students with high scores on the second grade MAT who are in schools with large concentrations of students who perform poorly on the second grade exam have smaller third grade test score gains than similar students who are in schools without a concentration of low performing students. These results suggest that more attention be paid to the influence that the characteristics of the student population have on the school's ability to implement the curriculum. As a first step, researchers may want to simply document the differences in the educational characteristics of students entering schools. This would provide evidence of the segregation that occurs across schools. Researchers may then want to conceptualize students within schools in terms of their homogeneity on demographic measures and their homogeneity on educational characteristics. This "educational minority or majority" concept may bring researchers closer to understanding the school environment, as it is organized by schools and experienced by children. / Ph. D.

Racial inequality in educational and occupational attainment has been shown to be related to racial inequality in test scores and cognitive skills. Most research and policy attention has been given to the ability of schools to equalize test scores. I argue that a major reason why researchers have been unable to explain why schools have not closed the gap is because by the time children begin school it may be too late. Cognitive skills develop from infancy and as such, it should be unsurprising that by the time children are five years old the differences across groups are firmly established. Thus, this research attempts to uncover where the racial test-score gap begins by examining infants. I perform a series of analyses using ordinary least squares regression (OLS) and structural equation modeling (SEM) using the first wave of the Early Childhood Longitudinal Survey--Birth cohort (ECLS-B). I utilize the mother's race, rather than the child's race, in the analyses because looking at the mother's race makes the most logical sense since the mother's race is more likely than the child's to determine household income, marital status, mother's education, parenting styles, and so on. I demonstrate that there is little to no raw gap in cognitive skills between the infants of White and Black mothers in the United States. However, through SEM I find that when one controls for social, human, and financial capital, and for differences in health and type of childcare, the infants of African American mothers would actually do better than the infants of White mothers because of their precocious motor development. I find no support for genetics and childcare and only limited support for financial and human capital as mediators of the gap. However, there is support for family social capital and low birth weight as key mediators of the small Black-White test score gap in infancy.

The main purpose of this study was to compare the strategies used by Chinese- speaking students when confronted with familiar versus unfamiliar topics in a multiple-choice format reading comprehension test. The focus was on describing what students do when they are taking reading comprehension tests by asking students to verbalize their thoughts. The strategies were further compared with participants' level of familiarity with different reading topics and their reading scores. Twenty Chinese-speaking participants at the University of Iowa performed three tasks: a topical knowledge vocabulary assessment that served as an indicator of each participant's topical knowledge about the four selected content areas in this study (law, business, language teaching, and engineering); two Test of English as a Foreign Language (TOEFL) internet-based test (iBT) practice reading comprehension passages, one with a familiar topic and the other with an unfamiliar topic, and both with retrospective think-aloud protocols; and an interview related to participants' test-taking strategies. Two stages of analysis, qualitative and quantitative, were undertaken in this study. For the qualitative analysis, all verbal reports provided by participants in the think-aloud protocols and the interviews were recorded and transcribed. Six categories of strategies emerged: general approaches to reading the passages, identification of important information by the discourse structure of the passages, vocabulary/sentence-in-context approaches, multiple-choice test-management strategies, test-wiseness, and background knowledge. For the quantitative analysis, an analysis of variance (ANOVA) with repeated measures was completed to determine if there were significant differences based on the frequency of strategy use and level of topic familiarity. The results showed that the types of test-taking strategies adopted by Chinese-speaking graduate students remained similar when they read passages with familiar versus unfamiliar topics. However, participants all reported feeling more relief and more confidence when reading passages related to their background knowledge. The second ANOVA employed a split-plot statistical design to examine whether there were significant differences based on participants' strategy use and their reading scores as measured by the iBT reading comprehension tests. High scorers employed strategies in categories one, two, three, and four significantly more frequently than low scorers. However, low scorers adopted significantly more strategies in category five than high scorers. In category six, high and low scorers seemed to use a similar number of strategies. Findings that emerged from the two perspectives are discussed; implications related to test-taking and reading pedagogy are provided in the conclusion.

No description available.

Pesquisas recentes vêm encontrando que alunos negros têm pior desempenho escolar que alunos brancos em testes cognitivos padronizados. A segregação racial é freqüentemente apontada na literatura internacional como uma das principais responsáveis por essa diferença. Nessa dissertação, foi analisado o efeito da segregação racial escolar no diferencial de proficiência escolar entre alunos brancos e negros do ensino fundamental brasileiro. Nos modelos estimados, mesmo após a utilização de diversos controles, foi encontrada evidência de que onde há maior segregação, os negros tem pior desempenho relativamente aos brancos. / Recent research have found that black students have worse schoolar performance than white students in standardized cognitive tests. Racial segregation is frequently pointed out as one of the main factors behind this scenario in international literature. We have studied the effects of racial seggregation on the black-white grade gap in Brazil. In the estimated models, even after the inclusion of several control variables, we have found that where the racial seggregation is higher, the grade differential is higher against black students.

Pesquisas recentes vêm encontrando que alunos negros têm pior desempenho escolar que alunos brancos em testes cognitivos padronizados. A segregação racial é freqüentemente apontada na literatura internacional como uma das principais responsáveis por essa diferença. Nessa dissertação, foi analisado o efeito da segregação racial escolar no diferencial de proficiência escolar entre alunos brancos e negros do ensino fundamental brasileiro. Nos modelos estimados, mesmo após a utilização de diversos controles, foi encontrada evidência de que onde há maior segregação, os negros tem pior desempenho relativamente aos brancos. / Recent research have found that black students have worse schoolar performance than white students in standardized cognitive tests. Racial segregation is frequently pointed out as one of the main factors behind this scenario in international literature. We have studied the effects of racial seggregation on the black-white grade gap in Brazil. In the estimated models, even after the inclusion of several control variables, we have found that where the racial seggregation is higher, the grade differential is higher against black students.

Twenty percent of the 2013-2014 sophomore class at a Washington high school was failing high-stakes tests, making these students ineligible to graduate. In an attempt to help students identify their academic proficiency with respect to the Common Core Curricular Standards 9 months before the high-stakes exam, the high school recently introduced the adaptive diagnostic software i-Ready. Cognitive learning theories comprised the framework for this study, which posit that learning is dependent on previous knowledge and central to measuring performance levels. The purpose of this quantitative correlational project study was to examine whether 10th grade students' achievement on i-Ready math scores (N = 220) could predict the subsequent high-stakes mathematics scores on the End of Course Exam while controlling for gender, ethnicity, and socioeconomic status. The i-Ready emerged as a statistically significant predictor of the End of Course Exam scores with β = .64 (p < .001), explaining R2 = .43 of the criterion variance. Gender, ethnicity, and socioeconomic status had no significant moderating influence. The project deliverable as a result of this study was a position paper advising the use of the i-Ready as a predictor for the End of Course Exam at the high school under study. The implications for positive social change include allowing educators to use the i-Ready as an early warning system for students in danger of failing high-stakes exams. This study may help identify students at risk of not graduating who could benefit from instructional support.

This dissertation consists of three essays studying the effects of collective household decisions on early childhood development from both empirical and theoretical perspectives. The first chapter outlines the dissertation, by presenting the motivations, methods, conclusions, and policy implications for the entire dissertation. Chapter two examines early childhood development using a collective model with children's cognitive production. We jointly estimate the home input demand with children's cognitive production functions based on a simultaneous equations model. Biases are considered that are caused by the non-random selection of time inputs and possible correlations across inputs and outcomes functions. A direct measure of time inputs relying on children's time diaries from the Child Development Supplement of the Panel Study of Income Dynamics (PSID-CDS) has been constructed. We thereby relax the assumption that there is no difference between parental time spent on children and leisure. Our results show that parental time inputs, especially the active time interacting with children's daily activities, have substantial effects on both children's math and reading test scores. The time inputs vary across parents' age, race, and eduction levels. In chapter three, we conduct a standard Blinder-Oaxaca decomposition to evaluate the role of home inputs in the black-white test score gaps based on the empirical model presented in chapter two. Aside from the finding that children's ability accounts for a large proportion of the differences, we find that home inputs can also explain a significant portion of the gap. When the maternal time is equalized at the average levels of white children, the racial differences in children's reading and math test scores can be closed by approximately 30%-50%. The last chapter extends a collective model with household production to the general equilibrium framework. We concentrate on the impacts of a global bargaining power shift within the household on children's cognitive achievement, especially on those who live with single mothers. The model shows that a global bargaining power change in favor of the female may not necessarily be beneficial to the children living with their single mothers. An increase of female's market equilibrium wage rate as a result of reduced labor supply by married women may induce single mothers to work longer hours, spend less time with children, and compensate them with more monetary investment compared with the case when the equilibrium wage rate stays constant. / Ph. D.

Mixed-format tests containing both multiple-choice (MC) items and constructed-response (CR) items are now widely used in many testing programs. Mixed-format tests often are considered to be superior to tests containing only MC items although the use of multiple item formats leads to measurement challenges in the context of equating conducted under the common-item nonequivalent groups design (CINEG). The purpose of this dissertation was to investigate how various test characteristics and examinee characteristics influence CINEG mixed-format test score equating results. Simulated data were used in this dissertation. Simulees' item responses were generated using items selected from one MC item pool and one CR item pool which were constructed based on the College Board Advanced Placement examinations from various subject areas. Five main factors were investigated in this dissertation, including item-type dimensionality, group ability difference, within group ability difference, length and composition of the common-item set, and format representativeness of the common-item set. In addition, the performance of two equating methods, the presmoothed frequency estimation method (PreSm_FE) and the presmoothed chained equipercentile equating method (PreSm_CE), was compared under various conditions. To evaluate equating results, both conditional statistics and overall summary statistics were considered: absolute bias, standard error of equating, and root mean squared error. The difference that matters (DTM) also was used as a criterion for evaluating whether adequate equating results were obtained. The main findings based on the simulation studies are as follows: (1) For most situations, item-type multidimensionality did not have substantial impact on random error, regardless of the common-item set. However, its influence on bias depended on the composition of common-item sets; (2) Both the group ability difference factor and the within group ability difference factor had no substantial influence on random error. When group ability differences were simulated, the common-item set with more items or more total score points had less equating error. When a within group ability difference existed, conditions in which there was a balance of different item formats in the common-item set displayed more accurate equating results than did unbalanced common-item sets. (3) The relative performance of common-item sets with various lengths and compositions was dependent on the levels of group ability difference, within group ability difference, and test dimensionality. (4) The common-item set containing only MC items performed similarly to the common-item set with both item formats when the test forms were unidimensional and no within group ability difference existed or when groups of examinees did not differ in proficiency. (5) The PreSm_FE method was more sensitive to group ability difference than the PreSm_CE method. When the within group ability difference was non-zero, the relative performance of the two methods depended on the length and composition of the common-item set. The two methods performed almost the same in terms of random error. The studies conducted in this dissertation suggest that when equating multidimensional mixed-format test forms in practice, if groups of examinees differ substantially in overall proficiency, inclusion of both item formats should be considered for the common-item set. When within group ability differences are likely to exist, balancing different item formats in the common-item set appears to be even more important than the use of a larger number of common items for obtaining accurate equating results. Because only simulation studies were conducted in this dissertation, caution should be exercised when generalizing the conclusions to practical situations.