Differential Item functioning is present when examinees of the same ability, but belonging to different groups, have differing probabilities of success on an item. Traditionally, DIF detection procedures have been implemented conditioning on total test score. However, if there are group differences on the abilities underlying test performance, and total score is used as the matching criterion, multidimensional item impact may be incorrectly identified as DIF. This study sought to confirm earlier research which demonstrated that multidimensional item impact may be identified as DIF, and then to determine whether conditioning on multiple ability estimates would improve item classification accuracy. Data were generated to simulate responses for 1000 reference group members and 1000 focal group members to two-dimensional tests. The focal group mean on the second ability was one standard deviation less than the reference group mean. The dimensional structure of the tests, the discrimination of the items, and the correlation between the two abilities were varied. Logistic regression and Mantel-Haenszel DIF analyses were conducted using total score as the matching criterion. As anticipated, substantial numbers of items were identified as DIF. Items were then selected into subtests based on item measurement direction. The logistic regression procedure was re-implemented, with subtest scores substituted for total score. In the majority of the conditions simulated, this change in criterion resulted in substantial reductions in Type I errors. The magnitude of the reductions were related to the dimensional structure of the test, and the discrimination of the items. Finally, DIF analyses of two real data sets were conducted, using the same procedures. For one of the two tests, substituting subtest scores for total score resulted in a reduction in number of items identified as DIF. These results suggest that multidimensionality in a data set may have a significant impact on the results of DIF analyses. If total score is used as the matching criterion very high Type I error rates may be expected under some conditions. By conditioning on subtest scores in lieu of total score in logistic regression analyses it may be possible to substantially reduce the number of Type I errors, at least in some circumstances.

The purpose of this study was to investigate the feasibility of using video as a method of beginner teacher observation. Additionally, this study investigated whether or not trained observers (raters) could reliably score beginner teacher performance videotapes using a four point holistic scoring scale. It was the goal of this study that the beginner teacher performance videotapes assessed holistically would help to narrow the gap that now exists between teacher evaluation and actual classroom teaching. To this end the researcher collected 24 beginner teacher performance videotapes and had twelve elementary school teachers, the raters, score each videotape utilizing a four point holistic scoring scale that was developed for the purposes of this dissertation. In sum, it appears that videotape performance assessment that utilizes a holistic scoring scale is a viable and cost effective method of teacher evaluation. Lastly, it was learned that camera condition was not a significant factor in terms of obtaining consistent scores on the performance videotapes. However, it remains to be seen if this method helps to narrow the gap between actual classroom teaching and teacher evaluation.

<p> This study outlines the development and initial validation of an abbreviated instrument intended to measure motivation for mathematics of university students in developmental algebra courses. I look across many of the predominant theories on motivation with the aim of representing several of these theories as latent constructs in a single instrument that is short enough to be administered in a reasonable amount of time, but inclusive enough that it could incorporate subscales representing multiple distinct latent factors. This study answers a call by researchers expressing a need to investigate relationships between disparate theories on motivation and is a response to recent studies that have used several subscales from many published instruments in whole or in part as lengthy combined instruments to measure motivation across theories. The practice of utilizing many separate instruments to measure across theoretical frameworks may be unwieldy leading to validity concerns based on response processes, and the practice of taking individual items from separate instruments may potentially be incomplete leading to validity concerns based on the internal structure of the instrument and underrepresentation of the intended construct. </p><p> To answer these concerns and develop a tool for future research, I conducted a three phase study. Phase one of this study asked experts in motivation to comment on and pick the best items from a pool of 122 items sourced from several popular previously published instruments that contained factors associated with self-determination, self-efficacy, achievement goals, and expectancy-value. The commentary by experts gave insight into item alignment with theory, and all items with at least 40% endorsement by experts proceeded to phase two. </p><p> In phase two, cognitive interviews of students and instructors provided insight into the cognitive processes employed in responding to the 53 items endorsed in phase one. Two researchers coded these qualitative interview data with a grounded theory approach and quantified the data using intra-respondent matrices. Effect sizes of each code provided evidence of content validity of preferred items, and concerns over social dynamics, misrepresentation of factors associated with poor wording, and the use of words like &ldquo;very much&rdquo; that forced students to quantify their cognitive processes provided evidence against non-preferred items. </p><p> During phase three I administered an instrument containing the surviving 34 items from phase two to 186 participants from twelve developmental algebra courses. Concerns over the broadness of the domain of mathematics led to the removal of self-efficacy and task-value items, and concerns over the abbreviated nature of the instrument led to the removal of items associated with extrinsic motivation. Concerns over the multilevel nature of achievement structured items led to their removal. Thus an exploratory and confirmatory factor analyses of the remaining 16 items representing intrinsic motivation, mastery orientations, performance orientations, and expectancy led to a four factor model that discriminated along theoretical lines and was a good fit for the data. A regression of achievement on the four latent factors from this model revealed expectancy to be the only significant predictor of achievement. With gender included as a moderating variable, performance and expectancy were both significant indicators of achievement for females, but expectancy was the only significant indicator for males. The latent factors from the instrument developed for this study had strong bivariate correlations to subscales from previously published instruments that represented similar constructs. </p><p> Several sources provided evidence of content validity. Qualitative data provided evidence in the form of commentary from experts and cognitive interview data from students and instructors. A structural equation model provided evidence of validity based on relationships to other variables. For this model the dependent variable achievement was regressed upon the latent motivation variables with gender included as a moderating variable. Exploratory and confirmatory factor analyses provided validity evidence based on the internal structure. Validity based on consequences and response processes was controlled by using an anonymous process where participation was blind to instructors and researchers, and the administration of an abbreviated measure in a familiar paper and pencil face-to-face format reduced construct irrelevant variance. </p><p> This process produced a four factor 16 item Motivation for Mathematics Abbreviated Instrument measuring intrinsic motivation, mastery orientation, performance orientation, and expectancy while accumulating validity evidence for three out of five sources of validity. The result of this inquiry was a psychometric instrument that may be used by researchers, practitioners, and grant writers who desire a tool to measure motivation for mathematics across several of the predominant theories on motivation.</p>

<p> Intelligence was defined by early psychometricians as capabilities that could be measured by standardized tests. This definition of intelligence is largely accepted to underlie academic achievement. More recent psychological theory posits a broader definition of human intelligence. The purpose of this study was to investigate the possibility that the historic definition of intelligence could be expanded to include transpersonal capabilities as features of intelligence which contribute to academic achievement. This study utilized a quantitative, descriptive, and correlational method to explore the possibility of relationships between intelligence, as traditionally measured by standardized tests in academic settings, and four other psychological constructs&mdash;multiple intelligences, spiritual intelligence, concept imagery, and empathy. By its nature this type of research is exploratory only and does not reveal causal relationships. One hundred ninety-five English-speaking college undergraduates, 18 to 25 years old, attending university in the United States, were recruited via SurveyMonkey Audience. Data were gathered via Survey Monkey using the following instruments: a demographic questionnaire, the Multiple Intelligence Survey (MIS); The Integrated Spiritual Intelligence Scale (ISIS); the Style of Processing Scale (SOP); and the Toronto Empathy Questionnaire (TEQ). It was hypothesized that higher standardized test scores and GPA would correlate positively with concept imagery (SOP), spiritual intelligence (ISIS), empathy (TEQ), logical-mathematical intelligence (MIS), and linguistic intelligence (MIS). Findings did not support the hypothesized relationships. However, an unpredicted negative correlation, between spiritual intelligence and the ACT and SAT standardized test scores, was found. Further analysis revealed that higher ISIS scores correlated with, and predicted, lower ACT/SAT scores. This research contributes to the limited literature available that investigates the relationship between spiritual intelligence, spiritual beliefs/participation, and academic achievement. Future research is recommended to replicate these findings, and to look for causal and/or directional explanations of the negative correlation between SI and ACT/SAT scores found in this study.</p>

<p> English Language Learners (ELLs) are no longer a part of specific areas of America. They have crossed all classroom boundaries of the United States. This means as ELLs have integrated into the classrooms, educators are becoming versed in methods and strategies to help ELLs learn and achieve proficiency on standardized assessments. The purpose of this study was to determine if ELLs learned enough to be proficient in English to do well on a standardized test as their non-ELL peers. The Missouri Assessment Program (MAP) and the Assessing Comprehension and Communication in English State to State (ACCESS) were the two exams used to compare proficiency results. The MAP is the standardized test given to Missouri students beginning at Grade 3. The ACCESS is a language achievement test developed by the World-Class Instructional Design and Assessment (WIDA) Consortium to track levels of English in students beginning in Kindergarten. Students in Grades 3 through 8 were the focus for this study. The exam results of ELLs who took both the MAP and ACCESS were analyzed and compared to their non-ELL peers. The results showed that ELLs who meet academic proficiency on their ACCESS test also have as much English comprehension to do as well on the MAP as the non-ELLs. All groups of students, Grades 3 through 8, showed that if ELLs have reached a level of bridging, or Level 5, they are capable of working with grade level material in English.</p>

<p> The purpose of this study was to contribute to available literature by ascertaining student perceptions of benefits of student access to technology as correlated to students&rsquo; standardized test scores. Students and teachers were surveyed for perceptions of technology benefits. Survey results were analyzed and Pearson product-moment correlation coefficients were calculated comparing student perceptions to standardized Missouri Assessment Program (MAP) grade-level assessment results. As described in specific detail in this paper, it was found student standardized MAP testing data were positively correlated to the introduction of technology-integrated instruction in the classroom setting. Student perceptions indicated a more positive linear association to the support of technology in the content area of mathematics than communication arts. Teacher perceptions of technology integration into the classroom indicated the influx of technology into classroom instruction benefitted lesson preparation and availability of supporting materials.</p>

<p> The purpose of this study was to determine if positive teacher-to-student relationships impacted student academic performance. This case study involved examination of the results of data collected from 43 students who participated in a mentor adoption program initiated with the intent to enhance positive teacher-to-student relationships for the 2013-2014 school year. Archival data of students who participated in the mentor adoption program were compared to data from a stratified group of students who did not participate in the mentor adoption program. Data from English language arts (ELA) and mathematics (MA) Missouri Assessment Program (MAP) scale scores, attendance rate, and number of discipline referrals were compiled and analyzed using paired-samples t-tests. The results of the study showed students who participated in the mentor adoption program demonstrated a significant increase in MAP ELA scale scores, increase in MAP MA scale scores, and significant decrease in the number of discipline referrals. Students who did not participate in the mentor adoption program showed significant improvement only in MAP MA scale scores. Perceptual interview data were gathered and analyzed from 10 teachers who participated in the mentor adoption program to determine teacher perceptions and feelings about the program. The results indicated teachers believed the mentor adoption program had value and should be continued in Elementary School A. The analysis of these data showed student academic performance was significantly impacted by the use of a mentor adoption program in Elementary School A.</p>

<p> The researcher conducted a statistical examination of a two-year journey through school turnaround to identify factors that had a direct impact on student performance on state exams. Following 31 students through sixth and seventh grades, the researcher collected data in alignment with five target areas for school improvement defined by the state of Missouri: (1) student performance, (2) highly qualified staff, (3) facilities, support and instructional resources, (4) parent and community involvement, and (5) governance and leadership. </p><p> Applying ANOVA and z-tests at a 95% confidence interval, the researcher analyzed the data to examine for statistically significant differences in scores o the Communication Arts and Mathematics MAP exams, levels of reading proficiency, attendance rates, and discipline, year to year. The researcher found significant increases in students&rsquo; Mathematics MAP scores, students&rsquo; reading on grade level, and referrals. </p><p> Using a multiple regression analysis the researcher also analyzed data for relationships between multiple independent variables and students&rsquo; scores on the MAP exams. An examination of the Pearson Product Moment Correlation coefficient provided information as to which variables had significant relationships with the students&rsquo; MAP scores and the coefficient of determination gave indication as to possible percentages of contribution each variable had in the resulting MAP test scores. This study confirmed that student&rsquo;s grade point averages were the only variables that maintained consistent significant relationships to the students&rsquo; scores on both Communication Arts and Mathematics MAP exams during both years of the study. In addition to the consistent contribution of the students GPA to their MAP results, the study also found that in 2012, students&rsquo; enrollment in a reading class significantly contributed to their Communication Arts MAP scores and attendance had a significant relationship to their Mathematics MAP scores. </p><p> The concluding reflections in the study were a result of a detailed examination of the statistical analyses in alignment with current turnaround research. While there is a need for further research in the area of school turnaround, this study contributed to a growing field of literature on effective and ineffective school turnaround practices.</p>

<p> Through empirical research, this dissertation examined whether a substance abuse intervention program implemented at a Midwest university could prove beneficial in addressing the problem of substance abuse on college campuses. Drawing on multiple resources, including Department of Education, psychologists, scholars, and other professional sources, this dissertation provides information on the importance of intervention and behavioral adjustment. This study covered statistical data over a two-year period on an intervention program including measurements such as: grade point average, attendance, number of months in the program, and degree persistence. A second area of research was directed at determining the effect of the intervention program regarding retention. The methodology used in this study was mixed and included examination of program implementation, through use of qualitative and statistical data. It concluded, based on research and final statistics, that participating in a substance abuse intervention program not only increased the potential for student success and behavioral change, but slightly improved the percentage of retention and graduation persistence. It also identified the need for further study based on availability of resources needed to maintain and sustain a viable program. </p><p> Implementation of the intervention program took place during the study. Therefore, adjustments in procedures were made based on feedback received and data gathered. The process for collection of samples was changed to provide secure handling of the sample and subsequent valid test results. Also, as a result of researching discipline measures for substance abuse at universities within the same sports conference, consequences for NCAA athletes changed from suspension from competition for a year to removal from competition until a clean drug screen was provided. </p><p> Studies in the future should include following students who left school prior to graduating to determine the mortality rate of persistence to degree among program participants. Conducting a survey with the fall semester incoming freshmen class would improve study design and provide a better picture of the extent of substance abuse, rather than surveying the spring semester after many freshmen have lived on campus for half of the academic year.</p>

abstract: The five-factor model of personality is a conceptual model for describing personality, and represents five traits which are theorized to interact with each other to form personality. The Big Five Questionnaire-Children (BFQ-C) was developed by Barbaranelli, Caprara, Rabasca and Pastorelli (2003) specifically to measure the five factor model in children. The original version was in Italian, but it has subsequently been translated and used in Dutch, German, and Spanish samples. Given that the BFQ-C has support in Europe, obtained in four different languages it seems promising as an assessment of personality for English speaking children and adolescents. The BFQ-C was translated into English utilizing translation and back translation in order to maintain a high conceptual equivalency. The current study utilizes principal components analysis in order to examine the structure of the English language translation of the BFQ-C in a sample of American adolescents. Results indicate that in contrast to the Italian study, findings from this study suggest a six component solution as the most effective interpretation of the data. / Dissertation/Thesis / M.A. Educational Psychology 2012