The use of analytic rubrics remains popular in the field of writing assessment. Previous work in second-language writing assessment and other fields like economics suggest that ratings produced using this method may have lower reliability on average than other methods. Currently, there is little research on the reliability of ratings of creative writing, specifically creative writing authored by adults. This study evaluated the reliability of ratings from an analytic rubric against those produced by a comparative method called Randomly Distributed Comparative Judgment and the rater experience of the methods. The author administered a science fiction and fantasy contest in which 9 raters rated subsets of 47 total contest entries. Raters used both methods on two occasions for a total of four ratings per assigned artifact. The analytic rubric ratings were analyzed using the Many-Facets Rasch Model to model story, rater, occasion, and interaction effects. The comparisons from the RDCJ method were used in a proprietary version of the Bradley-Terry Model to calculate true scores and rater effects. Analysis showed rater effects in the ratings of both methods, though greater for those associated with the rubric model. The ratings from the rubric also contained occasion effects, but the RDCJ ratings did not. Interviews with the raters found that raters generally favored the RDCJ method, though some would have preferred a modified version. However, they all found the rubric less useful, even though many thought that it covered the generally accepted factors of good creative writing. These findings may influence practitioners' decisions when choosing a rating method for shorter works of creative writing, particularly in contexts like story contests or university admissions. However, rating of creative writing is an understudied field compared to academic writing, and more work is needed in the areas of reliability and rating.

It is becoming increasing important that teachers educate students about social studies in such a way so that students are interested and motivated by what they read. So often the curriculum is bombarded with physically heavy, incomprehensible, and traditional textbooks. Based upon the need for extensions to the social studies textbooks, my goal to establish a guideline for selecting quality graphic novels fitted for elementary social studies instruction. Therefore, my study will attempt to answer the question: What is an effective means of determining quality graphic novels? Following my adaptation and creation of rubrics established for determining the needs and qualities of graphic novels, I was able to establish and analyze several social studies content related graphic novels appropriate for the elementary social studies curriculum. This investigation into social studies graphic novels provided 18 graphic novels for possible use in the elementary social studies curriculum, 5 of which were deemed quality via the established rubrics. Furthermore, the investigation proved that the books deemed quality provided more than what was established as necessary within the rubrics. The additional information found within those texts was referred to as a postlude. One strong conclusion from this study is the large void of graphic novels that teachers might link with the social studies curriculum so as to enhance elementary social studies instruction.

No description available.

In the wake of declining student performance and interest in science education, efforts to improve the quality of science teaching have intensified, including physics education. A recurring proposal to improve physics teaching is the use of formative assessment. Policy reforms tend to view the implementation of formative assessment as easy, but studies indicate that integrating these strategies into teachers’ practices can be challenging.   Using a phenomenological approach and hermeneutic reflections, the present study explores the opportunities and challenges that teachers’ and students’ experience when implementing formative assessments in the physics classroom. For example, teachers may encounter resistance from their students and colleagues with different expectations of physics teaching, limiting teachers’ opportunities to ‘break free’ from established traditions. However, the study also highlights opportunities for physics teachers to evolve by taking risks and embracing formative assessment as an overarching learning assessment approach.   Furthermore, the present study confirms the results of previous research indicating that students may see assessment rubrics in a positive light as their use can clarify teachers’ expectations and reduce uncertainty in this regard. However, the results of the present study also show that students may approach rubrics only as mechanical and strategic tools to obtain their desired grades, which risks conveying the message to students that physics knowledge is quantitative in nature. The students’ experiences also demonstrated that the use of rubrics could cause stress and anxiety, limiting the formative potential of rubrics.  The results of the study are discussed in relation to the support that teachers and students need in implementing formative assessment and rubric use, and they have implications for teachers’ assessment literacy, including their ability to implement formative assessments in relation to different purposes of physics teaching. One conclusion is that teachers’ and students’ lived experiences of formative assessment and rubric use need to be understood in relation to the wider context of their lifeworlds, which is marked by an increased focus on performance and results. This is crucial so that teachers and students would not be portrayed as the problems when investments in formative assessment do not meet expectations.

A relatively large number of 8th-grade public middle school students in the United States, particularly in urban communities, are not performing at acceptable levels in mathematics. One concept that poses significant difficulty for these students and negatively affects their overall mathematics achievement is fractions. Many researchers have attributed these difficulties primarily to traditional fraction instruction that emphasizes procedural rather than conceptual knowledge. Therefore this study was designed to investigate how students use their computational and conceptual knowledge and fraction representations to solve fraction-related performance-based mathematical tasks. Social constructivism was used as the theoretical framework in examining conceptual knowledge related to learning fractions. This qualitative study was implemented in an urban middle school in the southeast. It involved an initial sample of 37, 8th-grade, African American pre-algebra students who completed a fraction interest questionnaire and two fraction pretests. During the implementation period, 34 students in the researcher’s pre-algebra class completed three performance-based tasks, three reflection logs, and participated in an interview after completing each task. Of the 34 students who completed all tasks, three were purposefully selected as the informants for the study. In addition, observations, field notes, and artifacts (student work) were utilized to facilitate triangulation of the data. The findings of the study indicated the informants could compute fractions with an average of 85% of mastery but could conceptualize fractions only to a small extent. This validated prior findings and led to the conclusion that student deficiency with fractions results primarily from their level of conceptual knowledge. In the investigation of the ways in which 8th-grade students use fraction representations, this study found the informants used representations to develop a visual map of their mathematical thinking and reasoning and to check the accuracy of their computations. Therefore, this study suggests, when students’ mathematical learning experiences relative to fractions have not emphasized the use of representations to develop conceptual knowledge, they may not be comfortable with the accuracy of the solutions demonstrated in their fractions models.

A healthy civil society depends on citizens who have mature critical thinking skills and a willingness to entertain opposing points of view. The development of critical thinking in young adults has long been studied, but there has been little agreement on what the attributes of critical thinking are and how to reliably assess them. While many studies have attempted to assess the critical thinking abilities of college students, none have yet measured critical thinking through using the Critical Thinking Analytic Rubric (CTAR) to assess first-year college students' writing. This study used a modified version of the CTAR rubric to investigate students' critical thinking in writing completed for an American Heritage course. Four hypotheses were tested: (1) that raters would use the rubric with high inter-rater reliability estimates; (2) that there would be a significant relationship between the scores from the earlier holistic rubric used in the 2015 Hansen et al. study and the scores from the analytic rubric used in this study; (3) that there would be a significant relationship between analytic scores and ACT and GPA scores; (4) that there would be a significant relationship between essay score and gender. Findings included the following: (1) The inter-rater reliability for the overall scores of the papers was 0.898, which exceeds the 0.70 acceptable level. However, the inter-rater reliability for sub-scores was negative and required further investigation. (2) There was no significant relationship between the scores of the Hansen et al. study and this study. (3) There was no significant relationship between essay scores and ACT and GPA scores. (4) There was a significant relationship between essay scores and gender, with female students scoring higher than male students.

A rubric specifically for speaking skills was recently implemented and practiced in an English classroom for grade 6, in a school in the south of Sweden. The predetermined effected results of how the rubric works is debated among many schools and researchers, but no research have been done on the actually effects specifically in this area recently. Therefore, the overall aim for this study is to analyse how this specific tool for the spoken language learning works in practice. The study includes theory and previous research, which will be presented and moreover discussed in relation to the findings. Semi-structured interviews will be used and the participants are two teachers who teached year 6 at the same school in a city in the south of Sweden; both used the rubric in the English classroom. I investigated why and how it was implemented and used in the English classroom. Moreover, I answered the questions of what kind of rubric was used; and by comparing the rubric to the knowledge requirement in the syllabus, I determined how it outlined the knowledge requirements. In addition, by analysing the teachers’ answers, I investigated how the rubric affected the students’ learning and how it facilitated the learners’ self-awareness of their language development. The conclusion demonstrates that the rubric for speaking skills is beneficial for the majority of the students, but it has a negative effect on the students who are on a lower knowledge level than the rubric includes.

Researchers have suggested that the college student population in the United States is evolving and the number of nontraditional students is rising. New student retention and academic success were ongoing concerns at a college in the southern United States and the association of those outcomes with instructional delivery model and student type was not known. In an effort to improve new student outcomes, this study examined differences in first-quarter student retention and academic success, as measured by GPA, for courses taught strictly online or on campus, and for traditional versus nontraditional students. Guided by Bean and Metzner's conceptual model of nontraditional student attrition, this quasi-experimental study used data from 1,304 first-quarter students divided into 4 equal groups (n = 326). Groups were compared for GPA using 2x2 factorial ANOVA and for retention using chi-square tests of association. Findings showed no significant differences in retention or in the interaction between instructional delivery model and student type for GPA. A significant difference in GPA between traditional and nontraditional students, with the latter earning higher grades, was found. In addition, a bimodal grade distribution was identified in all 4 sample groups indicating the highest frequencies of students earning As and Fs, suggesting that new students either do very well or very poorly academically. Based on these findings, a white paper and presentation for campus officials was developed. The implementation of rubrics in all campus-based courses along with continuous evaluation of student performance was recommended. Positive social change may result from the use of rubrics with the new student population by increasing consistency of grading and improving understanding of expectations which may lead to better student outcomes over time.

No description available.

I denna studie sammanställs och analyseras 12 intervjuer med sammanlagt 24 elever som informanter utifrån ett fenomenografiskt perspektiv. Eleverna som ingick i studien gick antingen i en fjärdeklass eller en femteklass. Studien syftade till att utifrån ett elevperspektiv undersöka användandet av lärandematriser som stöd för utveckling av deras textskapande. Intervjuerna har transkriberats för att sedan analyseras i relation till tidigare forskning. De frågeställningar som kommer att besvaras i denna studie lyder: Vilka uppfattningar har elever om användandet av lärandematriser i svenskundervisning? Hur uppfattar elever att lärandematriser påverkar deras egna utvecklinginom textskapande i svenskundervisning? Resultatet visar att majoriteten av de 24 elever uppfattade att deras användande av lärandematriser stöttade deras textskapande. Eleverna uppfattade även att lärandematrisen påverkade deras skriftliga utveckling positivt. Trots att majoriteten hade positiva uppfattningar om lärandematriser fanns det enstaka elever som uppfattade dem som överflödiga eller onödiga.