A healthy civil society depends on citizens who have mature critical thinking skills and a willingness to entertain opposing points of view. The development of critical thinking in young adults has long been studied, but there has been little agreement on what the attributes of critical thinking are and how to reliably assess them. While many studies have attempted to assess the critical thinking abilities of college students, none have yet measured critical thinking through using the Critical Thinking Analytic Rubric (CTAR) to assess first-year college students' writing. This study used a modified version of the CTAR rubric to investigate students' critical thinking in writing completed for an American Heritage course. Four hypotheses were tested: (1) that raters would use the rubric with high inter-rater reliability estimates; (2) that there would be a significant relationship between the scores from the earlier holistic rubric used in the 2015 Hansen et al. study and the scores from the analytic rubric used in this study; (3) that there would be a significant relationship between analytic scores and ACT and GPA scores; (4) that there would be a significant relationship between essay score and gender. Findings included the following: (1) The inter-rater reliability for the overall scores of the papers was 0.898, which exceeds the 0.70 acceptable level. However, the inter-rater reliability for sub-scores was negative and required further investigation. (2) There was no significant relationship between the scores of the Hansen et al. study and this study. (3) There was no significant relationship between essay scores and ACT and GPA scores. (4) There was a significant relationship between essay scores and gender, with female students scoring higher than male students.

No description available.

Kamratbedömning kan ha en positiv effekt på elevers lärande. För att uppnå denna positiva effekt måste elever kunna ge återkoppling till sina kamrater och även ta emot återkoppling från sina kamrater. Elever måste också kunna använda den återkoppling som de får. Återkoppling kan ges på fyra olika nivåer, uppgiftsnivå, processnivå, självregleringsnivå och personnivå. Att använda elever som lärande resurser för varandra, är en av nyckelstrategierna inom formativ bedömning. Fokus på formativ bedömning och användning av den samma har ökat inom skolan. Det, tillsammans med att det inte finns många studier som undersöker formativ bedömning med ett ämnesinnehåll i svensk kontext, är exempel på vad som ligger till grund för studien. Det övergripande syftet med denna studie var att öka kunskapen om hur kamratbedömning genomförs i naturvetenskap på mellanstadiet. Fokus riktades dels mot hur lärare implementerar kamratbedömning, men framförallt mot hur elever ger varandra återkoppling. För att undersöka hur och på vilka nivåer som 11-åriga elever ger varandra återkoppling, genomförde elever kamratbedömning i mindre grupp efter att enskilt ha besvarat uppgifter med ett naturvetenskapligt innehåll. Insamling av data skedde i flera steg. När läraren gav eleverna instruktioner kring bedömningsmatrisen, uppgifterna och den kamratbedömning som de skulle genomföra, observerades och videofilmades detta. Elevernas kamratbedömningssamtal i grupp, videofilmades också. Därefter intervjuades eleverna enskilt.Studiens resultat visade att eleverna fick återkoppling på olika nivåer av sina kamrater. Den återkoppling som var mest förekommande, var på uppgiftsnivå. Det fanns exempel på återkoppling på andra nivåer också i materialet, samt exempel där det inte förekom någon återkoppling alls. När eleverna bedömde varandras svar, fokuserade de på mängden naturvetenskapliga begrepp i kamraternas svar. Slutsatser som dragits utifrån studiens resultat var bland andra att elever behöver träna både på kamratbedömning och på att ge användbar återkoppling, samt att lärare bör vara medvetna om att deras instruktioner är betydelsefulla när det gäller hur kamratbedömningen faller ut. En annan slutsats är att kamratbedömning med ämnesinnehåll, kräver både bedömarfärdighet och ämneskunskap. / Peer assessment may have a positive effect on student learning. In order to have these positive effect students have to be able to give feedback to their peer and also to receive feedback from their peer. The students also have to be able to use the given feedback. Using students as learning resources to each other is a key strategy within formative assessment. The feedback that is given can be directed at four different levels, task level, process level, self-regulation level and self-level. Using peers as learning resources, is one of the key strategies within formative assessment. Focus on formative assessment and the use of it, have increased within school. That, and the fact that there are not many studies that examines formative assessment with science content, are a part of the background to the conducted study.The overall purpose of the study was to contributed to the field concerning peer assessment in science with 11-year old students. The focus was partly how teachers implement peer assessment, but above all how students give feedback. In order to examine how and in what different levels student give each other feedback, students conducted peer assessment in small groups, after they had answered questions concerning science. Data collection was done in the following steps. At first, the teacher gave the students instructions about the tasks, the scoring rubric, how to assess and so on. While doing that, the teacher was observed and video recorded. Next step concerned the students. They answered the questions and then had peer assessment in small groups. This was also video recorded. Later on the students were interviewed. The students received different kinds of feedback, mostly at task level, from their peer. Some examples of feedback at other levels were also discovered. When students assessed each other’s answers, they looked at the amount of science concepts that were used in their peer’s answers. The results suggest that students need to practice peer assessment, how to give useful feedback and that the teacher need to be aware of that given instruction may turn out differently from what is expected. The results also show that students believe that peer assessment is useful and that feedback is given. This was contradictory from what was seen in some of the observations of the peer assessment. Conclusions are for example that students need both assessment skills and scientific knowledge.

No description available.

No description available.

Science and technology are constantly transforming our day-to-day living. Science education has become of vital importance to prepare learners for this everchanging world. Unfortunately, science education in South Africa is hampered by under-qualified and inexperienced teachers. Textbooks of good quality can assist teachers and learners and facilitate the development of science teachers. For this reason thorough assessment of textbooks is needed to inform the selection of good textbooks. An investigation revealed that the available textbook evaluation instruments are not suitable for the evaluation of the physical science textbooks in the South African context. An instrument is needed that focusses on science education textbooks and which prescribes the criteria, weights, evaluation procedure and rating scheme that can ensure justifiable, transparent, reliable and valid evaluation results. This study utilised elements from the Analytic Hierarchy Process (AHP) to develop such an instrument and verified the reliability and validity of the instrument’s evaluation results. Development of the Instrument for the Evaluation of Science Education Textbooks started with the formulation of criteria. Characteristics that influence the quality of textbooks were identified from literature, existing evaluation instruments and stakeholders’ concerns. In accordance with the AHP, these characteristics or criteria were divided into categories or branches to give a hierarchical structure. Subject experts verified the content validity of the hierarchy. Expert science teachers compared the importance of different criteria. The data were used to derive weights for the different criteria with the Expert Choice computer application. A rubric was formulated to act as rating-scheme and score sheet. During the textbook evaluation process the ratings were transferred to a spreadsheet that computed the scores for the quality of a textbook as a whole as well as for the different categories. The instrument was tested on small scale, adjusted and then applied on a larger scale. The results of different analysts were compared to verify the reliability of the instrument. Triangulation with the opinions of teachers who have used the textbooks confirmed the validity of the evaluation results obtained with the instrument. Future investigations on the evaluation instrument can include the use of different rating scales and limiting of criteria. / Thesis (M. Ed. (Didactics))

Sustainable development through sustainable engineering is a promising strategy for combating unsustainable patterns of population growth, resource consumption, and environmental degradation. For sustainable engineering to alleviate global problems, however, improvements in undergraduate education are required to equip students with the knowledge and skills needed to engage in sustainable design. Consequently, the goal of this dissertation is to assess and improve sustainability education in civil and environmental engineering (CEE) at the Georgia Institute of Technology (Georgia Tech). Three phases of inquiry were conducted to (1) examine the current status of CEE sustainability education, (2) use assessment results to develop a pedagogically-innovative sustainability module, and (3) investigate the impacts of implementing the module into select CEE courses on student learning. Several key findings resulted from this work. First, the Sustainability Tool for Assessing Universities’ Curricula Holistically (STAUNCH®) suggested that integration of sustainability into the curriculum was incomplete and favored environmental sustainability. Second, CEE seniors’ conceptual understanding of sustainability, based on concept map results, was found to be generally correct, although limited in comprehensiveness, connectedness, and balance. Third, examination of capstone project reports (2002 and 2011) using the novel Sustainable Design Rubric revealed little change in the students’ sustainable design abilities over the past decade, due potentially in part to students simply “meeting the expectations” of project sponsors. Based on these insights, a five-part, learning-cycle-based sustainability module was developed and implemented in CEE capstone and cornerstone design courses. Higher learning gains for cornerstone students, as compared to seniors, supports future integration of the module into cornerstone design courses. While project results are especially important for CEE at Georgia Tech, other programs and institutions may benefit from the development and improvement of sustainability knowledge assessment tools, as well as the empirically-informed and theoretically-grounded sustainability module.

The purpose of this study is to determine the relation between the teachers’ and the students’ understanding of music rubrics. The study will present the use of music rubrics in three different schools. In these schools, observations were performed as well as interviews with the teachers and their students. A study of the rubrics on each school was also executed to construct appropriate questions and an observation schedule. To analyse our material a phenomenographical method was used. The result shows that the teachers and students have similar understandings and interpretations of the content as well as the purpose of the music rubric.

Orientador: Jorge Muniz Junior / Resumo: O objetivo desta tese é propor um modelo para avaliar competências de estudantes de engenharia em fóruns de discussão on-line. O modelo inclui um instrumento de pontuação (rubrica) baseado na Taxonomia de Bloom para avaliação de Competências em disciplinas da engenharia. A revisão da literatura indicou oportunidades de pesquisa atendidas pelo modelo proposto, tais como, comparação de diferentes rubricas, aplicação da Taxonomia de Bloom em atividades colaborativas, bem como validade e confiabilidade de rubricas em diferentes contextos educacionais. O modelo de avaliação utiliza rubrica analítica, a qual fornece feedback específico para cada uma das competências avaliadas, de acordo com os níveis da Taxonomia de Bloom: lembrar, entender, aplicar, analisar, avaliar e criar. As competências avaliadas estão alinhadas com a Accreditation Board of Engineering and Techonology (ABET), World Economic Forum de 2015 e National Academy of Engineering, de forma a comtemplar complexidade e desafios do profissional do século XXI. A validação do modelo foi feita por meio de sua aplicação em instituições públicas de ensino superior (Escola de Engenharia de São Carlos (EESC), Instituto Federal de São Paulo (IFSP) e Universidade Federal de São Carlos (UFSCar)), o que envolveu 118 docentes especialistas de ensino a distância e 106 estudantes. Evidenciaram a validade e confiabilidade do modelo por meio dos coeficientes: Indice de Validade de Conteúdo (90%), Alfa de Cronbach (0,73), Porcentagem Abs... (Resumo completo, clicar acesso eletrônico abaixo) / Abstract: The objective of this thesis is proposing a model to evaluate Engineering students’ competencies in on-line discussion forums. The model includes a grading tool (rubric), based on Bloom’s Taxonomy, for the evaluation of competencies in Engineering courses which stimulate logical thinking and decision making. The literature review revealed research possibilities about the proposed model use, such as the comparison of different rubrics, the application of Bloom’s Taxonomy in collaborative activities, and rubric validity and reliability in different educational contexts. The evaluation Model uses an analytic rubric, which provides a specific feedback for each of the evaluated competencies, according to the levels of Bloom’s Taxonomy: remembering, understanding, applying, analyzing, evaluating and creating. The evaluated competencies are relevant for the Accreditation Board of Engineering and Technology, 2015 World Economic Forum, and National Academy of Engineering, keeping in view the complexity and challenges of the 21st century professional.Validation of the model was done through its application in public universities (Escola de Engenharia de São Carlos (EESC), Instituto Federal de São Paulo (IFSP) e Universidade Federal de São Carlos (UFSCar)), with the collaboration of 118 distance education specialist teachers and 106 students. Validity and reliability of the Model was proved by the following coefficients: Content Validity Index (90%), Cronbach’s Alpha (0.73), Absolute Pe... (Complete abstract click electronic access below) / Doutor

This project investigates the extent to which EFL teachers’ assessment practices of two students’ written texts differ in a Swedish upper-secondary school. It also seeks to understand the factors influencing the teachers regarding inter-rater reliability in their assessment and marking process. The results show inconsistencies in the summative grades given by the raters; these inconsistencies include what the raters deem important in the rubric; however, the actual assessment process was very similar for different raters. Based on the themes found in the content analysis regarding what perceived factors affected the raters, the results showed that peer-assessment, assessment training, context, and time were of importance to the raters. Emerging themes indicate that the interpretation of rubrics, which should actually matter the most when it comes to assessment, causes inconsistencies in summative marking, regardless of the use of the same rubrics, criteria and instructions by the raters. The results suggest a need for peer-assessment as a tool in the assessment and marking of students’ texts to ensure inter-rater reliability, which would mean that more time needs to be allocated to grading.