Assessment is the primary means of feedback between students and instructors. However, to effectively use assessment, the ability to interpret collected information is essential. We present insights into three unique, important avenues of assessment in the physics classroom and laboratory. First, we examine students’ performance on conceptual surveys. The goal of this research project is to better utilize the information collected by instructors when they administer the Force Concept Inventory (FCI) to students as a pre-test and post-test of their conceptual understanding of Newtonian mechanics. We find that ambiguities in the use of the normalized gain, g, may influence comparisons among individual classes. Therefore, we propose using stratagrams, graphical summaries of the fraction of students who exhibit “Newtonian thinking,” as a clearer, more informative method of both assessing a single class and comparing performance among classes. Next, we examine students’ expressions of confusion when they initially encounter new material. The goal of this research project is to better understand what such confusion actually conveys to instructors about students’ performance and engagement. We investigate the relationship between students’ self-assessment of their confusion over material and their performance, confidence in reasoning, pre-course self-efficacy and several other measurable characteristics of engagement. We find that students’ expressions of confusion are negatively related to initial performance, confidence and self-efficacy, but positively related to final performance when all factors are considered together. Finally, we examine students’ exhibition of scientific reasoning abilities in the instructional laboratory. The goal of this research project is to explore two inquiry-based curricula, each of which proposes a different degree of scaffolding. Students engage in sequences of these laboratory activities during one semester of an introductory physics course. We find that students who participate in the less scaffolded activities exhibit marginally stronger scientific reasoning abilities in distinct exercises throughout the semester, but exhibit no differences in the final, common exercises. Overall, we find that, although students demonstrate some enhanced scientific reasoning skills, they fail to exhibit or retain even some of the most strongly emphasized skills. / Physics

Stars are one of the most frequently covered topics in introductory astronomy classes. From a constructivist framework, one must know what conceptions students bring with them to the classroom in order to effectively facilitate deep conceptual learning about stars. This study investigated the beliefs about stars that students hold when they enter an introductory astronomy course, and used that information to develop a concept inventory that can be used to assess those beliefs pre- and postinstruction.First, students' preinstructional beliefs were investigated through the use of student-supplied-response (SSR) surveys, which asked students to describe their ideas about topics such as what is a star, how is starlight created, how are stars formed, are all stars the same, and more. More than 2,200 students participated in this portion of the study during four semesters. Responses were inductively analyzed in an iterative process and coded for themes. Calculated frequencies show that although many students (80%) understand that stars are made of gas, a third to half of the participants (32-44%, depending upon the question) believe that starlight is created (or energy otherwise emitted) as a result of the star burning. Nuclear fusion, the true energy source in stars, is identified by fewer than 10% of the students. Interviews with seven volunteers confirmed that the responses seen on the SSR surveys were consistent with verbal explanations.The second portion of the study involved the design and testing of the Star Properties Concept Inventory. After item development and testing on Versions 1 and 2, interviews with 18 participants about their responses to Version 1, and an expert review by 26 volunteer astronomy instructors, Version 3 was created and tested during the Fall 2005 semester. Results from approximately 2,000 students who took Version 3 show that those students in an introductory astronomy course for nonscience majors increased their scores significantly over the semester, whereas a control group (students in an introductory earth science course for nonscience majors) showed no increase. These results support the purpose of this concept inventory to investigate the effectiveness of instruction on the topic of star properties and formation.

Det finns lärare som planerar sin undervisning utan att undersöka hur effektiv den är i att komma till rätta med studenternas missuppfattningar. En lärare som vet vilka missuppfattningar som är vanliga och leder till felaktiga svar tror jag har större möjlighet att utforma undervisningen på ett sätt som får eleverna att göra sig av med sina missuppfattningar och därmed svara rätt. Syftet med detta examensarbete var att undersöka hur gymnasieelever i början av tredje årskursen på det naturvetenskapliga programmet uppfattar biologiska begrepp. Verktyget som användes för att undersöka elevernas begreppsuppfattning var Biology Concept Inventory (BCI). Testet besvarades av 66 svenska gymnasieelever i sista året på det naturvetenskapliga programmet. Resultatet från de svenska eleverna jämfördes med resultatet från 85 gymnasieelever i USA. Resultaten från båda länderna visar att många elever väljer bort alternativ där biologiska processer innehåller slump och hellre väljer alternativ som innebär att den biologiska processen styrs av en drivkraft som till exempel det naturliga urvalet eller en koncentrationsgradient. Användningsområden och begränsningar hos BCI diskuteras. Förslag ges till förändrad undervisning och vidare forskning. / There are teachers who plan their teaching without examining its effectiveness in overcoming students’ misconceptions. I think that a teacher who knows what misconceptions are common and lead to wrong answers has a better chance to develop their teaching in a way that will allow students to get rid of their misconceptions and hence choose correct answers. The purpose of the present study was to examine concept understanding in biology of Swedish high school students at the beginning of the final year of the science program. The tool used to explore students’ concept understanding was the Biology Concept Inventory (BCI). The test was answered by 66 Swedish high school students in the final year of the science program. The results from the Swedish students were compared to the results from 85 high school students in the United States. The results from both countries show that many students avoid alternatives in which a biological process include randomness and prefer to choose alternatives which means that the biological process is controlled by a driving force, for instance natural selection or a concentration gradient. Applications and limitations of the BCI are discussed. Suggestions for changes in education and further research are given.

No description available.

Student misconceptions in science are common and may be present even for students who are academically successful. Concept inventories, multiple-choice tests in which the distractors map onto common, previously identified misconceptions, are commonly used by researchers and educators to gauge the prevalence of student misconceptions in science. Distractor analysis of concept inventory responses could be used to create profiles of individual student misconceptions which could provide deeper insight into the phenomenon and provide useful information for instructional planning, but this is rarely done as the inventories are not designed to facilitate it. Researchers in educational measurement have suggested that diagnostic cognitive models (DCMs) could be used to diagnose misconceptions and to create such misconception profiles. DCMs are multidimensional, confirmatory latent class models which are designed to measure the mastery/presence of fine-grained skills/attributes. By replacing the skills/attributes in the model with common misconceptions, DCMs could be used to filter students into misconception profiles based on their responses to concept inventory-like questions. A few researchers have developed new DCMs that are specifically designed to do this and have retrofitted data from existing concept inventories to them. However, cognitive diagnostic assessments, which are likely to display better model fit with DCMs, have not been developed. This project developed a cognitive diagnostic assessment to measure knowledge and misconceptions about Newton's laws and fitted it with the deterministic input noisy-and-gate (DINA) model. Experienced physics instructors assessed content validity and Q-matrix alignment. A pilot test with 100 undergraduates was conducted to assess item quality within a classical test theory framework. The final version of the assessment was field tested with 349 undergraduates. Results showed that response data displayed acceptable fit to the DINA model at the item level, but more questionable fit at the overall model level; that responses to selected items were similar to those given to two items from the Force Concept Inventory; and that, although all students were likely to have misconceptions, those with lower knowledge scores were more likely to have misconceptions. / Doctor of Philosophy / Misconceptions about science are common even among well-educated adults. Misconceptions range from incorrect facts to personal explanations for natural phenomena that make intuitive sense but are incorrect. Frequently, they exist in people's minds alongside correct science knowledge. Because of this, misconceptions are often difficult to identify and to change. Students may be academically successful and still retain their misconceptions. Concept inventories, multiple-choice tests in which the incorrect answer choices appeal to students with common misconceptions, are frequently used by researchers and educators to gauge the prevalence of student misconceptions in science. Analysis of incorrect answer choices to concept inventory questions can be used to determine individual student's misconceptions, but it is rarely done because the inventories are not known to be valid measures for this purpose. One source of validity for tests is the statistical model that is used to calculate test scores. In valid tests, student's answers to the questions should follow similar patterns to those predicted by the model. For instance, students are likely to get questions about the same things either all correct or all incorrect. Researchers in educational measurement have proposed that certain types of innovative statistical models could be used to develop tests that identify student's misconceptions, but no one has done so. This project developed a test to measure knowledge and misconceptions about forces and assessed how well it predicted student's misconceptions compared to two statistical models. Results showed that the test predicted student's knowledge in good agreement and misconceptions in moderate agreement with the statistical models; that students tended to answer selected questions in the same way that they answered two similar questions from an existing test about forces; and that, although students with lower test scores were more likely to have misconceptions, students with high test scores also had misconceptions.

This research was undertaken to investigate the assessment of the spatial visualization skills of first-year engineering students. This research was conducted through three approaches: (1) a review of cogent research framed by a spatial visualization matrix, (2) the development and validation of an Engineering Graphics Concept Inventory, and (3) an investigation into the relationship into the correlations between 3D modeling skills and performance on the Purdue Spatial Visualization Test: Rotations (PSVT:R) and the Mental Cutting Test (MCT). The literature reviewed spans the field of published research from the early 1930's to the present. This review expands and provides a new direction on published research as it is viewed through the lenses of the four common pedagogical approaches to teaching spatial visualization: the standard approach, the remedial approach, computer-aided design, and the theory-informed approach. A spatial visualization matrix of criteria was developed to evaluate each of the methods. The four principle criteria included: learning outcomes, active and engaged learning, stage of knowledge, and explanatory power. Key findings from the literature review indicate the standard method is not the most effective method to teaching spatial visualization while the theory-informed method as evaluated by the matrix is the most effective pedagogical approach of the four methods evaluated. The next phase of this research focused on the two-year development, validation, and reliability of an Engineering Graphics Concept Inventory given to over 1300 participants from three universities. A Delphi method was used to determine the key concepts identified by the expert panel to be included in the inventory. A student panel of 20 participants participated in the pilot study of "think aloud" protocols to refine inventory test items and to generate the appropriate distractors. Multiple pilot studies coupled with a detailed psychometric analysis provided the feedback and direction needed for the adjustment of test items. The reported Cronbach's α for the final instrument is .73, which is within the acceptable range. The inventory is ready to be implemented and the predictability of the instrument, in reference to students' spatial visualization skills, to be researched. The final chapter of this research was a correlational study of the relationship between first-year engineering student's 3D modeling frameworks and their performance on the PSVT:R and the MCT. 3D modeling presence in graphical communications has steadily increased over the last 15 years; however there has been little research on the correlations between the standard visualization tests and 3D modeling. 220 first-year engineering students from Embry-Riddle Aeronautical University participated in the study in the fall of 2011. The main findings from this research indicate there is no significant correlational relationship between the PSVT:R and a student's 3D modeling ability, but there is one for the MCT. The significant correlational factors reported for the MCT and modeling aptitude for the three assignments are: r = .32 (p < 0.05), .36 (p< 0.01), and .47 (p< 0.01). These findings may be used by undergraduate educators and course administrators to more effectively organize engineering graphics education to yield students with deeper, more meaningful knowledge about engineering graphics and its inherent connection throughout the engineering curriculum. Together these three studies represent a sequential exploratory mixed methods approach that intertwines qualitative interviews and observations to frame the quantitative instrument and data collection. Results of this study can be used to guide the assessment of incoming freshmen engineering students, and the modification and development of engineering graphics courses. / Ph. D.

Recursion is one of the most important and hardest topics in lower division computer science courses. As it is an advanced programming skill, the best way to learn it is through targeted practice exercises. But the best practice problems are hard to grade. As a consequence, students experience only a small number of problems. The dearth of feedback to students regarding whether they understand the material compounds the difficulty of teaching and learning CS2 topics. We present a new way for teaching such programming skills. Students view examples and visualizations, then practice a wide variety of automatically assessed, small-scale programming exercises that address the sub-skills required to learn recursion. The basic recursion tutorial (RecurTutor) teaches material typically encountered in CS2 courses. The advanced recursion in binary trees tutorial (BTRecurTutor) covers advanced recursion techniques most often encountered post CS2. It provides detailed feedback on the students' programming exercise answers by performing semantic code analysis on the student's code. Experiments showed that RecurTutor supports recursion learning for CS2 level students. Students who used RecurTutor had statistically significant better grades on recursion exam questions than did students who used a typical instruction. Students who experienced RecurTutor spent statistically significant more time on solving programming exercises than students who experienced typical instruction, and came out with a statistically significant higher confidence level. As a part of our effort in enhancing recursion learning, we have analyzed about 8000 CS2 exam responses on basic recursion questions. From those we discovered a collection of frequently repeated misconceptions, which allowed us to create a draft concept inventory that can be used to measure student's learning of basic recursion skills. We analyzed about 600 binary tree recursion programming exercises from CS3 exam responses. From these we found frequently recurring misconceptions. The main goal of this work is to enhance the learning of recursion. On one side, the recursion tutorials aim to enhance student learning of this topic through addressing the main misconceptions and allow students to do enough practice. On the other side, the recursion concept inventory assesses independently student learning of recursion regardless of the instructional methods. / Ph. D.

This article focuses on the results of a research about teaching General Physics concepts to college students, and stresses the relevance of evaluating this kind of knowledge. Between 2009 and 2011, 4,535 students from the Pontifical Catholic University of Perú went through an evaluation process using the Force Concept Inventory test. The data results showed no significant improvement in the students’ learning process after having learned the concepts of force and motion, matters included in Physics 1 and Physics 2. The hardest concept to learn was Newton’s second law. Furthermore, a relevant amount of the students evaluated found no relation between learning these concepts and passing the courses. / Este artículo sintetiza el análisis de los resultados de un estudio acerca de la enseñanza de conceptos de Física en alumnos universitarios y la utilidad de evaluar este tipo de conocimientos. Entre los años 2009 y 2011, 4535 alumnos de la Universidad Católica han sido evaluados con la prueba Force Concept Inventory (FCI) a. Los resultados indican que los conocimientos de fuerza y movimiento se implantan entre los cursos de Física 1 y Física 2, y no se encuentra una mejora significativa después. El concepto con mayor dificultad de aprendizaje es la segunda ley de Newton. Además, existe un importante número de alumnos para los cuales no hay relación entre la ganancia de conceptos y la aprobación del curso.

Physical Geology is a popular general education course at Hillsborough Community College (HCC) as at many other colleges and universities. Unlike many science courses, most students taking Physical Geology are not majoring in a STEM (Science, Technology, Engineering, and Mathematics) discipline. Typically most students enrolled in Physical Geology are majoring in business, education, or pursuing a general A.A degree for transfer to a four-year university. The class is likely to be one of the few, if not the only, physical science classes that many of these students will take in their academic career. Therefore, this class takes on increased importance, as it will provide students with the foundation for scientific knowledge to be applied throughout their working careers. Student performance in an online general education physical geology course was examined and compared in this three and a half-year study involving over 700 students. Student performance was compared on the basis of term length (sixteen week semester versus nine week summer term) and delivery method (online versus face-to-face). Four identical tests were given each term; the average score of four tests was used to evaluate overall student performance. Neither term length or delivery method has a significant influence on student test scores as demonstrated by similar average score per term, similar standard deviation, and similar distribution pattern. Student score distribution follows a normal distribution reasonably well. The commonly used ANOVA tests were conducted to confirm that there is no statistically significant difference in student performance. A concept inventory of the geosciences can be valuable in providing a means to test if students are indeed learning geological concepts and to identify which misconceptions students are likely to enter class with so they can be addressed. Based on a set of 16 Geoscience Concept Inventory questions selected by the instructor, no difference in student performance was found between pre-test and post-test in terms of average score and score distribution. Some misconceptions were identified by the GCI, however little to no improvement was noted in the post-test. In contrast to the GCI, remarkable improvement in student learning is illustrated by the instructor-specific test. Possible reasons for this result are as follows, students may have adapted more to the individual instructor's test writing style and teaching style throughout the semester. The pre-test and post-test for the instructor given tests were assigned as a grade, perhaps prompting the student to take the test more seriously and consider the answers more carefully. The questions written are instructor-specific and course-specific, meaning that the students likely were introduced to the concept more thoroughly and multiple times.

This work presents two research efforts, one involving planetary science education research and a second involving the surface composition of Mars. In the former, student beliefs and reasoning difficulties associated with the greenhouse effect were elicited through student interviews and written survey responses from &gt;900 US undergraduate non-science majors. This guided the development of the Greenhouse Effect Concept Inventory (GECI), an educational research tool designed to assess pre- and post-instruction conceptual understanding of the greenhouse effect. Three versions of this multiple-choice instrument were administered to &gt;2,500 undergraduates as part of the development and validation process. In contrast to previous research efforts regarding causes, consequences, and solutions to the enhanced greenhouse effect, the GECI focuses primarily on the physics of energy flow through Earth's atmosphere. The GECI is offered to the science education community as a research tool for assessing instructional strategies on this topic.It was confirmed that the study population subscribes to several previously identified beliefs. These include correct understandings that carbon dioxide is an important greenhouse gas and the greenhouse effect increases planetary surface temperatures. Students also commonly associate the greenhouse effect with increased penetration of sunlight into and trapping of solar energy in the atmosphere. Students intermix concepts associated with the greenhouse effect, global warming, and ozone depletion. Reinforcing the latter concept, a majority believe that the Sun radiates most of its energy as ultraviolet light. Students also describe inaccurate and incomplete trapping models, which include permanent trapping, trapping through reflection, and trapping of gases and pollution. Another reasoning difficulty involves the idea that Earth's surface radiates energy primarily during the nighttime.The second research effort describes the distribution of chlorine on Mars measured by the Mars Odyssey Gamma Ray Spectrometer (GRS). The distribution of chlorine is heterogeneous across the surface, with a concentration of high chlorine centered over the Medusa Fossae Formation. The distribution of chlorine correlates positively with hydrogen and negatively with silicon and thermal inertia. Four mechanisms (aeolian, volcanic, aqueous, and hydrothermal) are discussed as possible factors influencing the distribution of chlorine measured within the upper few tens of centimeters of the surface.