The major purpose of this study was to determine if pre-clinical medical school course examinations reflect critical thinking skills. The entire second year class from a medical school in the southwest made up the population. Student examination results from the first two years as well as scores on the Watson-Glaser Critical Thinking Appraisal were used in this study.

Bibliography: pages 85-87. / A simplified cohort survival analysis was used to investigate the academic progression of first-time entering undergraduate students within four large bachelors' degree programmes at the University of Cape Town. The rates of graduation, academic exclusion and voluntary drop-out were quantified in relation to the matriculation authorities and prior matriculation performance of the students within each of the four cohorts. The results of the analyses served to identify specific areas of concern with regard to the internal efficiencies in student progression through each of the four degree programmes, and it is suggested that the availability of information of this type will be essential in the attainment of the institutional transformation goals set out in the 1997 White Paper on the transformation of higher education in South Africa. Significant relationships between the matriculation criteria and the final academic outcomes of students within each cohort were detected using log-near modelling. By means of multiple discriminant analysis, significant predictor variables of the final undergraduate academic outcomes within each cohort were identified. However, the relatively weak discriminatory powers of the multiple discriminant models and the poor predictive accuracy of the associated classification functions suggest the variables included in these analyses did not adequately explain the variability in the final undergraduate academic outcomes of students within the selected cohorts. The extent of the voluntary drop-out phenomenon within each of the cohorts was quantified in relation to matriculation criteria, and further analysis of the cohorts indicated that factors other than academic difficulty appeared to have prompted the greater proportion of the voluntary withdrawals. Those students who had dropped out voluntarily were therefore not included in either the log-linear models or the multiple discriminant analyses.

The purpose of this study was to determine the extent of the direct and indirect influence of previous grades, quality of instruction, motivation, quantity of instruction, and homework on Hispanic-American eighth grade students' academic achievement, while controlling for important background variables (family background, student's English proficiency, and gender). Few researchers have examined both direct and indirect effects of school learning variables and background influences simultaneously. Path analytic techniques were used to test a model of school learning on Hispanic-American eighth grade students' achievement, while controlling for background variables. The National Education Longitudinal Study of 1988 (NELS:88) was used to test the model. NELS:88 is a large, nationally representative survey of eighth graders developed by the National Center for Education Statistics (NCES). Results indicate that the achievement of Hispanic-American students was strongly influenced by previous grades, motivation, quantity of instruction, and time spent on homework. The most influential background variables were family background and English proficiency, while gender had a small but significant influence, indicating boys doing better than girls on achievement. These results support both the variables tested and the framework derived from school learning theory. / Ph. D.

In an attempt to alleviate subjectivity in special education placement decisions, Congress mandated that such decisions be made by a multidisciplinary team (P.L. 94-142). Minority students are consistently overrepresented in special education classes (Mercer, 1973; Tucker, 1980; Keyes, 1981). The research problem that was the concern of this study was: do race of the child, socioeconomic status of the child, and racial composition of the school district affect special education placement decisions? It was hypothesized that: there would be no difference in-the special education placement decisions made for white pupils and those made for black pupils; decisions made for low SES children and those made for high SES children; decisions made by special educators from school districts with a high percentage of black pupil enrollment and those made by special educators from school districts with a low percentage of black enrollment; there would be no relationship between the identification of a handicapping classification and the recommendation of time to be spent in a special class; and, that there would be no significant first or second order interactions. Crosstabulation, 2x2x2 analysis of variance, point biserial correlation coefficient, and multiple regression analysis were used to test the hypotheses. Data were obtained from 81 school district directors of special education programs in Maryland and Virginia. These respondents made special education recommendations for a hypothetical child. Findings observed included: no correlation between amount of time recommended and the identification of a handicapping classification; SES, race and district proportion explained a significant amount of variance in EMR classification; SES alone accounted for significant variance in EMR and LD classifications; and SES and race combined significantly affected the recommendation of EMR classification, SES and district racial proportion combined significantly affected the recommendation of the other than EMR or LD category. / Ed. D.

A particularistic case study was designed to investigate how portfolio assessment contributed to teachers’ instructional decision-making. Four fifth grade teachers and twenty-four fifth grade students were selected as the participants for this case study. The dual role of teacher as instructional leader and assessor was examined. Data were collected from classroom and team observations, formal and informal interviews, document analysis, audiotapes, and team planning sessions. This study demonstrated the empowerment and autonomy that teachers developed during their experience with portfolio assessment. Teachers increased their authority related to instructional decision-making, initiating self and student change, and empowering students. Analyzing student writing samples and creating benchmarks inductively derived from their own students’ writing samples provided teachers with an active role in determining the instructional focus. Teachers increased their level of decision-making through collaborative idea sharing, brainstorming sessions, and peer encouragement. They transferred these skills to other areas. The change in teachers’ instructional practices was gradual and evolutionary. The decision-making processes that the teachers underwent were context dependent and were directly related to their analysis of student writing portfolios. The monthly portfolio assessment sessions served as the catalyst for change. Teachers developed instructional adaptations and modifications based upon specific areas of student need. This process resulted in changes in the following areas: instruction, assessment, attitude, student expectations, and philosophy. The integration between assessment and instruction resulted in authentically designed experiences for students. Gradually, teachers shifted their cognitive exploration techniques from concrete to abstract techniques. The expectations for decision-making also shifted from teacher ownership to student ownership. A socialization process emerged whereby students assumed more ownership and direction for their own learning. An integrated instructional/assessment system was developed for the students which paralleled the system that was created and used by the teachers. Students inductively derived their own benchmarks based upon their own writing. As a final step toward student empowerment, metacognitive strategies were utilized by having each student evaluate his own progress by providing both quantitative and qualitative documentation along with personal reflections and future writing goals. / Ed. D.

Thesis (MEd)--University of Stellenbosch, 2007. / ENGLISH ABSTRACT:The focus of this study is on the utilisation of the learner portfolio for the Social Sciences learning area as an alternative, authentic assessment instrument to record the achievements, progress and growth of the learner as required by the expected learning outcomes. As such the learner portfolio is a more qualitative and valid alternative to traditional “pen-and-paper” testing, because the learner portfolio should present a more comprehensive picture of learners’ achievement, progress and growth. It has been endeavoured to explore and describe not only the learner portfolio as an authentic assessment instrument, but to establish the current perceptions, comprehension and experience of teachers in the Social Sciences learning area (Intermediate Phase) regarding its application. To answer the research question, and to make a logical link to the purpose of this study, the researcher executed a qualitative research study from an interpretative research paradigm. The researcher implemented multiple sources (interviews, document analysis and questionnaires) to generate data. In the course of the study a number of steps were taken to ensure the validity and reliability of the data, and to pay attention to the ethical aspects that surfaced during the research. In the literature study, extending over two chapters, the theoretical foundation of the study, consisting of assessment as a broad concept in outcomes-based education (OBE) and the learner portfolio as an authentic assessment instrument, is described. The study concludes that at present teachers are not equipped with an extensive knowledge of assessment, and have only a superficial knowledge of the structure, purpose and management of the learner portfolio and the benefits offered. It appear that teachers have relatively limited experience of utilising the learner portfolio as an assessment instrument, and the results of the study indicate that learner portfolios are not optimally utilised. Learner portfolios merely contain the best and final results of learners’ activities. They do not indicate development and growth over a given period, so that the expected learning outcomes are not realised. It is clear that the utilisation of the learner portfolio as an alternative assessment instrument is imperative in the South African education system, but that it do not achieve its purpose in the context of this specific study. / AFRIKAANSE OPSOMMING: Hierdie studie fokus op die benutting van die leerderportefeulje in die leerarea Sosiale Wetenskappe as ‘n alternatiewe, outentieke assesseringsinstrument om die prestasies, vordering en groei van leerders in verhouding tot die verwagte leeruitkomste te demonstreer. Die leerderportefeulje is ‘n meer kwalitatiewe en geldige alternatief tot tradisionele ‘pen-enpapier’- toetsing, omdat die portefeulje ‘n meer omvattende beeld van leerders se prestasies, vordering en groei verskaf. Die leerderportefeulje as ‘n outentieke assesseringsinstrument word verken en beskryf, en die persepsies, begrip en ervaring rondom die benutting daarvan deur onderwysers wat by die onderrig van die leerarea Sosiale Wetenskappe in die Intermediêre Fase betrokke is, word ondersoek. Om die navorsingsvraag te beantwoord en logies by die doel van die studie in te skakel, het die navorser ‘n kwalitatiewe navorsingstudie uit die interpretatiewe navorsingsparadigma onderneem. Daar is gebruik gemaak van veelvuldige bronne (onderhoude, dokument-analise en vraelyste) om data te genereer. Verskillende stappe is gedoen om die geldigheid en betroubaarheid van die data te verseker en aandag te gee aan etiese aspekte wat tydens die ondersoek na vore gekom het. In die literatuurstudie, wat oor twee hoofstukke strek, word assessering as breë konsep binne uitkomsgebaseerde onderwys (UGO) beskryf, en die leerderportefeulje as ‘n outentieke assesseringsinstrument ondersoek. Daar is bevind dat onderwysers tans nie oor voldoende kennis van assessering beskik nie, en ‘n oppervlakkige kennis van die struktuur, doel en bestuur, asook van die voordele verbonde aan die leerderportefeulje openbaar. Dit blyk ook dat onderwysers relatief min ervaring het in die aanwending van die leerderportefeulje as ‘n assesseringsinstrument. Uit die beskrywing van die resultate is dit duidelik dat die leerderportefeulje as ‘n assesseringsinstrument nie tot sy reg kom nie. Leerderportefeuljes vertoon bloot die beste, finale werkprodukte van die leerders se leer. Dit demonstreer nie die leerders se ontwikkeling en groei oor ‘n gegewe tydperk nie, en die verwagte leeruitkomste word dus nie gerealiseer nie. Uit die studie is dit duidelik dat die benutting van leerderportefeuljes as ‘n alternatiewe assesseringsinstrument in die Suid-Afrikaanse onderwysstelsel noodsaaklik is om leerdergroei en -ontwikkeling te monitor, maar dat dit binne die konteks van hierdie spesifieke studie, nie sy doel bereik nie.

published_or_final_version / Education / Master / Master of Education

The goal of this study was to determine if performance-based tests should be routinely administered to students in computer application courses. The purpose was to determine the most appropriate mode of testing for individuals taking a computer applications course. The study is divided into areas of assessment, personality traits, and computer attitudes.

In 1997, NLNAC added critical thinking as a required outcome for accreditation of associate degree nursing (ADN) programs. Until recently general critical thinking tests were the only available standardized critical thinking assessment tools. The emphasis has shifted to discipline specific tools. This concurrent validity study explored the correlation between two critical thinking tests, a general skills test, the California Critical Thinking Skills Test (CCTST) and a discipline specific test, the Arnett Critical Thinking Outcome Evaluation (CTOE). Both tests are based on the same definition of critical thinking. The CCTST, developed in 1990, covers discipline neutral content in multiple choice items. The CTOE, a free entry, written response test developed in 1998, assesses critical thinking in nursing situations using a partial credit model. A convenience sample of 434 sophomore ADN students from 9 programs in Texas completed the demographic survey and critical thinking tests in 1999. The sample was 87.9% female and 74.2% Caucasian, with a mean age of 31, mean GPA of 3.13, mean 3.7 years healthcare employment experience, mean CCTST score of 15.0023 and mean CTOE of 82.69. The sample also included 22.4% current LVNs, 15.7% with prior degrees and 53.5% in the first generation of their family to go to college. With Pearson correlation, three of four hypotheses concerning correlation between CCTST and CTOE scores were accepted, showing weak but significant correlation. GPA positively correlated but healthcare employment experience, first generation and minority status negatively correlated with CCTST scores. GPA correlated positively with CTOE scores. Stepwise multiple linear regression with CCTST scores retained GPA, healthcare employment experience, prior degree, and first generation in college status. The significant, positive correlation between CCTST and CTOE scores was weaker than expected. This may be due to the different formats of the tools, or a fundamental difference between a general critical thinking skills test and a discipline specific tool. Critical thinking is highly contextually sensitive and disciplines emphasize skills differently. Both tests may be useful in a critical thinking assessment program since they measure different aspects and contribute to a composite picture of critical thinking. Research should continue on discipline specific tools.

This project-based dissertation described, in detail, a seven-step research and development (R&D) process used to create, and bring to operational use, an educational tool that supported the academic use of the assessment loop: the Guidebook For Student Learning Outcomes & The Assessment Loop. The dissertation established the problem that this product solved, provided relevant research, including a literature review, and the process and methods that led to the development of this useful product. It described the purpose of this specific guidebook and for guidebooks in general. This project was informed by research of instructional design of text-based teaching materials, R&D-focused field-testing procedures, assessment theory and practice, programmatic and online course assessment needs and practices, and use of Moodle as an assessment tool and evidence repository. About the product: The guidebook is designed for use by Community College department chairs (DCs) and faculty members. It describes, from the viewpoint of a practitioner, each step in the process of assessment: from creating and measuring student learning outcomes (SLOs) to using assessment for improvement. It is hoped that use of the Guidebook by its intended audience will lead to more comprehensive assessment practices at the colleges where it is used.