Published Article / This article describes a process of student learning outcomes assessment for a health sciences programme in radiography at a university in South Africa. Its purpose is to demonstrate that while the process of student learning outcomes assessment is universal, it can be used both nationally and internationally. As long as underlying premises are met, assessment needs to be considered within the context of a country's unique culture, society and history. Underlying premises include understanding the institution's mission and vision, determining that the programme's mission and vision are congruent with those of the institution, and involving faculty early in the assessment process.

The Building Construction Science program at Mississippi State University is undergoing a major curriculum review and revision process in preparation for accreditation by the American Council for Construction Education (ACCE). This will be the program’s first attempt at accreditation in its 10-year history. None of the faculty in the program have ever been through an accreditation – making the process more challenging. What’s more, the accrediting body recently adopted an outcomes-based approach to curriculum review that hinges on programs demonstrating student achievement of 20 different student learning outcomes. These outcomes have been recognized by many as ambiguous and difficult to define – reducing motivation of programs and their faculty to move forward with accreditation. This has been the impetus for this study. The purpose of this research was to define what the 20 student learning outcomes mean for the BCS program and identify the program’s effectiveness toward including the outcomes required for accreditation into their curriculum and assessing student achievement. The study was conducted in three parts: Defining the 20 outcomes, mapping outcomes to the curriculum, and identifying assessments used to measure student achievement of the outcomes. A modified Delphi was used that incorporated the Nominal Group Technique for initial data gathering and 2 stages of surveys to identify the most essential learning criteria that define each learning outcome. The Delphi included a sample of BCS faculty, Alumni, and construction industry members. A syllabus review of the program’s core construction courses was used to map the outcomes through the curriculum and identify assessments connected to the intended outcomes. The results of the inclusion mapping were organized into three categories of Missing, Adequate, or Overlapping. The results of the study generated an initial list of 355 learning criteria across the 20 student learning outcomes that were reduced to a final list of 173 criteria identified as essential to demonstration of student achievement for the learning outcomes. The curriculum evaluation showed that nearly two-thirds of the learning outcomes are likely being redundantly included in the curriculum, and about five are missing. Assessments were shown to be included in all courses but many were difficult to connect to specific learning outcomes.

The foci of this qualitative study were twofold. First, the researcher wanted to know what instruments and methods of data collection are being used to assess core general education intended student-learning outcomes at 62 urban and metropolitan universities (members of the Coalition of Urban and Metropolitan Universities). Second, the researcher was interested in knowing the extent to which these approaches to measurement are producing data that can be used for improvement purposes. A review of the literature revealed that only 15% of institutions that indicated in a previous study that they were initiating change in the curriculum of general education programs were assessing student outcomes. Essentially, these institutions were depriving themselves of valuable data and information that might have made their organizational changes more meaningful. The present qualitative study, using a researcher-developed instrument, surveyed 62 universities as how they were assessing their general education programs. The grounded theory model of Strauss and Corbin was used to analyze the data. The study indicated that 23 of the 27 institutions that responded to the survey were conducting assessment of the core curriculum. They were using direct and indirect approaches to measurement of knowledge, skills, behaviors, and beliefs and values. The 27 institutions fell within five stages of assessment. Sixteen of the 19 institutions that were conducting assessment reported that they were having some success in identifying weaknesses in the pedagogy, the curriculum, and the assessment process. They reported changes such as adopting new pedagogical strategies, revising and adding courses, opening a new writing and mathematical center, having an increased awareness regarding the value of assessment, and generating heightened involvement among faculty members in the assessment process. Sixteen institutions reported that assessment methods such as standardized tests, essays, portfolios, and the senior assignment made it possible to identify weaknesses and make changes in their core curricula. Eleven institutions reported that they did not have any changes to report as a result of conducting assessment. Four of the eleven were in the early stages of assessment, three were in the planning stages, and one had not begun a formal assessment process. The grounded theory analysis led to this conclusion: If the leadership of institutions of higher learning realize the stage of assessment that they are in, they will be better positioned to respond to assessment training needs, assessment resource needs, stakeholders' expectations, and accrediting bodies' mandates.

Doctor of Philosophy / Department of Special Education, Counseling and Student Affairs / Kenneth F. Hughey / In academic courses, assessment is used to evaluate the effect of teaching on student learning. Academic advising has been viewed as a form of teaching (Crookston, 1972); therefore, it is necessary to assess the effect of academic advising on student learning. The best practices of assessment of academic achievement involve three key steps: the identification of student learning outcomes (i.e., what is assessed), the development and use of good measures of student learning (i.e., how assessment is conducted), and the use of sound professional judgment to understand the information gathered and to make changes to improve student learning (i.e., how assessment results are used). However, the assessment of academic advising is often minimal, narrow, and inconsistent. Further, when assessment of academic advising is conducted, it is most commonly a survey of student satisfaction of their advising experience (Carlstrom, 2012; Habley, 2004; Macaruso, 2007; Robbins, 2009). The purpose of this study was to learn about the assessment practices in the profession by surveying those who conducted or were responsible for assessment of academic advising. The study found that 80% of participants had identified academic advising student learning outcomes in their situation. The most frequently reported outcome was that students would know degree requirements. A little over half of the participants who identified student learning outcomes assessed the achievement of those outcomes and student surveys were the most frequently reported measure used. Seven percent of participants reported to use three or more measures to assess student learning outcomes. Multiple measures are needed in assessing outcomes to gather comprehensive evidence of outcomes achievement. Sixty percent of participants reported they used assessment information to make decisions regarding improvement of services and student learning. The most frequently reported use of information was making revisions to the advising process/delivery outcomes. The results of the survey indicated that participants viewed advisors’ belief in assessment as important to facilitating assessment of academic advising. They also viewed administrators’ use of information in making decisions and changes to improve advising practices and increase student learning as important.

With increasing concern over the state of the education system in the United States, more and more emphasis is being placed on teaching methods. Internet related infrastructure has become cheaper and more powerful, and online learning environments are taking a stronger presence in most higher education institutions with more video content being sought for these environments. However, the effectiveness of using video as a teaching tool is still uncertain. Without additional research, video remains an expensive gamble for an already struggling system. The purpose of this study is to evaluate the impact on student learning outcomes of video content as a primary teaching method compared to more traditional lecture based classes.

The researcher’s professional role as an Education Officer was the impetus for this study. Designing and implementing professional development activities is a significant component of the researcher’s position description and as a result of reflection and feedback from participants and colleagues, the creation of a more effective model of professional development became the focus for this study. Few studies have examined all three links between the purposes of professional development that is, increasing teacher knowledge, improving teacher practice, and improving student outcomes. This study is significant in that it investigates the nature of the growth of teachers who participated in a model of professional development which was based upon the principles of Lesson Study. The research provides qualitative and empirical data to establish some links between teacher knowledge, teacher practice, and student learning outcomes. Teacher knowledge in this study refers to mathematics content knowledge as well as pedagogical-content knowledge. The outcomes for students include achievement outcomes, attitudinal outcomes, and behavioural outcomes. As the study was conducted at one school-site, existence proof research was the focus of the methodology and data collection. Developing over the 2007 school year, with five teacher-participants and approximately 160 students from Year Levels 6 to 9, the Lesson Study-principled model of professional development provided the teacher-participants with on-site, on-going, and reflective learning based on their classroom environment. The focus area for the professional development was strategising the engagement with and solution of worded mathematics problems. A design experiment was used to develop the professional development as an intervention of prevailing teacher practice for which data were collected prior to and after the period of intervention. A model of teacher change was developed as an underpinning framework for the development of the study, and was useful in making decisions about data collection and analyses. Data sources consisted of questionnaires, pre-tests and post-tests, interviews, and researcher observations and field notes. The data clearly showed that: content knowledge and pedagogical-content knowledge were increased among the teacher-participants; teacher practice changed in a positive manner; and that a majority of students demonstrated improved learning outcomes. The positive changes to teacher practice are described in this study as the demonstrated use of mixed pedagogical practices rather than a polarisation to either traditional pedagogical practices or contemporary pedagogical practices. The improvement in student learning outcomes was most significant as improved achievement outcomes as indicated by the comparison of pre-test and post-test scores. The effectiveness of the Lesson Study-principled model of professional development used in this study was evaluated using Guskey’s (2005) Five Levels of Professional Development Evaluation.

abstract: To foster both external and internal accountability, universities seek more effective models for student learning outcomes assessment (SLOA). Meaningful and authentic measurement of program-level student learning outcomes requires engagement with an institution’s faculty members, especially to gather student performance assessment data using common scoring instruments, or rubrics, across a university’s many colleges and programs. Too often, however, institutions rely on faculty engagement for SLOA initiatives like this without providing necessary support, communication, and training. The resulting data may lack sufficient reliability and reflect deficiencies in an institution’s culture of assessment. This mixed methods action research study gauged how well one form of SLOA training – a rubric-norming workshop – could affect both inter-rater reliability for faculty scorers and faculty perceptions of SLOA while exploring the nature of faculty collaboration toward a shared understanding of student learning outcomes. The study participants, ten part-time faculty members at the institution, each held primary careers in the health care industry, apart from their secondary role teaching university courses. Accordingly, each contributed expertise and experience to the rubric-norming discussions, surveys of assessment-related perceptions, and individual scoring of student performance with a common rubric. Drawing on sociocultural learning principles and the specific lens of activity theory, influences on faculty SLOA were arranged and analyzed within the heuristic framework of an activity system to discern effects of collaboration and perceptions toward SLOA on consistent rubric-scoring by faculty participants. Findings suggest participation in the study did not correlate to increased inter-rater reliability for faculty scorers when using the common rubric. Constraints found within assessment tools and unclear institutional leadership prevented more reliable use of common rubrics. Instead, faculty participants resorted to individual assessment approaches to meaningfully guide students to classroom achievement and preparation for careers in the health care field. Despite this, faculty participants valued SLOA, collaborated readily with colleagues for shared assessment goals, and worked hard to teach and assess students meaningfully. / Dissertation/Thesis / Doctoral Dissertation Leadership and Innovation 2018

Focusing upon the intersections between community college faculty and assessment professionals (e.g., institutional researchers) in improving student learning outcomes, the purpose of this study was to describe, analyze, and interpret the experiences of these professionals as they planned for and conducted student learning outcomes assessment in developmental reading, writing, and study skills courses. This instrumental case study at one particular community college in Florida investigated the roles played by these individuals within the larger college effort to develop a Quality Enhancement Plan (QEP), an essential component of a regional accreditation review. The methodology included individual interviews, a focus group interview, a field observation, and analysis of documents related to assessment planning. There were several major findings: · Assessment professionals and faculty teaching developmental courses had similar professional development interests (e.g., teaching and learning, measurement). · While some faculty leaders assumed a facilitative role similar to that of an assessment professional, the reporting structure determined the appropriate action taken in response to the results of assessment. That is, assessment professionals interpreted results and recommended targets for improvement, while faculty and instructional administrators implemented and monitored instructional strategies. · The continuous transformation of the QEP organizational structure through research, strategy formulation, and implementation phases in an inclusive process enabled the college to put its best knowledge and measurement expertise into its five-year plan. · Developmental goals for students in addition to Florida-mandated exit exams included self-direction, affective development such as motivation, and success at the next level. · Faculty identified discipline-based workshops as promising vehicles for infusing instructional changes into courses, thus using the results of learning outcomes assessments more effectively.A chronological analysis further contributed to findings of the study. This researcher concluded that the College's eight-year history of developing general education outcomes and striving to improve the college preparatory program through longitudinal tracking of student success had incubated a powerful faculty learning community and an alliance with assessment professionals. This community of practice, when provided the right structure, leadership, and resources, enabled the College to create a Quality Enhancement Plan that faculty and staff members could be proud of.

Prior research has raised questions about different kinds of Music in General Studies (MGS) courses offered at two-year colleges, but few have addressed faculty perceptions related to student learning outcomes (SLO) and institutional missions. In principle, there is a demand on educational institutions to be accountable for SLOs, but two-year colleges present special accountability problems, because they serve multiple missions within each institution. MGS faculty perspectives can provide baseline data needed to demonstrate the ways in which MGS courses contribute to meeting the needs of students, the community, and the institutional missions. This study serves a broader goal of familiarizing readers with faculty perspectives on music education in two-year colleges. More specifically, it contributes to understanding how student learning outcomes of MGS courses are incorporated in light of blended missions as well as the challenges created by serving blended missions within a single music course. The following questions guide the research and focus on South Carolina, two-year college music faculty perspectives on MGS courses: (1) How do instructors of MGS courses describe the primary learning goals of students enrolled in MGS courses? (2) What student learning outcomes do instructors of MGS courses identify for measurement in their MGS courses? (3) How do the instructors' perceptions shape MGS content, textbook selection, and SLOs? (4) How are student learning outcomes measured in MGS courses? (5) How do instructors of MGS courses perceive the purpose of MGS within the institutional mission of their respective colleges? Following within case and cross case analysis of interview data, findings indicated that participants tended to emphasize "identifying the elements of music using correct terminology" as the most important SLO in MGS courses. All participants considered "performing music" the least important SLO. The majority reported their institutional missions as "blended" (transfer and vocational) and perceived MGS courses to be aligned with institutional missions.  

本研究旨在探討國民小學校長空間領導、教師社群運作與學生學習成效的關聯性。本研究採用問卷調查法，以臺灣地區公立國民小學教育人員為對象，總共發出1,064份問卷，回收1,008份問卷，回收率為94.74%，而有效問卷回收率則為92.20%。正式問卷回收之後，分別以描述性統計、t考驗、單因子變異數分析、皮爾森積差相關、逐步多元迴歸以及結構方程模式等統計方法加以分析。 本研究獲得以下八項結論，分述如下： 一、 國民小學校長空間領導各層面達到高程度表現，在「建構教育空間」、「形塑空間願景」層面表現最突出。 二、 國民小學教師社群運作各層面表現達到高程度表現，以「情感投入」層面最獲肯定。 三、 國民小學學生學習成效各層面表現達到中高程度表現，其中以「學生行為表現」層面最獲認同。 四、 不同背景變項在國民小學校長空間領導、教師社群運作與學生學習成效之差異有其脈絡因素存在。 五、 國民小學校長空間領導、教師社群運作與學生學習成效三者間具有正向關聯。 六、 國民小學校長空間領導及教師社群運作的分層面能預測學生學習成效。 七、 國民小學校長空間領導、教師社群運作與學生學習成效的結構方程模式之適配度評鑑良好，能解釋主要變項間的關係。 八、 國民小學校長空間領導可直接影響學生學習成效，更可間接透過教師社群運作的中介機制，對學生學習成效產生正向影響。 最後，根據研究結論，提出相關建議，俾供教育行政主管機關、學校設施規劃設計、學校單位以及後續研究之參考。 / The main purpose of this study was to explore the relationship among principals’ space leadership, teacher community operation, and student learning outcomes in Taiwan elementary school. The researcher adopted survey as the main research method. The subjects have been public elementary school educators in Taiwan. 1,064 school staffs were selected to complete the questionnaire, where 1,008 questionnaires were returned. The return rate was 94.74% and the valid rate was 92.20%. The data were analyzed by descriptive statistics, t-test, one-way ANOVA, Pearson product-moment correlation, stepwise regression, and Structural Equation Modeling. Based on the result of the current study, eight research conclusions were generated as follows: 1. The level of space leadership of principals in the elementary schools is high, and the performance in “constructing educational space” and “molding space vision” are outstanding. 2. The level of teacher community operation is high, and “affective engagement” is certainly the most eligible in the elementary schools. 3. The level of student learning outcomes is medium-performance, and “student behavior” acquired the most recognition in the elementary schools. 4. The differences of the background of principals’ space leadership, teacher community operation, and student learning outcomes have the context factors. 5. The relationships among principals’ space leadership, teacher community operation and student learning outcomes have positive correlations. 6. The sub-level of the principals’ space leadership and teacher community operation can apparently predict the student learning outcomes. 7. The proper fit of structural equation model among principals’ space leadership, teacher community operation and student learning outcomes is assessed as positive and can explain the relationships among main variables. 8. The principals’ space leadership can affect student learning outcomes directly, and which can also affect student learning outcomes positively through teacher community operation. Eventually, according to the above conclusions, the research is to provide some recommendations as future references for the educational administration authority, school planners, and elementary schools.