The use of rating scales in the evaluation of secondary teacher performance has been called into question and widely criticized. Of particular concern has been the use of student ratings of teacher performance. A review of instruments and practices used in the rating process reveals serious design flaws that account for the criticisms leveled against the use of rating scales. This study sought to address the limitations evident in previous rating efforts by utilizing a combination of design methodologies and measurement models including elements of Classical Test Theory (CTT), factor analysis, and Item Response Theory (IRT). The IRT model employed was the one-parameter logistic model also known as the Rasch model. Twelve scales were developed consisting of a total of ninety-two items. These scales were developed to facilitate student ratings of secondary level teachers of religion in the Church Educational System (CES) of the Church of Jesus Christ of Latter-day Saints (LDS). In addition to exploring rating scale design methodology and scale performance, this study also examined a potential threat to the validity of decisions based on ratings referred to as halo effect. Using a variety of approaches to operationally define and estimate halo error, the extent to which male and female students exhibit differing degrees of halo in their ratings of teachers was examined. The results of the study revealed that of the twelve teacher traits hypothesized in the design of the rating scales, only three met defensible criteria based on CTT and Rasch model standards: the Student-Teacher Rapport Scale (STRS), the Scripture Mastery Expectation Scale (SMES), and the Spiritual Learning Environment Scale (SLES). Secondary students were unable to meaningfully discriminate between all twelve traits. Traditional approaches to halo effect estimation suggest that males exhibited halo to a greater degree than females, whereas Rasch model approaches to halo effect estimation were less consistent. Considered together, however, the evidence suggests differential halo error by gender, with males exhibiting halo to a greater degree than females. The implications of these findings for teacher evaluation, instructional design, and future research efforts are also addressed.

The purpose of this study was to examine the potential for using propensity score-based matching methods to estimate teacher contributions to student learning. Value-added models are increasingly used in teacher accountability systems in the United States in spite of ongoing qualms about the validity of teacher quality estimates resulting from those models. Using a large national dataset, teacher effects were estimated for 435 teachers using both value-added and propensity score-based approaches. The two approaches resulted in teacher effect estimates that were moderately correlated, with propensity score-based estimates more highly correlating with the value-added estimates as the matching ratio was increased. For many teachers' students, finding a set of matched control students was impossible unless the set of matching variables was reduced. Results suggest that many teachers have classroom compositions that are unusual, making evaluation of the teachers' impacts on student outcomes problematic. It was also found that, while value-added estimates were relatively insensitive to covariate inclusion choices or method of effect estimation, propensity score-based estimates were somewhat sensitive. Propensity score-based teacher effect estimates offer promise both for better accounting for classroom composition and student background variables and for indicating when a teacher's context is unique with respect to those variables, making the teacher's impact challenging to evaluate.

In an ever increasingly competitive global marketplace, a concern exists that American students are not being adequately prepared with the skills needed for the 21st century. As a remedy, improving quality of teacher instruction is a current national focus. Stakeholders are questioning current infrequent and inefficient methods of evaluating teacher performance. Many states are looking at using a 360 model of evaluating through multiple perspectives including the students themselves as key stakeholders. One method of accessing student voice and adding another perspective to teacher evaluations would be to include student evaluations in the rating of teacher performance, Student Evaluation of Teaching (SET). While using student evaluations of teacher performance is wide spread in higher education, the practice has been limited in public school settings until brought to light by the publication of the recent Gates Foundation MET (Measures of Effective Teaching) Project (2010). Currently, states across the nation are considering adding a student input component to teacher evaluations. With the validity and reliability of student evaluations in the university settings still under debate by professors, public school teachers also fear punitive measures and public judgment based on the verdicts of adolescents. This research examined the archival data from a program study of one high school's student evaluation implementation process, accessing teacher feedback from the initial evaluation process and then an adjusted implementation of student evaluations according to teacher feedback the following year. Based on mixed method design using both qualitative and quantitative methods to analyze teacher questionnaires, focus group open-ended responses and statistical analysis of close-ended agree/disagree statements from teacher questionnaires, this study used triangulation to explore teacher reflections on their anxiety levels created by the student evaluation implementation process, the value they found in student evaluations, and the degree to which student evaluations facilitated change in their teaching instruction. Exploring possibilities through the eyes of teachers to reduce their anxiety and increase their value of student input, this study suggests ways to tap into the potential but underutilized resource in schools that could come from developing a mutually beneficial partnership between students and teachers to improve teacher instruction and increase student learning.

The purpose of this mixed-method phenomenological study is to understand the beliefs and attitudes that mid-career secondary school teachers have regarding the teacher evaluation process and its effect on their professional practice. Mid-career secondary school teachers (defined as having between 14-21 years of classroom experience) from Bayview Public Schools were selected to participate. A total of 152 mid-career secondary school teachers completed an electronic survey. Additionally, a total of 9 participants took part in one-on-one semi-structured interviews. The theoretical framework used to guide the study was the theory of planned behavior (TPB) (Ajzen, 1988; 1991) and Bandura*s theory of self-efficacy (1977). The quantitative results from the electronic survey were used to augment qualitative data collected from interviews with willing participants. The interviews with study participants were analyzed for emerging themes. In all, a total of nine emerging themes came to light through the analysis of interview data. The data revealed areas of concern regarding the current method of evaluating teachers in Bayview Public Schools. A presentation of the findings with regard to the theoretical framework, literature, and practice were presented. Furthermore, a list of recommendations was provided addressing the specific concerns of participating teachers. In conclusion, recommendations were also made concerning future research that might continue to add to the body of knowledge concerning teacher evaluation.

This mixed-methods replication study was conducted to develop further understanding of the professional perceptions of educational leaders as to the fairness and impact of Race to the Top reforms concerning teacher evaluation and compensation on student achievement and growth. Graduate students in education and educational leadership from a target university were selected to complete an electronic survey to collect quantitative and qualitative data for analysis. Quantitative results from the electronic survey revealed limited diversity in professional perceptions of the five identified components of RTTT based upon professional classification or percentage free and reduced lunch population at the school sites where assigned. Among the identified RTTT components, the component that provided for the use of school- or team-level VAM scores as part of the evaluation and compensation system was consistently viewed as the least fair and least impactful by respondents. Analysis of the qualitative data revealed a number of themes that effected respondents' professional perceptions of the RTTT initiative. The use of a value-added model in RTTT reforms, the variables considered by the model, and communication and implementation problems associated with the reforms were the central areas of concern among survey respondents. This study provided follow-up data to Windish's 2012 study and showed a negative general trajectory of the professional perceptions of educational leaders related to this high-profile, national educational reform effort.

This study examined the relationship between the professional practices components of the School Board of Brevard County Instructional Personnel Performance Appraisal System Instrument and student achievement as measured by a teacher’s valueadded measurement score. A Pearson Product-Moment Correlation was the statistical test used to analyze the data. The population included Brevard Public School instructional personnel assigned to Grades 4-10 who taught reading and/or mathematics measured by the Florida Comprehensive Assessment Test during the 2011-2012 school year and who received teacher aggregated value-added measurement scores. Findings indicated that there was a small to moderate statistically significant, positive relationship between all eight professional practices component variables and value-added measurement scores. Correlation coefficients ranged from .089 for collaborative inquiry to .218 for quality of instruction. All of the components combined had a correlation of .231, confirming the strength of multiple evaluation measures. Recommendations were provided for future research aimed at further data analysis in Brevard Public Schools as well as other school districts in order to identify the combination of evaluation components that most accurately reflect teaching effectiveness resulting in student learning as well as to pinpoint weaknesses upon which additional training could be based and the fidelity of implementation improved.

The focus of this research was to examine the initial year of implementation of the Marzano Teacher Evaluation Model and iObservation®tool (Learning Sciences International, 2012) as it related to student achievement in the School District of Osceola County, Florida and to determine if the Marzano model improved the ability to determine teacher effectiveness with more accuracy than previous models of teacher evaluation used in the school district. Twelve research questions guided this study concerning the relationship and predictability between the variables of teacher instructional practice scores, number of observations reported in the iObservation®tool, and student achievement in Grades 3-5 using reading and mathematics FCAT 2.0 DSS scores. Linear Regression analysis suggested that for Grade 3 reading and mathematics the instructional practice mean had statistical significance in predicting performance and was a strong predictor of Grade 3 FCAT reading and mathematics performance. Linear Regression analysis suggested that for Grade 3 reading and mathematics the instructional practice mean had statistical significance in predicting performance and was a strong predictor of Grade 3 FCAT reading and mathematics performance. Linear Regression analysis further suggested no statistical significance or predictability for Grades 4, 5 for instructional practice mean and Grades 3,4,5 for observation mean related to FCAT reading and mathematics performance. Caution should be used when attempting to interpret these findings, as this study was based solely on intitial year implemention data. Implications for practice are also discussed in this study.

This study focused on the relationship between student achievement and teacher evaluation during the first year of implementation of the Marzano Causal Teacher Evaluation model in a large suburban school district in Central Florida. The population included high school level teachers and students. Teacher evaluation and performance data were collected and analyzed for relationships using Spearman Rho and Chi-Square Analysis. Variables reviewed included: (a) Marzano‟s Causal Teacher Evaluation Model iObservation© protocol, (b) categorized teacher years of experience, (c) student growth scores based on a teacher‟s student success on statewide assessments as calculated using VAM or an administered pre- and posttest, (d) school reported teacher demographics on school improvement plans and (e) historical 9th - and 10th -grade student achievement data on FCAT 2.0 Reading and 9 th - grade student achievement data on the Algebra 1 End-ofCourse (EOC) Examinations.

The purpose of this study was to develop categories of meaning regarding veteran teachers' perspectives on teacher evaluation and how veteran teachers want to be evaluated. A total of 14 teachers with 10 or more years of teaching experience were interviewed. The study relied upon a qualitative method, using grounded theory to provide an in-depth analysis on perspectives veteran teachers had on teacher evaluation and how they wanted to be evaluated. Interview data was analyzed and coded for concepts that represented teachers' perspectives. The analysis yielded data which presented two themes, Theme one: Veteran Teachers' Perspectives on Teacher Evaluation, and Theme Two: Veteran Teachers' Plan for Evaluation. Theme one revealed several categories: "evaluation career," "evaluation process," "types of evaluation processes," "evaluators," and "purpose of evaluation." Theme two presented three categories: "what to evaluate," "who evaluates," and "how to evaluate." Data analysis led to a grounded theory suggesting that teachers experienced commonalities regarding their perspectives on teacher evaluation and how they want to be evaluated. This study concluded that teachers perceive the current status of teacher evaluation as ineffective and useless. Teachers want the process to continue using principal observation as the key component, but want it done more often both formally and informally. Teachers feel that evaluators should be competent in the areas they evaluate and serve as instructional leaders. They want other data sources to be included in their evaluations. Teachers disagree with pay for performance systems or those solely dependent on student outcomes, and that student growth data should be part of a multi data driven system. Self-evaluation and professional growth are areas teachers feel should be tied to an effective evaluation system. Teachers want to receive feedback from parents, peers, and students. Teachers find the California Standards for the Teaching Profession (CSTP) to be an effective and necessary tool to base teacher evaluation upon. This study presented perspectives concerning teachers' experiences with teacher evaluation and also presented data regarding how teachers wanted to be evaluated.

This study was designed to determine if teachers in one public school in Virginia were prepared to be evaluated based on culturally responsive practices (CRP) after completing Virginia Department of Education's (VDOE) Cultural Competency Training Module. This qualitative study sample included eight teachers from a suburban school division. The conceptual framework illustrated the connections between the evaluation of CRP and teacher preparedness after teachers completed VDOE's Cultural Competency Training Module. The research questions that directed this study were: (1) How has Virginia Department of Education's Cultural Competency Training Module prepared teachers to implement culturally responsive practices? (2) To what extent do teachers feel prepared to be evaluated based on culturally responsive practices after completing Virginia Department of Education's Cultural Competency Training Module? The research method included a basic qualitative research design that used interview protocol. Interview prompts were created based on Virginia's Cultural Competency Domains that underpin legislation approved by the 2021 Virginia General Assembly requiring that teacher evaluations include a standard for CRP. Interviews took place during the summer months of 2023 as virtual meetings using the Zoom video conferencing platform. Interview transcriptions were utilized as the data set. As categories and themes emerged, the interconnectedness of data was examined using open coding. The findings of this study revealed that teachers indicated a support for Virginia's Cultural Competency Domains. However, teachers perceived that VDOE's Cultural Competency Training Module did not achieve the desired focus of providing educators with the tools needed to implement CRP. Instead, teachers perceived that their lived experiences framed their individual approach to understand and implement CRP. The implications of the study encouraged VDOE to consider a redesign of the Cultural Competency Training Module. Another implication emphasized the need for school divisions to consider investing in professional trainers to provide deep level culturally competency training in a format that also accounts for the emotional security and comfortability of teachers. / Doctor of Education / This study was designed to determine if teachers in one public school in Virginia were prepared to be evaluated based on culturally responsive practices (CRP) after completing Virginia Department of Education's (VDOE) Cultural Competency Training Module. This study included eight teachers from a suburban school division. The conceptual framework illustrated the connections between the evaluation of CRP and teacher preparedness after teachers completed VDOE's Cultural Competency Training Module. The research questions that directed this study were: (1) How has Virginia Department of Education's Cultural Competency Training Module prepared teachers to implement culturally responsive practices? (2) To what extent do teachers feel prepared to be evaluated based on culturally responsive practices after completing Virginia Department of Education's Cultural Competency Training Module? The research method included teacher interviews. Interview prompts were created based on Virginia's Cultural Competency Domains that reinforced legislation approved by the 2021 Virginia General Assembly requiring that teacher evaluations include a standard for CRP. Interviews took place during the summer months of 2023 as virtual meetings using the Zoom video conferencing platform. Interview transcriptions were utilized as the data for the study. As categories and themes emerged from interview responses, the connection of data was examined. The findings of this study revealed that teachers indicated a support for Virginia's Cultural Competency Domains. However, teachers perceived that VDOE's Cultural Competency Training did not achieve the desired focus of providing educators with the tools needed to implement CRP. Instead, teachers perceived that their lived experiences framed their individual approach to understand and implement CRP. An implication of the study encouraged VDOE to consider a redesign of the Cultural Competency Training Module. Another implication emphasized the need for school divisions to consider investing in professional trainers to provide deep level culturally competency training in a format that also accounts for the emotional security and comfortability of teachers.