The purpose of this study was to examine the potential for using propensity score-based matching methods to estimate teacher contributions to student learning. Value-added models are increasingly used in teacher accountability systems in the United States in spite of ongoing qualms about the validity of teacher quality estimates resulting from those models. Using a large national dataset, teacher effects were estimated for 435 teachers using both value-added and propensity score-based approaches. The two approaches resulted in teacher effect estimates that were moderately correlated, with propensity score-based estimates more highly correlating with the value-added estimates as the matching ratio was increased. For many teachers' students, finding a set of matched control students was impossible unless the set of matching variables was reduced. Results suggest that many teachers have classroom compositions that are unusual, making evaluation of the teachers' impacts on student outcomes problematic. It was also found that, while value-added estimates were relatively insensitive to covariate inclusion choices or method of effect estimation, propensity score-based estimates were somewhat sensitive. Propensity score-based teacher effect estimates offer promise both for better accounting for classroom composition and student background variables and for indicating when a teacher's context is unique with respect to those variables, making the teacher's impact challenging to evaluate.

The purpose of this study was to analyze the relationship that exists among instructional practice scores, value-added measures, and learning gains for the Large Urban School District (LUSD) among reading teachers in Grades 6-12 for the 2012-2013 school year. In addition, this study was also conducted to address the perceptions of secondary school principals and assistant principals regarding the relationship of the three variables and their relevance in making personnel decisions. Quantitative data were obtained from school district databases for observation scores, value-added measures, and standardized assessment achievement data to determine the relationship among the variables. In addition, a perception survey was completed by secondary school principals and assistant principals. With a sample size of 138, the survey yielded a return rate of 84%. The data were analyzed to determine actual relationships among instructional practice scores, value-added measures, and learning gains, as well as how the participants perceived each variable in isolation. The literature review supported the findings regarding the inflation of observation scores by school administrators. The only significant relationship (.48) existed between value-added measures and learning gains. Likewise, school leaders in the LUSD believed that their observations were important in analyzing the needs of their teachers and should be included in summative evaluations. Learning gains were supported by the participants more than instructional practice scores and value-added measures as evidence of effective instruction. The literature review revealed past program evaluation studies regarding the Florida Comprehensive Achievement Test (FCAT) as a valid measure for assessing grade level benchmarks. The information in this study is valuable and suggests that continued professional learning for school leaders regarding classroom observations to improve inter-rater reliability is needed. Likewise, school leaders would benefit from understanding the relationships that exist among instructional practice scores, value-added measures, and learning gains to drive conversations with teachers regarding rigorous instruction.

The focus of this research was to examine the initial year of implementation of the Marzano Teacher Evaluation Model and iObservation®tool (Learning Sciences International, 2012) as it related to student achievement in the School District of Osceola County, Florida and to determine if the Marzano model improved the ability to determine teacher effectiveness with more accuracy than previous models of teacher evaluation used in the school district. Twelve research questions guided this study concerning the relationship and predictability between the variables of teacher instructional practice scores, number of observations reported in the iObservation®tool, and student achievement in Grades 3-5 using reading and mathematics FCAT 2.0 DSS scores. Linear Regression analysis suggested that for Grade 3 reading and mathematics the instructional practice mean had statistical significance in predicting performance and was a strong predictor of Grade 3 FCAT reading and mathematics performance. Linear Regression analysis suggested that for Grade 3 reading and mathematics the instructional practice mean had statistical significance in predicting performance and was a strong predictor of Grade 3 FCAT reading and mathematics performance. Linear Regression analysis further suggested no statistical significance or predictability for Grades 4, 5 for instructional practice mean and Grades 3,4,5 for observation mean related to FCAT reading and mathematics performance. Caution should be used when attempting to interpret these findings, as this study was based solely on intitial year implemention data. Implications for practice are also discussed in this study.

The most known and widely used methods use cash flows and tangible assets to measure the impact of investments in the organization’s outputs. But in the last decade many newer organizations whose outputs are heavily dependent on information technology utilize knowledge as their main asset. These organizations’ market values lie on the knowledge of its employees and their technological capabilities. In the current technology-based business landscape the value added by assets utilized for generation of outputs cannot be appropriately measured and managed without considering the role that intangible assets and knowledge play in executing processes. The analysis of processes for comparison and decision making based on intangible value added can be accomplished using the knowledge required to execute processes. The measurement of value added by knowledge can provide a more realistic framework for analysis of processes where traditional cost methods are not appropriate, enabling managers to better allocate and control knowledge-based processes. Further consideration of interactions and complexity between proposed process alternatives can yield answers about where and when investments can improve value-added while dynamically providing higher returns on investment

Value-added models (VAMs) have become widely used in evaluating teacher accountability. The use of these models for high-stakes decisions making has been very controversial due to lack of consistency in classifying teachers as high performing or low performing. There is an abundance of research on the impact of various student level covariates on teacher value-added scores; however, less is known about the impact of teacher-level and school-level covariates. This study uses hierarchical linear modeling to examine the impact of including teacher characteristics, school characteristics, and student demographics aggregated at the school level on elementary mathematics and reading teacher value-added scores. Data for this study was collected from a large school district in north Texas. This study found that across all VAMs fitted, 32% of mathematics teachers and 37% of reading teachers changed quintile ranking for their value-added score at least once across all VAMs, while 55% and 65% of schools changed their quintile ranking of value-added scores based on mathematics and reading achievement, respectively. The results show that failing to control for aggregated student demographics has a large impact on both teacher level and school level value-added scores. Policymakers and administrators using VAM estimates in high-stakes decision-making should include teacher- and school-level covariates in their VAMs.

学位プログラム名: 京都大学大学院思修館 / 京都大学 / 新制・課程博士 / 博士(総合学術) / 甲第24949号 / 総総博第31号 / 新制||総総||5(附属図書館) / 京都大学大学院総合生存学館総合生存学専攻 / (主査)教授 池田 裕一, 教授 IALNAZOV Dimiter Savov, 准教授 関山 健, 安橋 正人 (奈良女子大学) / 学位規則第4条第1項該当 / Doctor of Philosophy / Kyoto University / DFAM

No description available.

No description available.

No description available.

No description available.