Previous research indicates that pre- and in-service teachers are not receiving adequate training to implement data-informed instructional decision making. This is problematic given the promise this decision making process holds for improving instruction and student learning. At the same time, many educators do not see the value of different types of assessment data (e.g. accountability data), and lack the knowledge, skills, and confidence to use available data to guide instructional decisions. The purpose of this study was to conduct a formative evaluation of an online training designed to improve Iowa pre- and in-service teachers’ perceptions about data, data knowledge, skills and confidence working with data. The training along with a data literacy test was administered online to 29 pre-service teachers from two Iowa universities. A pre-post design was used to assess changes in these data constructs. Results indicated that participants’ perceptions about external accountability data improved significantly after completing the training, as did their confidence working with data. However, most participants’ data performance were relatively stable pre-post training. A content analysis of responses pre-post revealed qualitative changes in some participants’ thinking about data. Participants rated the value, effectiveness and quality of the training and complementary materials. Ratings were mostly positive, with participants signifying the training and materials as valuable and effective for enhancing their understanding of data as well as their confidence working with data. Participants also identified opportunities for improving the training. The author concludes with a discussion of the results, implications for future research, and how the study adds to the existing literature and informs practice.

abstract: A core reform area of President Obama’s Race to the Top (RTT) framework, the Statewide Longitudinal Data Systems (SLDS) program, offered funding to states for the development of their own data systems. As a result, Arizona received funding to build a longitudinal student data system. However the targeted audience—teachers—needed training to move from a state of ‘data rich but information poor’ to one of developing actionable knowledge. In this mixed methods action research study, six teachers from three schools participated in job-embedded data-informed decision making (DIDM) and root cause analysis (RCA) professional development to improve their abilities to employ DIDM and RCA strategies to determine root causes for student achievement gaps. This study was based on the theories of situated learning, specifically the concept of communities of practice (CoP), change theory, and the Concerns-Based Adoption Model (CBAM). Because teachers comprise most of the workforce in a district, it is important to encourage them to shift from working in isolation to effectively implement and sustain changes in practice. To address this concern, an online wiki provided an avenue for participants to interact, reflect, and share experiences across schools as they engaged in the application of new learning. The results from this ten-week study indicated an increase in participant readiness levels to: (a) use and manage data sources, (b) apply strategies, and (c) collaborate with others to solve problems of practice. Results also showed that participants engaged in collaborative conversation using the online wiki when they wanted to share concerns or gain further information to make decisions. The online collaboration results indicated higher levels of online discussion occurred when participants were attempting to solve a problem of practice during the learning process. Overall, participants (a) used collaborative strategies to seek, create, and/or utilize multiple sources of data, not just student learning data, (b) worked through implementation challenges when making changes in practice, and (c) sought further types of data collection to inform their decisions about root causes. Implications from this study warrant further investigation into the use of an online CoP as an avenue for increasing teacher collaboration across schools. / Dissertation/Thesis / Doctoral Dissertation Leadership and Innovation 2016

abstract: Data and the use of data to make educational decisions have attained new-found prominence in K-12 education following the inception of high-stakes testing and subsequent linking of teacher evaluations and teacher-performance pay to students' outcomes on standardized assessments. Although the research literature suggested students' academic performance benefits were derived from employing data-informed decision making (DIDM), many educators have not felt efficacious about implementing and using DIDM practices. Additionally, the literature suggested a five-factor model of teachers' efficacy and anxiety with respect to using DIDM practices: (a) identification of relevant information, (b) interpretation of relevant information, (c) application of interpretations of data to their classroom practices, (d) requisite technological skills, and (e) comfort with data and statistics. This action research study was designed to augment a program of support focused on DIDM, which was being offered at a K-8 charter school in Arizona. It sought to better understand the relation between participation in professional development (PD) modules and teachers' self-efficacy for using DIDM practices. It provided an online PD component, in which 19 kindergarten through 8th-grade teachers worked through three self-guided online learning modules, focused sequentially on (a) identification of relevant student data, (b) interpretation of relevant student data, and (c) application of interpretations of data to classroom practices. Each module concluded with an in-person reflection session, in which teachers shared artifacts they developed based on the modules, discussed challenges, shared solutions, and considered applications to their classrooms. Results of quantitative data from pre- and post-intervention assessments, suggested the intervention positively influenced participants' self-efficacy for (a) identifying and (b) interpreting relevant student data. Qualitative results from eight semi-structured interviews conducted at the conclusion of the intervention indicated that teachers, regardless of previous experience using data, viewed DIDM favorably and were more able to find and draw conclusions from their data than they were prior to the intervention. The quantitative and qualitative data exhibited complementarity pointing to the same conclusions. The discussion focused on explaining how the intervention influenced participants' self-efficacy for using DIDM practices, anxiety around using DIDM practices, and use of DIDM practices. / Dissertation/Thesis / Doctoral Dissertation Leadership and Innovation 2017