Educators are increasingly being asked to interact with data to facilitate students’ learning in the classroom. However, as an educational measurement community, we have little understanding of the factors and/or contexts that facilitate educators’ successful use of data. Educators’ use of score reports and the relationship to the intended use is integral to the concept of validity. A conceptual model, “Data Habit of Mind,” is proposed to study educators’ understanding, interpretation and potential applications of results from large-scale assessments. The metaphor, “Habit of Mind,” was originally coined by Robert Sternberg and Dan Keating, and has been applied in the education sector to describe educators’ habits of inquiry when interacting with assessments. Based on an extensive review of the literature, Data Habit of Mind is defined as a combination of statistical literacy and score report interpretation. Statistical literacy is the extent to which an individual is able to describe, organize and reduce, represent, and analyze and interpret data. Score report interpretation is the extent to which an individual is able to describe, summarize, question, and propose an application for a given set of elements on a score report. The combination of these two makes up an individual’s Data Habit of Mind. Twenty educators were interviewed to assess their level of statistical literacy and their score report interpretation skills. A cognitive interview approach was used to capture the educators’ cognitive processes as they solved performance-based tasks, and protocol analysis procedures were used to encode the responses into the conceptual model. Descriptions of educators’ Data Habit of Mind were then generated through qualitative matrix analysis. Four groups of educators were identified based on the patterns of relationship between their statistical literacy and score report interpretation scores. Demographic factors, including teaching experience, gender and educational background were not meaningful predictors of educators’ Data Habit of Mind. These results add to our understanding of how educators interpret and use test results and have implications for test validation processes.

The phrase "opportunities to learn" (OTL) is most commonly interpreted in institutional, or inter-individual, terms but it can also be viewed as a cognitive, or intra-individual, phenomenon. How student learning heterogeneity (LH) - learning differences manifested when children's understanding is later assessed - is understood varies by OTL interpretation. In this study, I argue that the cognitive underpinning of learning disability, learning difficulty, typical achievement, and gifted achievement in mathematics is not well understood in part because of the ambiguity of LH assumptions in previous studies. Data from 104,315 Ontario students who had responded to provincially-mandated mathematics tests in grades 3, 6, and 9 dataset were analyzed using latent trait analysis (LTM) and latent class analysis (LCA). The tests were constructed to distinguish four achievement levels per grade and, either five curriculum strands (grades 3 and 6), three strands (grade 9 applied) or four strands (grade 9 academic). Best-fitting LTM models reflected 3- or 4-factors (grade 9 applied and grades 3, 6, 9 academic, respectively). Best-fitting LCA solutions reflected 4- or 5-classes (grade 3, 6 and grade 9 applied, academic, respectively). There were differences in relative proportions of students who were distributed across levels and classes. Moreover, grade 9 models were more complex than the reported four achievement levels. To explore intrinsic modeled results further, latent factors were plotted against latent classes. Implications of institutional versus cognitive interpretations are discussed.

The aim of this thesis is to ascertain the degree to which high-stakes assessment for qualifications, such as New Zealand's National Certificate of Educational Achievement (NCEA), act as a barrier to secondary English teachers' use of information and communication technologies (ICTs) with their students. Although the focus is on high-stakes assessment for qualifications, other factors, which might also facilitate or hinder English teachers' use of ICTs, such as professional development and infrastructural, technical and access issues, are also considered. The literature review summarises the factors which tend to constrain or encourage teachers' use of ICTs, with a special focus on the considerable constraint placed on secondary teachers by their role in preparing and assessing students for high-stakes qualifications. The literature review also highlights the lack of convincing research into the impact on learning of ICTs but reveals that, in the subject English, there is some evidence of a positive impact when appropriate ICTs are used by well trained teachers in appropriate contexts. Key NCEA foundation and implementation documents and publicity, achievement standards and assessment activities were analysed to ascertain the degree of official endorsement for the use of ICTs in secondary schools and English programmes in particular. To gauge the perceptions of New Zealand English teachers about the constraints and encouragers of ICTs in their teaching, all NCEA level one English teachers were surveyed. This was followed by face-to-face and online focus groups in which trends revealed in the survey were explored. Document analysis revealed considerable official optimism that the flexibility and internal assessment of the NCEA would enable teachers to make greater use of ICTs. The achievement standards and supporting assessment activities however, tend to situate ICTs at the margins of English programmes as optional extras which, if used at all, tend to support current practice. The focus groups confirmed survey findings that, although English teachers are significant users of ICTs in their personal and professional lives, although they believe in the educational advantages of ICTs and although they work in schools and departments which support the classroom use of ICTs, they face significant constraints which prevent them making as much use of ICTs as they would like in their teaching. Most significant among these constraints is pressure of course coverage and lack of class time (largely attributable to the need to prepare students for high-stakes assessments). Other constraints include lack of adequate access to ICTs and technical support, and lack of appropriate professional development and time to learn about ICTs. Based on the literature review and research findings, recommendations are provided for schools, policy makers and researchers. Key among these is the need to acknowledge the profound influence of high-stakes qualifications on secondary schools and teachers and evolve such qualifications to encourage and enable desired innovations. It is recommended that ICTs could be infused into English and eventually, inter-disciplinary programmes, through the creation of innovative, ICT infused achievement standards which could be combined into flexibly structured courses which better meet the needs of twenty first century students. Also recommended are approaches which enable greater access to ICTs for English teachers and methods of professional development which have proved effective with adult learners. / Subscription resource available via Digital Dissertations only.

Teachers' conceptions are powerful in shaping the quality of their instructional practice. The purpose of this thesis is to defend a four-facet model of teachers' conceptions of assessment, which revolves around emphasising improvement or school accountability, or student accountability purposes or treating assessment as irrelevant. Further, it explores how those conceptions relate to teachers' conceptions of learning, teaching, curriculum, and teacher efficacy. A literature review is used to identify the major conceptions. Multiple studies led to a 50-item Teachers' Conceptions of Assessment (COA-III) questionnaire based on the four main conceptions of assessment. Structural equation modelling showed a close fit of a hierarchical, multi-dimensional model to the data. Teachers moderately agreed with the improvement conceptions and the system accountability conception. Teachers disagreed that assessment was irrelevant. However, teachers had little agreement that assessment was for student accountability. Improvement, school, and student accountability conceptions were positively correlated. The irrelevance conception was inversely related to the improvement conception and not related to the system accountability conception. A four-factor structure of teachers' beliefs about assessment, curriculum, teaching, learning, and teacher efficacy, was found. Teachers agreed that assessment influences and improves their teaching and student learning. They agreed less strongly that assessment, measuring surface learning only, makes schools, teachers, and students accountable and that teachers are able to conduct assessment through a systematic technological approach. They agreed at a similar level with student centred learning that involves deep approaches to learning, divorced from assessment. They disagreed with a telling type of teaching that focuses only on intellectual development of students or on reconstruction or reform of society. Use of the CoA-III makes teachers' conceptions of assessment more explicit and will assist in the development of teacher training programs, the design of assessment policy, and enhance further research into educational assessment practices. Furthermore, explicit attention to teachers' conceptions of assessment is expected to be a precursor to teachers' self-regulation of their assessment beliefs and practices.

The aim of this thesis is to ascertain the degree to which high-stakes assessment for qualifications, such as New Zealand's National Certificate of Educational Achievement (NCEA), act as a barrier to secondary English teachers' use of information and communication technologies (ICTs) with their students. Although the focus is on high-stakes assessment for qualifications, other factors, which might also facilitate or hinder English teachers' use of ICTs, such as professional development and infrastructural, technical and access issues, are also considered. The literature review summarises the factors which tend to constrain or encourage teachers' use of ICTs, with a special focus on the considerable constraint placed on secondary teachers by their role in preparing and assessing students for high-stakes qualifications. The literature review also highlights the lack of convincing research into the impact on learning of ICTs but reveals that, in the subject English, there is some evidence of a positive impact when appropriate ICTs are used by well trained teachers in appropriate contexts. Key NCEA foundation and implementation documents and publicity, achievement standards and assessment activities were analysed to ascertain the degree of official endorsement for the use of ICTs in secondary schools and English programmes in particular. To gauge the perceptions of New Zealand English teachers about the constraints and encouragers of ICTs in their teaching, all NCEA level one English teachers were surveyed. This was followed by face-to-face and online focus groups in which trends revealed in the survey were explored. Document analysis revealed considerable official optimism that the flexibility and internal assessment of the NCEA would enable teachers to make greater use of ICTs. The achievement standards and supporting assessment activities however, tend to situate ICTs at the margins of English programmes as optional extras which, if used at all, tend to support current practice. The focus groups confirmed survey findings that, although English teachers are significant users of ICTs in their personal and professional lives, although they believe in the educational advantages of ICTs and although they work in schools and departments which support the classroom use of ICTs, they face significant constraints which prevent them making as much use of ICTs as they would like in their teaching. Most significant among these constraints is pressure of course coverage and lack of class time (largely attributable to the need to prepare students for high-stakes assessments). Other constraints include lack of adequate access to ICTs and technical support, and lack of appropriate professional development and time to learn about ICTs. Based on the literature review and research findings, recommendations are provided for schools, policy makers and researchers. Key among these is the need to acknowledge the profound influence of high-stakes qualifications on secondary schools and teachers and evolve such qualifications to encourage and enable desired innovations. It is recommended that ICTs could be infused into English and eventually, inter-disciplinary programmes, through the creation of innovative, ICT infused achievement standards which could be combined into flexibly structured courses which better meet the needs of twenty first century students. Also recommended are approaches which enable greater access to ICTs for English teachers and methods of professional development which have proved effective with adult learners. / Subscription resource available via Digital Dissertations only.

Teachers' conceptions are powerful in shaping the quality of their instructional practice. The purpose of this thesis is to defend a four-facet model of teachers' conceptions of assessment, which revolves around emphasising improvement or school accountability, or student accountability purposes or treating assessment as irrelevant. Further, it explores how those conceptions relate to teachers' conceptions of learning, teaching, curriculum, and teacher efficacy. A literature review is used to identify the major conceptions. Multiple studies led to a 50-item Teachers' Conceptions of Assessment (COA-III) questionnaire based on the four main conceptions of assessment. Structural equation modelling showed a close fit of a hierarchical, multi-dimensional model to the data. Teachers moderately agreed with the improvement conceptions and the system accountability conception. Teachers disagreed that assessment was irrelevant. However, teachers had little agreement that assessment was for student accountability. Improvement, school, and student accountability conceptions were positively correlated. The irrelevance conception was inversely related to the improvement conception and not related to the system accountability conception. A four-factor structure of teachers' beliefs about assessment, curriculum, teaching, learning, and teacher efficacy, was found. Teachers agreed that assessment influences and improves their teaching and student learning. They agreed less strongly that assessment, measuring surface learning only, makes schools, teachers, and students accountable and that teachers are able to conduct assessment through a systematic technological approach. They agreed at a similar level with student centred learning that involves deep approaches to learning, divorced from assessment. They disagreed with a telling type of teaching that focuses only on intellectual development of students or on reconstruction or reform of society. Use of the CoA-III makes teachers' conceptions of assessment more explicit and will assist in the development of teacher training programs, the design of assessment policy, and enhance further research into educational assessment practices. Furthermore, explicit attention to teachers' conceptions of assessment is expected to be a precursor to teachers' self-regulation of their assessment beliefs and practices.

The aim of this thesis is to ascertain the degree to which high-stakes assessment for qualifications, such as New Zealand's National Certificate of Educational Achievement (NCEA), act as a barrier to secondary English teachers' use of information and communication technologies (ICTs) with their students. Although the focus is on high-stakes assessment for qualifications, other factors, which might also facilitate or hinder English teachers' use of ICTs, such as professional development and infrastructural, technical and access issues, are also considered. The literature review summarises the factors which tend to constrain or encourage teachers' use of ICTs, with a special focus on the considerable constraint placed on secondary teachers by their role in preparing and assessing students for high-stakes qualifications. The literature review also highlights the lack of convincing research into the impact on learning of ICTs but reveals that, in the subject English, there is some evidence of a positive impact when appropriate ICTs are used by well trained teachers in appropriate contexts. Key NCEA foundation and implementation documents and publicity, achievement standards and assessment activities were analysed to ascertain the degree of official endorsement for the use of ICTs in secondary schools and English programmes in particular. To gauge the perceptions of New Zealand English teachers about the constraints and encouragers of ICTs in their teaching, all NCEA level one English teachers were surveyed. This was followed by face-to-face and online focus groups in which trends revealed in the survey were explored. Document analysis revealed considerable official optimism that the flexibility and internal assessment of the NCEA would enable teachers to make greater use of ICTs. The achievement standards and supporting assessment activities however, tend to situate ICTs at the margins of English programmes as optional extras which, if used at all, tend to support current practice. The focus groups confirmed survey findings that, although English teachers are significant users of ICTs in their personal and professional lives, although they believe in the educational advantages of ICTs and although they work in schools and departments which support the classroom use of ICTs, they face significant constraints which prevent them making as much use of ICTs as they would like in their teaching. Most significant among these constraints is pressure of course coverage and lack of class time (largely attributable to the need to prepare students for high-stakes assessments). Other constraints include lack of adequate access to ICTs and technical support, and lack of appropriate professional development and time to learn about ICTs. Based on the literature review and research findings, recommendations are provided for schools, policy makers and researchers. Key among these is the need to acknowledge the profound influence of high-stakes qualifications on secondary schools and teachers and evolve such qualifications to encourage and enable desired innovations. It is recommended that ICTs could be infused into English and eventually, inter-disciplinary programmes, through the creation of innovative, ICT infused achievement standards which could be combined into flexibly structured courses which better meet the needs of twenty first century students. Also recommended are approaches which enable greater access to ICTs for English teachers and methods of professional development which have proved effective with adult learners. / Subscription resource available via Digital Dissertations only.

Teachers' conceptions are powerful in shaping the quality of their instructional practice. The purpose of this thesis is to defend a four-facet model of teachers' conceptions of assessment, which revolves around emphasising improvement or school accountability, or student accountability purposes or treating assessment as irrelevant. Further, it explores how those conceptions relate to teachers' conceptions of learning, teaching, curriculum, and teacher efficacy. A literature review is used to identify the major conceptions. Multiple studies led to a 50-item Teachers' Conceptions of Assessment (COA-III) questionnaire based on the four main conceptions of assessment. Structural equation modelling showed a close fit of a hierarchical, multi-dimensional model to the data. Teachers moderately agreed with the improvement conceptions and the system accountability conception. Teachers disagreed that assessment was irrelevant. However, teachers had little agreement that assessment was for student accountability. Improvement, school, and student accountability conceptions were positively correlated. The irrelevance conception was inversely related to the improvement conception and not related to the system accountability conception. A four-factor structure of teachers' beliefs about assessment, curriculum, teaching, learning, and teacher efficacy, was found. Teachers agreed that assessment influences and improves their teaching and student learning. They agreed less strongly that assessment, measuring surface learning only, makes schools, teachers, and students accountable and that teachers are able to conduct assessment through a systematic technological approach. They agreed at a similar level with student centred learning that involves deep approaches to learning, divorced from assessment. They disagreed with a telling type of teaching that focuses only on intellectual development of students or on reconstruction or reform of society. Use of the CoA-III makes teachers' conceptions of assessment more explicit and will assist in the development of teacher training programs, the design of assessment policy, and enhance further research into educational assessment practices. Furthermore, explicit attention to teachers' conceptions of assessment is expected to be a precursor to teachers' self-regulation of their assessment beliefs and practices.

The aim of this thesis is to ascertain the degree to which high-stakes assessment for qualifications, such as New Zealand's National Certificate of Educational Achievement (NCEA), act as a barrier to secondary English teachers' use of information and communication technologies (ICTs) with their students. Although the focus is on high-stakes assessment for qualifications, other factors, which might also facilitate or hinder English teachers' use of ICTs, such as professional development and infrastructural, technical and access issues, are also considered. The literature review summarises the factors which tend to constrain or encourage teachers' use of ICTs, with a special focus on the considerable constraint placed on secondary teachers by their role in preparing and assessing students for high-stakes qualifications. The literature review also highlights the lack of convincing research into the impact on learning of ICTs but reveals that, in the subject English, there is some evidence of a positive impact when appropriate ICTs are used by well trained teachers in appropriate contexts. Key NCEA foundation and implementation documents and publicity, achievement standards and assessment activities were analysed to ascertain the degree of official endorsement for the use of ICTs in secondary schools and English programmes in particular. To gauge the perceptions of New Zealand English teachers about the constraints and encouragers of ICTs in their teaching, all NCEA level one English teachers were surveyed. This was followed by face-to-face and online focus groups in which trends revealed in the survey were explored. Document analysis revealed considerable official optimism that the flexibility and internal assessment of the NCEA would enable teachers to make greater use of ICTs. The achievement standards and supporting assessment activities however, tend to situate ICTs at the margins of English programmes as optional extras which, if used at all, tend to support current practice. The focus groups confirmed survey findings that, although English teachers are significant users of ICTs in their personal and professional lives, although they believe in the educational advantages of ICTs and although they work in schools and departments which support the classroom use of ICTs, they face significant constraints which prevent them making as much use of ICTs as they would like in their teaching. Most significant among these constraints is pressure of course coverage and lack of class time (largely attributable to the need to prepare students for high-stakes assessments). Other constraints include lack of adequate access to ICTs and technical support, and lack of appropriate professional development and time to learn about ICTs. Based on the literature review and research findings, recommendations are provided for schools, policy makers and researchers. Key among these is the need to acknowledge the profound influence of high-stakes qualifications on secondary schools and teachers and evolve such qualifications to encourage and enable desired innovations. It is recommended that ICTs could be infused into English and eventually, inter-disciplinary programmes, through the creation of innovative, ICT infused achievement standards which could be combined into flexibly structured courses which better meet the needs of twenty first century students. Also recommended are approaches which enable greater access to ICTs for English teachers and methods of professional development which have proved effective with adult learners. / Subscription resource available via Digital Dissertations only.

Teachers' conceptions are powerful in shaping the quality of their instructional practice. The purpose of this thesis is to defend a four-facet model of teachers' conceptions of assessment, which revolves around emphasising improvement or school accountability, or student accountability purposes or treating assessment as irrelevant. Further, it explores how those conceptions relate to teachers' conceptions of learning, teaching, curriculum, and teacher efficacy. A literature review is used to identify the major conceptions. Multiple studies led to a 50-item Teachers' Conceptions of Assessment (COA-III) questionnaire based on the four main conceptions of assessment. Structural equation modelling showed a close fit of a hierarchical, multi-dimensional model to the data. Teachers moderately agreed with the improvement conceptions and the system accountability conception. Teachers disagreed that assessment was irrelevant. However, teachers had little agreement that assessment was for student accountability. Improvement, school, and student accountability conceptions were positively correlated. The irrelevance conception was inversely related to the improvement conception and not related to the system accountability conception. A four-factor structure of teachers' beliefs about assessment, curriculum, teaching, learning, and teacher efficacy, was found. Teachers agreed that assessment influences and improves their teaching and student learning. They agreed less strongly that assessment, measuring surface learning only, makes schools, teachers, and students accountable and that teachers are able to conduct assessment through a systematic technological approach. They agreed at a similar level with student centred learning that involves deep approaches to learning, divorced from assessment. They disagreed with a telling type of teaching that focuses only on intellectual development of students or on reconstruction or reform of society. Use of the CoA-III makes teachers' conceptions of assessment more explicit and will assist in the development of teacher training programs, the design of assessment policy, and enhance further research into educational assessment practices. Furthermore, explicit attention to teachers' conceptions of assessment is expected to be a precursor to teachers' self-regulation of their assessment beliefs and practices.