The primary purpose of this study was to examine the current practice of the superintendent’s evaluation process in three public school districts in Texas. This study collected information about current criteria used, the process as described by superintendents and school board presidents, and their perceptions regarding the effectiveness of the instrument used to measure the performance of the superintendent. A qualitative case study research approach was used to provide the researcher with rich, in-depth, relevant data. The researcher conducted multiple interviews of three superintendents and school board presidents in public school districts in Education Service Region IV of Texas. Additional data was gathered through documents and a reflective journal. There were six themes that emerged from data collected regarding superintendent evaluation: timing, rating, alignment, relationships, performance-based evaluation, and local control. The participating district modified and adjusted criteria and the process to align with the district context to more closely measure the school districts goals and priorities. The perspectives of superintendents and school board members offer insight into the process and struggles that each has with the overwhelming nature of the job of measuring the performance of the superintendent. / text

The purpose of the present study was to determine whether expert evaluators' assessments of teachers vary between observations of rehearsal frames that demonstrate effective student behavior change and observations of full rehearsals. Ten experienced evaluators rated 12 music teachers on 10 criteria. The evaluators first observed brief video recordings of two rehearsal frames (RF) of each teacher and then a recording of a full rehearsal (FV) taught by the same teacher. The evaluators rated the teachers on all 10 criteria following each observation. Evaluators in the present study tended to rate teachers more highly and express greater confidence in their ratings in the FV condition than in the RF condition. These differences indicate that observing brief video episodes of teaching does not lead to the same ratings of teacher effectiveness as does observing video recordings of full rehearsals. The differences between the two conditions were larger in terms of evaluator confidence (29% higher confidence ratings in the FV condition) than in terms of ratings of teacher effectiveness (7% higher ratings in the FV condition). Although all teachers were rated more highly overall in the FV condition than in the RF condition, the differences between the two conditions were small and varied considerably among teachers and among evaluators. / text

published_or_final_version / Medical Sciences / Master / Master of Medical Sciences

published_or_final_version / Medical Sciences / Master / Master of Medical Sciences

published_or_final_version / Surgery / Master / Master of Medical Sciences

Computer benchmarking involves running a set of benchmark programs to measure performance of a computer system. Modern benchmarks are developed from real applications. Applications are becoming complex and hence modern benchmarks run for a very long time. These benchmarks are also used for performance evaluation in the early design phase of microprocessors. Due to the size of benchmarks and increase in complexity of microprocessor design, the effort required for performance evaluation has increased significantly. This dissertation proposes methodologies to reduce the effort of benchmarking and performance evaluation of computer systems. Identifying a set of programs that can be used in the process of benchmarking can be very challenging. A solution to this problem can start by identifying similarity between programs to capture the diversity in their behavior before they can be considered for benchmarking. The aim of this methodology is to identify redundancy in the set of benchmarks and find a subset of representative benchmarks with the least possible loss of information. This dissertation proposes the use of program characteristics which capture the performance behavior of programs and identifies representative benchmarks applicable over a wide range of system configurations. The use of benchmark subsetting has not been restricted to academic research. Recently, the SPEC CPU subcommittee used the information derived from measuring similarity based on program behavior characteristics between different benchmark candidates as one of the criteria for selecting the SPEC CPU2006 benchmarks. The information of similarity between programs can also be used to predict performance of an application when it is difficult to port the application on different platforms. This is a common problem when a customer wants to buy the best computer system for his application. Performance of a customer's application on a particular system can be predicted using the performance scores of the standard benchmarks on that system and the similarity information between the application and the benchmarks. Similarity between programs is quantified by the distance between them in the space of the measured characteristics, and is appropriately used to predict performance of a new application using the performance scores of its neighbors in the workload space. / text

This study examined the moderating effects of teachers' implementation of a research-based comprehension intervention on a related student outcome. In addition to looking at the utility of including implementation data in a model of student outcomes, the stability of implementation ratings across occasions and the relationship between two implementation data sources (teacher logs and researcher ratings) were examined. The program featured in the study consisted of research-based comprehension strategy instruction implemented in 4th grade classrooms during social studies. Two measures of implementation -- fidelity and overall instructional quality -- did not predict student outcomes. In the tested model, a student's comprehension skills upon entering 4th grade did more to predict post-intervention comprehension achievement than did the teacher's instructional practices. Secondary analyses showed that an overall measure of teacher quality appears to be relatively reliable across only a few measurement occasions. Fidelity scores were less stable across occasions. The alternative method of collecting implementation data used in this study (audio recordings) appears to offer a viable and less costly means of obtaining implementation data. In addition, when measured at a macro level, implementation fidelity data from two sources (teacher logs and researcher ratings) were moderately correlated. Results inform future theory-driven evaluation activities by providing information on approaching the task of documenting implementation and using that information to understand program outcomes.

Not available / text

E-health is an emerging field in the intersection of information systems, healthcare and business management, referring mainly to healthcare services delivered and enhanced through the use of information and communication technologies (ICT). In a broader sense, the term characterizes not only a technical development, but also a wider way of thinking, an attitude, and a commitment for a network to improve and connect provider, patients and governments. Such a network will be used to educate and inform healthcare professionals, managers and healthcare users; to stimulate innovation in care delivery and health system management; and to improve the healthcare system locally, regionally, and globally. The evaluation of e-health services in both theory and practice has proved to be important and complex. E-health evaluation will help achieve better user services utilization, justify the enormous investments of governments on delivering e-health services, and address the aspects that are hampering healthcare services from embracing the full potential of ICT towards successful e-health initiatives. The complexity of evaluation is mostly due to the challenges faced at the intersection of three areas, each well-known for its complexity; healthcare services, information systems, and evaluation methodologies. However, despite the importance of the evaluation of e-health services, literature shows that e-health evaluation is still in its infancy in terms of development and management. The aim of this research study is to develop, and assess a cross disciplinary evaluation framework for e-health services and to propose evaluation criteria for better user’s utilization and satisfaction of e-health services. The evaluation framework is criteria based, while the criteria are determined by an evaluation matrix of three elements, the evaluation rationales, the evaluation timeframes, and the evaluation stakeholders. The evaluation criteria have to be multi-dimensional as well as grounded in, or derived from, one or more specific perspectives or theories. The framework is designed to deal effectively with the challenges of e-health evaluation and overcome the limitation of existing evaluation frameworks. The cross disciplinary evaluation framework has been examined and validated by adopting an interpretive case study methodology. The chosen case study is NHS direct which is currently one of the largest e-health services in the world. The data collection process has been carried out by using three research methods; archival records, documentation analysis and semi-structured interviews. The use of multiple methods is essential to generate comparable data patterns and structures, and enhance the reliability of conclusions through data triangulation. The contribution of the research study is in bridging the gap between the theory and practice in the evaluation of e-health services by providing an efficient evaluation framework that can be applied to a wide range of e-health application and able to answer real-world concerns. The study also offers three sets of well-argued and balanced hierarchies of evaluation criteria that influence user’s utilization and satisfaction of e-health services. The evaluation criteria can be used to help achieve better user services utilization, to serve as part of e-health evaluation framework, and to address areas that require further attention in the development of future e-health initiatives.

<p> The purpose of this study was to ascertain whether the adoption of Open Educational Resources had a significant effect on student learning outcomes in seven courses taught at seven post-secondary institutions. The use of open educational resources (OER) is increasing in the United States. Initiatives focusing on expanding the use of OER as a replacement for traditional textbooks at the post-secondary level include OpenStax, Project Kaleidoscope, Open Course Library, and others. While researchers have begun to explore OER, few have sought to evaluate the quality of OER as a function of student academic success. In this dissertation, I examined measures of student success in seven courses at seven different early-adopters of Project Kaleidoscope where faculty members chose to adopt OER to replace traditional textbooks. The sample for this study consisted of students using open textbooks in courses at seven Project Kaleidoscope post-secondary institutions, as well as a control group of students at those same institutions who used traditional textbooks in sections of the same courses. I used an ex-post-facto quasi-experimental design, in which I compared students using OER to students using traditional textbooks in comparable courses. In order to control for the threat of selection bias, I used propensity score matching (PSM) to match treatment and control groups on a set of demographic variables. After creating matched treatment and control groups, I used multiple regression and logistic regression to examine whether textbook selection predicts a measurable difference in student achievement after accounting for relevant covariates. </p><p> I found that students using open textbooks earned, on average, lower grades than students who used traditional textbooks, after controlling for student-level and course-level covariates. Further analysis revealed that this negative differential was isolated to students in business and psychology classes. I also found that students who used open textbooks enrolled in more credits than students using traditional textbooks, controlling for relevant covariates. Because of the finding of a variation in textbook effect from course to course, future studies may seek to understand the effects of particular OER adoption instances rather than the global effect of OER adoption.</p>