Companies today experience problems with poor data quality in their systems. Because of the enormous amount of data in companies, the data has to be of good quality if companies want to take advantage of it. Since the purpose with a data warehouse is to gather information from several databases for decision support, it is absolutely vital that data is of good quality. There exists several ways of determining or classifying data quality in databases. In this work the data quality management in a large Swedish company's data warehouse is examined, through a case study, using a framework specialized for data warehouses. The quality of data is examined from syntactic, semantic and pragmatic point of view. The results of the examination is then compared with a similar case study previously conducted in order to find any differences and similarities.

In this report a method is applied that was originally developed for the creation of evaluation frameworks for CASE-tools. Here the method is taken out of its original context and applied for the creation of an evaluation framework for database design transformation in CASE-tools. The focus of this report is on the process of creating the framework and not on the resulting framework. The creation of the framework is divided into two main processes. During phase1 a framework is developed from existing literature. This framework is then refined in phase 2 when the framework is tested in an in-depth exploratory study of support for design transformation in two commercial CASE-tools.

There exist several methods, which can be used for evaluation of commercially available CASE-tools. Each method has its own focus and is based on specific underlying assumptions. There have been attempts to standardise evaluation of CASE-tools; however available methods differs much from each other. One such method, named the 2G method has been proposed, which for each application, will establish a specific evaluation framework. This framework is tailored to the organisation at a specific point in time (since an organisation will change over time). The method consists of two phases which are iterated a sufficient number of times before a stable evaluation framework will be the result. The 2G method has been successfully applied on several applications in different organisations, though only for evaluation of CASE-tools before adoption. In this dissertation we report on an application of the 2G method, which aims to evaluate a CASE-tool from a company context which has already adopted a CASE-tool. As part of this method application the 2G method has also been transferred to the organisation. An additional issue this dissertation addresses is what kind of support a general Qualitative Research Tool will offer a method user when using the tool in a 2G method application. Likewise the goal includes to establish is what is poorly or unsupported in such tool in a 2G application. This dissertation will show that the 2G method is applicable also in a scenario where a CASE-tool has already been adopted, and therefore demonstrate that the method also is useful in evaluation studies performed after a CASE-tool has been adopted in an organisation. From the experiences of the application points will be made concerning what kind of support one would like to have in a qualitative research tool to simplify the work during the 2G applications.

This study aims to evaluate the use of the method Information Demand Analysis (henceforth IDA) against an analysis tool. To gain empirical understanding of IDA, the method will be applied to a cooperation process between two business organisations. The research questions of the study are to investigate what can be required of a method, to identify the information demand for the above mentioned cooperation process, and to identify the strengths and weaknesses of the use of IDA. Based on a literature study an evaluation framework, which describes what can be required of a method, was developed. The evaluation framework resulted in an analysis tool, which consists of the elements: method content, method user, method context, method validation, the method creator’s requirements, and the wishes and expectations of the business organisations. The use of IDA implied scoping to delimit the problem situation and a workshop to identify the information demand. In order to gain an understanding of the use of the method IDA, and to identify the information demand, the method was applied to a cooperation process between Steel AB and Wood AB. The information demand was later represented in Extended Enterprise Modelling Language (henceforth EEML). Finally, we analysed if and how the elements in the analysis tool were reflected in IDA and identified the strengths and weaknesses of the use of the method. The strengths of IDA are that it is general and applicable on different types of business organisations. Furthermore, it has well defined concepts and the possibility of selecting appropriate concepts ensures that it is applicable on different problem situations. The business organisations, which participated in the workshop, found that IDA resulted in a holistic view and increased the understanding for each other. The weaknesses of IDA are lack of documentation of explicitly defined steps, the implications for selecting certain concepts, guidance, and explicitly described notations. Concerning the involved roles, in IDA, we request a description of them, their responsibilities, and the needed knowledge sets and skills for using the method. Since IDA still is under development we had difficulties understanding how our outcome of the method should fulfil the purpose of IDA.

User studies play a vital role in data visualization research because they help measure the strengths and weaknesses of different visualization techniques quantitatively. In addition, they provide insight into what makes one technique more effective than another; and they are used to validate research contributions in the field of information visualization. For example, a new algorithm, visual encoding, or interaction technique is not considered a contribution unless it has been validated to be better than the state of the art and its competing alternatives or has been validated to be useful to intended users. However, conducting user studies is challenging, time consuming, and expensive. User studies generally requires careful experimental designs, iterative refinement, recruitment of study participants, careful management of participants during the run of the studies, accurately collecting user responses, and expertise in statistical analysis of study results. There are several variables that are taken into consideration which can impact user study outcome if not carefully managed. Hence the process of conducting user studies successfully can take several weeks to months. In this dissertation, we investigated how to design an online framework that can reduce the overhead involved in conducting controlled user studies involving web-based visualizations. Our main goal in this research was to lower the overhead of evaluating data visualizations quantitatively through user studies. To this end, we leveraged current research opportunities to provide a framework design that reduces the overhead involved in designing and running controlled user studies of data visualizations. Specifically, we explored the design and implementation of an open-source framework and an online service (VisUnit) that allows visualization designers to easily configure user studies for their web-based data visualizations, deploy user studies online, collect user responses, and analyze incoming results automatically. This allows evaluations to be done more easily, cheaply, and frequently to rapidly test hypotheses about visualization designs. We evaluated the effectiveness of our framework (VisUnit) by showing that it can be used to replicate 84% of 101 controlled user studies published in IEEE Information Visualization conferences between 1995 and 2015. We evaluated the efficiency of VisUnit by showing that graduate students can use it to design sample user studies in less than an hour. Our contributions are two-fold: first, we contribute a flexible design and implementation that facilitates the creation of a wide range of user studies with limited effort; second, we provide an evaluation of our design that shows that it can be used to replicate a wide range of user studies, can be used to reduce the time evaluators spend on user studies, and can be used to support new research.

The aim of this study was to investigate the influence of GeoGebra training on teachers and learners in rural geometry classrooms. The conceptual framework that was used in this study was based on the four-level training evaluation framework of Kirkpatrick (1996), focusing on the first three levels only while the fourth level was not considered. The study was conducted in disadvantaged and under-resourced schools situated in the Mpumalanga Province of South Africa. This undertaking was considered as a way of promoting what was perceived as a simple but effective method of teaching and learning with technology. The technology-enhanced teaching strategy was employed with the anticipation of enhancing the development of geometrical concepts that are seen as too abstract by the majority of learners in resource-constrained areas. Hence, the focus of this study was on the teaching and learning of the properties of triangles and the properties of quadrilaterals in Grade 10 using GeoGebra and traditional methods. Within the non-equivalent, quasi-experimental design, both qualitative and quantitative approaches were used. Four purposively sampled Grade 10 teachers from four schools and their classes comprising of 165 learners participated. The data collection involved pre- and post-tests, questionnaires, lesson observations, and interviews. Learners’ achievement was measured by outcomes obtained from marked and recorded achievements tests. The qualitative data collected from the teachers through questionnaires, lesson observations and interviews were coded and categorised into themes. This analysis revealed that most participants had positive training experiences and preferred using GeoGebra in the teaching and learning of geometry despite a lack of resources in their schools. The findings also showed that there was lack of training workshops that focused on appropriate teachers` knowledge and skills that are connected to technological innovations, particularly in GeoGebra. The quantitative data analysis results showed a significant difference in the mean scores for both groups respectively in favour of learners taught with GeoGebra compared to a chalk and talk method. The teachers’ implementation of and enthusiasm about GeoGebra had a positive influence on learner achievement. Based on the results, it was concluded that as a pedagogical tool, GeoGebra can work effectively in rural schools where geometry is hardly taught. / Thesis (PhD)--University of Pretoria, 2020. / Science, Mathematics and Technology Education / PhD / Unrestricted

This dissertation reports an evaluation study which was done with an educational programme for Automotive Service Technicians which was adapted for South African conditions and derived from a programme used internationally, and originally developed in Schweinfurt, Germany in 2005. The programme was designed to answer to particular problems experienced during automotive driveline-component installations. Since the inception of this programme, ZF Germany had been training representatives from their different subsidiaries over the world on the essential elements of automotive driveline installation protocol. The representatives were trained to adapt the core programme in accordance with the particulars of the vehicle populations in each respective country, and the researcher has performed this task The aim of this research was to evaluate the effectiveness of one particular module known as “Guidelines to clutch replacement” with regard to bringing about the desired changes in knowledge, attitude and behaviour within the trainees. Previous anecdotal feedback from the industry had suggested that the programme had been helpful in the reduction of installation errors, but the extent of the successes and failures of the programme had been unknown until this study. The training department at ZF South Africa was tasked to design further training modules based on the findings of the module under study in order to establish the successes and failures of the core concept for improvement of successive programmes. The approach for this programme evaluation was utilization-focused which allowed the researcher to choose from and combine a variety of data collection strategies over the complete range of summative and formative evaluation approaches. However, in keeping with the stated aim of this study, this study had been limited to a summative inquiry by employing a quantitative data collection strategy at the hand of a quasi-experimental research design. This research report presents the findings of a one-day intervention programme that was offered to Automotive Service Technicians in the Gauteng area. The conceptual framework that was adopted for the research was based on the four level evaluation framework of Kirkpatrick (1998) with the first three levels having been empirically tested and the fourth level discussed on the basis of empirical information. Findings suggest that although the levels of knowledge-acquisition could not to be considered as high, behaviour modification had indeed been observed to be in alignment with the clutch-installation-protocol and almost all the respondents had adopted the protocol as their preferred way of executing clutch installations. In addition, most respondents found the programme to be pleasant and of a high utility value. Certain problems with the programme became evident, such as the pace having been too fast; printed hand-outs were not considered to have high utility value, and sensitivity to personal and cultural differences were found to be lacking. The low levels recorded for knowledge acquisition may be language related which possibly relates to the fast pace of the course. The research findings suggest that the course should be spread over two days instead of one day and be augmented with practical demonstrations and re-designed printed hand-outs. In order to effectively measure level four of the Kirkpatrick framework, criteria of concern should be negotiated with participating organisations in order to provide relative data for answering research questions on this level. Procedures for collecting data over the course of several years need to be established and agreed upon by all stakeholders for such data to be reliable and valid in the inclusion of a time-series study. Regarding a relatively simple programme such as the programme under study with programme objectives that have a predominant procedural-knowledge focus, the Kirkpatrick framework has been found to be effective and its procedures may be applied in other industry-based training programmes. An added academic contribution to the previous one is that the Kirkpatrick framework as utilised in this study has shown that the framework offers a high utility value for fast-paced short courses where contact time with trainees are limited and evaluation designs need to fit in with the practical limitations. The high utility value of the Kirkpatrick framework became evident in the findings of this study where transfer of learning had evidently taken place regardless of possible learning problems such as language barriers. / Dissertation (MEd)--University of Pretoria, 2014. / tm2015 / Science, Mathematics and Technology Education / MEd / Unrestricted

There are growing concerns about quality of education in schools in many countries, and education systems implement mechanisms like school inspection, an external education quality assurance measure, to evaluate their education. Realising that effective improvement of education quality may be achieved from within rather than from outside, many education systems are adopting School Self-Evaluation (SSE), an internal evaluation process, to evaluate quality of education. This study attempted to identify the characteristics of effective SSE frameworks in order to develop one for Zimbabwean primary schools. The study utilised exemplary frameworks as facilitators for introducing SSE practices in Zimbabwe and was guided by the following question: What are the characteristics of an effective SSE framework for improving classroom quality in Zimbabwean primary schools? The study espoused design research approach which aims to provide solutions to various education problems. The study comprised three phases, the preliminary phase which included a literature review and a needs analysis with the former aimed to gain insight into the efficacy of SSE in evaluating quality of education. The needs analysis sought to establish how education is evaluated in Zimbabwean primary schools. The second, the prototyping phase, involved developing and formatively evaluating various prototypes. The last phase, a semi-summative evaluation, involved field-testing and appraisal of the intervention. Interviews and questionnaires were used to collect data. Six design principles were generated with the main ones being to engage stakeholders in developing SSE frameworks, to agree on the need for SSE initiative and to define the quality indicators in context. The main characteristics of the SSE framework were that it should have a clear purpose, be context specific, and should focus on what is essential for education. The main conclusion of the study is that there are no clear policy guidelines for Zimbabwean primary schools, coupled with lack of SSE instruments, to engage in self-evaluation of quality of education and therefore, no meaningful SSE takes place. An SSE framework with procedural guidelines developed in this research appears to be relevant, feasible and is expected to be effective for use in Zimbabwean primary schools. Some recommendations were made in order to improve Zimbabwe‟s quality of education. / Thesis (PhD)--University of Pretoria, 2015. / Centre for Evaluation and Assessment (CEA) / University of Pretoria / Science, Mathematics and Technology Education / PhD / Unrestricted

The impacts of climate change have resulted in the need for adaptation tools to provide stakeholders with the ability to respond to a broad range of potential impacts. Geovisualizations serve as powerful engagement tools due to their capacity in communicating complex climate data to various audiences. Studies have shown a preference towards conveying climate data through geo-visual representations, to quickly present ideas rooted in geographical challenges and solutions. However, a rapid pace of technological advancements has paved the way for an abundance of geovisualization products that have eclipsed the necessary theoretical inquiry and knowledge required to establish effective visualization principles. This study addresses this research gap by conducting a structured review of the geovisualization for climate change literature, and creating a conceptual framework that classifies existing geovisualization products into themes relating to visualization features, audiences, and the intended outcome or purpose of the visualization medium. The Climate Visualizations for Adaptation Products (CVAP) framework, is a tool for researchers and practitioners to use as a decision support system to discern an appropriate type of geovisualization product to implement within a specific use case or towards a particular audience. The process of developing a geovisualization software tool for displaying sea ice probability (SIP) in Arctic regions is detailed, in the context of suggested best practices for web development. Challenges and opportunities encountered while adhering to the best practice protocols and guidelines are examined. A usability evaluation is suggested to assess the general user attitude towards a website or service. Finally a summary with conclusions and suggestions for future research are provided. / Graduate

The purpose of this quantitative study was to investigate the perceptions of K-12 teachers as they relate to the implementation of the Tennessee Educator Acceleration (TEAM) evaluation framework. Survey links were sent to 1,115 K-12 teachers from 4 Northeast Tennessee school districts. The survey achieved a 24% return rate for a total of 270 participants. The research evaluated K-12 teachers’ overall perceptions of the TEAM evaluation framework, their perceptions of changes to their lesson planning processes, their perceptions of changes in the use of instructional strategies in their classrooms, and their perceptions of changes in the amount of time needed to prepare lessons for instruction since the implementation of the TEAM evaluation framework. Data sources analyzed consisted of an online survey design using a 5-point Likert-type scale. There were 4 research questions included in this research each with a corresponding null hypothesis. Each research question was analyzed with a series of single sample t-tests with mid-point of the scale (3.0) as the test value representing neutrality. All data were analyzed at the .05 level of significance. Findings from the data indicated a significant difference in perceptions of teachers in 3 of 4 areas. First the planning process for their lessons was reported to be more structured and focused on the evaluation rubric. Next, the instructional strategies used in their lessons were reported as more focused on higher order thinking skills. And finally the time required to plan instruction had increased since the implementation of the TEAM framework.