Companies today experience problems with poor data quality in their systems. Because of the enormous amount of data in companies, the data has to be of good quality if companies want to take advantage of it. Since the purpose with a data warehouse is to gather information from several databases for decision support, it is absolutely vital that data is of good quality. There exists several ways of determining or classifying data quality in databases. In this work the data quality management in a large Swedish company's data warehouse is examined, through a case study, using a framework specialized for data warehouses. The quality of data is examined from syntactic, semantic and pragmatic point of view. The results of the examination is then compared with a similar case study previously conducted in order to find any differences and similarities.

In this report a method is applied that was originally developed for the creation of evaluation frameworks for CASE-tools. Here the method is taken out of its original context and applied for the creation of an evaluation framework for database design transformation in CASE-tools. The focus of this report is on the process of creating the framework and not on the resulting framework. The creation of the framework is divided into two main processes. During phase1 a framework is developed from existing literature. This framework is then refined in phase 2 when the framework is tested in an in-depth exploratory study of support for design transformation in two commercial CASE-tools.

There exist several methods, which can be used for evaluation of commercially available CASE-tools. Each method has its own focus and is based on specific underlying assumptions. There have been attempts to standardise evaluation of CASE-tools; however available methods differs much from each other. One such method, named the 2G method has been proposed, which for each application, will establish a specific evaluation framework. This framework is tailored to the organisation at a specific point in time (since an organisation will change over time). The method consists of two phases which are iterated a sufficient number of times before a stable evaluation framework will be the result. The 2G method has been successfully applied on several applications in different organisations, though only for evaluation of CASE-tools before adoption. In this dissertation we report on an application of the 2G method, which aims to evaluate a CASE-tool from a company context which has already adopted a CASE-tool. As part of this method application the 2G method has also been transferred to the organisation. An additional issue this dissertation addresses is what kind of support a general Qualitative Research Tool will offer a method user when using the tool in a 2G method application. Likewise the goal includes to establish is what is poorly or unsupported in such tool in a 2G application. This dissertation will show that the 2G method is applicable also in a scenario where a CASE-tool has already been adopted, and therefore demonstrate that the method also is useful in evaluation studies performed after a CASE-tool has been adopted in an organisation. From the experiences of the application points will be made concerning what kind of support one would like to have in a qualitative research tool to simplify the work during the 2G applications.

This study aims to evaluate the use of the method Information Demand Analysis (henceforth IDA) against an analysis tool. To gain empirical understanding of IDA, the method will be applied to a cooperation process between two business organisations. The research questions of the study are to investigate what can be required of a method, to identify the information demand for the above mentioned cooperation process, and to identify the strengths and weaknesses of the use of IDA. Based on a literature study an evaluation framework, which describes what can be required of a method, was developed. The evaluation framework resulted in an analysis tool, which consists of the elements: method content, method user, method context, method validation, the method creator’s requirements, and the wishes and expectations of the business organisations. The use of IDA implied scoping to delimit the problem situation and a workshop to identify the information demand. In order to gain an understanding of the use of the method IDA, and to identify the information demand, the method was applied to a cooperation process between Steel AB and Wood AB. The information demand was later represented in Extended Enterprise Modelling Language (henceforth EEML). Finally, we analysed if and how the elements in the analysis tool were reflected in IDA and identified the strengths and weaknesses of the use of the method. The strengths of IDA are that it is general and applicable on different types of business organisations. Furthermore, it has well defined concepts and the possibility of selecting appropriate concepts ensures that it is applicable on different problem situations. The business organisations, which participated in the workshop, found that IDA resulted in a holistic view and increased the understanding for each other. The weaknesses of IDA are lack of documentation of explicitly defined steps, the implications for selecting certain concepts, guidance, and explicitly described notations. Concerning the involved roles, in IDA, we request a description of them, their responsibilities, and the needed knowledge sets and skills for using the method. Since IDA still is under development we had difficulties understanding how our outcome of the method should fulfil the purpose of IDA.

User studies play a vital role in data visualization research because they help measure the strengths and weaknesses of different visualization techniques quantitatively. In addition, they provide insight into what makes one technique more effective than another; and they are used to validate research contributions in the field of information visualization. For example, a new algorithm, visual encoding, or interaction technique is not considered a contribution unless it has been validated to be better than the state of the art and its competing alternatives or has been validated to be useful to intended users. However, conducting user studies is challenging, time consuming, and expensive. User studies generally requires careful experimental designs, iterative refinement, recruitment of study participants, careful management of participants during the run of the studies, accurately collecting user responses, and expertise in statistical analysis of study results. There are several variables that are taken into consideration which can impact user study outcome if not carefully managed. Hence the process of conducting user studies successfully can take several weeks to months. In this dissertation, we investigated how to design an online framework that can reduce the overhead involved in conducting controlled user studies involving web-based visualizations. Our main goal in this research was to lower the overhead of evaluating data visualizations quantitatively through user studies. To this end, we leveraged current research opportunities to provide a framework design that reduces the overhead involved in designing and running controlled user studies of data visualizations. Specifically, we explored the design and implementation of an open-source framework and an online service (VisUnit) that allows visualization designers to easily configure user studies for their web-based data visualizations, deploy user studies online, collect user responses, and analyze incoming results automatically. This allows evaluations to be done more easily, cheaply, and frequently to rapidly test hypotheses about visualization designs. We evaluated the effectiveness of our framework (VisUnit) by showing that it can be used to replicate 84% of 101 controlled user studies published in IEEE Information Visualization conferences between 1995 and 2015. We evaluated the efficiency of VisUnit by showing that graduate students can use it to design sample user studies in less than an hour. Our contributions are two-fold: first, we contribute a flexible design and implementation that facilitates the creation of a wide range of user studies with limited effort; second, we provide an evaluation of our design that shows that it can be used to replicate a wide range of user studies, can be used to reduce the time evaluators spend on user studies, and can be used to support new research.

[EN] The increasing adoption of process-aware information systems (PAISs) together with the high variability in business processes has resulted in collections of process families. These families correspond to a business process model and its variants, which can comprise hundreds or thousands of different ways of realizing this process. Modeling and managing process variability in this context can be very challenging due to the size of these families. Motivated by this challenge, several approaches enabling process variability have been developed. However, with these approaches PAIS engineers usually are required to model and manage one by one all the elements of a process family and ensure its correctness by their own. This can be tedious and error-prone especially when a process family comprises hundreds or thousands of process variants. For example, variability may not be properly reflected since PAIS engineers need to be aware of each variation of each process variant. Thus, there is a need of methods that allow PAIS engineers to model process variability more explicitly, especially at a level of abstraction higher than the one provided by the existing process variability approaches. However, how process variability is represented in existing approaches becomes critical for these methods (e.g., what language constructs are used to model process variability). In this context, the use of modeling patterns (reusable solutions to a commonly occurring problem) is a promising way to address these issues. For example, patterns have been proved as an efficient solution to model individual business processes. The objective of this thesis is to enhance the modeling of variability in process families through change patterns. First, we conduct a systematic study to analyze existing process variability approaches regarding their expressiveness with respect to process variability modeling as well as their process support. Thus, we can identify how process variability is actually modeled by existing approaches (i.e., a core set of variability-specific language constructs). In addition, based on the obtained empirical evidence, we derive the VIVACE framework, a complete characterization of process variability which comprises also a core set of features fostering process variability. VIVACE enables PAIS engineers to evaluate existing process variability approaches as well as to select that variability approach meeting their requirements best. In addition, it helps process engineers in dealing with PAISs supporting process variability. Second, to facilitate variability modeling in process families, based on the identified language constructs, we present a set of 10 change patterns and show how they can be implemented in a process variability approach. In particular, these patterns support process family modeling and evolution and are able to ensure process family correctness. In order to prove their effectiveness and analyze their suitability, we applied these change patterns in a real scenario. More concretely, we conduct a case study with a safety standard with a high degree of variability. The case study results show that the application of the change patterns can reduce the effort for process family modeling in a 34% and for evolution in a 40%. In addition, we have analyzed how PAIS engineers apply the patterns and their perceptions of this application. Most of them expressed some benefit when applying the change patterns, did not perceived an increase of mental effort for applying the patterns, and agreed upon the usefulness and ease of use of the patterns. / [ES] La creciente adopción de sistemas de información dirigidos por procesos de negocio (PAIS) junto con la alta variabilidad en dichos procesos, han dado lugar a la aparición de colecciones de familias de procesos. Estas familias están constituidas por un modelo de proceso de negocio y sus variantes, las cuales pueden comprender entre cientos y miles de diferentes formas de llevar a cabo ese proceso. Gestionar la variabilidad en este contexto puede resultar muy difícil dado el tamaño que estas familias pueden alcanzar. Motivados por este desafío, se han desarrollado varias soluciones que permiten la gestión de la variabilidad en los procesos de negocio. Sin embargo, con estas soluciones los ingenieros deben crear y gestionar uno por uno todos los elementos de las familias de procesos y asegurar ellos mismos su corrección. Esto puede resultar tedioso y propenso a errores especialmente cuando las familias están compuestas de miles de variantes. Por ejemplo, la variabilidad puede no quedar adecuadamente representada ya que los ingenieros deben ser conscientes de todas y cada una de las variaciones de todas las variantes. Así, son necesarios nuevos métodos que permitan modelar la variabilidad de los procesos de una manera más explícita, a un nivel de abstracción más alto del proporcionado por las soluciones actuales. Sin embargo, cómo se representa la variabilidad en estos métodos resulta crítico (ej.: qué primitivas se utilizan). En este contexto, el uso de patrones de modelado (soluciones reutilizables a un problema recurrente) resultan un camino prometedor. Por ejemplo, los patrones han sido probados como una solución eficaz para gestionar procesos de negocio individuales. El objetivo de esta tesis es mejorar el modelado de la variabilidad en las familias de procesos a través del uso de patrones de cambio. En primer lugar, hemos llevado a cabo un estudio sistemático con el fin de analizar las soluciones existentes que permiten gestionar la variabilidad en los procesos, así como el soporte que estas proporcionan. Así, hemos sido capaces de identificar y analizar cuál es el conjunto básico de primitivas específicas para representar la variabilidad. Además, basándonos en la evidencia empírica obtenida, hemos derivado el marco de evaluación VIVACE, el cual recoge las primitivas de variabilidad y un conjunto básico de características que favorecen la variabilidad en los procesos. El principal objetivo de VIVACE es conformar una completa caracterización de la variabilidad en los procesos de negocio. Asimismo, VIVACE permite evaluar las soluciones que gestionan la variabilidad en los procesos, así como seleccionar la solución que se ajuste mejor a sus necesidades. Finalmente, VIVACE puede ayudar a los ingenieros a gestionar PAISs con variabilidad. En segundo lugar, para facilitar el modelado de la variabilidad en las familias de procesos, basándonos en las primitivas identificadas, hemos definido un conjunto de 10 patrones de cambio y hemos mostrado cómo estos patrones pueden ser implementados. En particular, estos patrones ayudan al modelado y la evolución de familias de procesos y son capaces de garantizar la corrección de la propia familia. Para probar su efectividad y analizar su idoneidad, hemos aplicado estos patrones de cambio en un escenario real. En concreto, hemos llevado a cabo un caso de estudio con un estándar de seguridad con un alto nivel de variabilidad. Los resultados de este caso demuestran que la aplicación de nuestros patrones de cambio puede reducir el esfuerzo para el modelado de familias de procesos en un 34% y para la evolución de esos modelos en un 40%. Además, hemos analizado cómo los ingenieros aplican los patrones y cuáles son sus percepciones de esta aplicación. Como resultado, la mayoría de ellos encontró beneficios al aplicar los patrones. Además, no percibieron un aumento en el esfuerzo mental necesario para aplicarlos y estuvieron de acuerdo en la utilid / [CAT] La creixent adopció de sistemes d'informació dirigits per processos de negoci (PAIS) junt amb l'alta variabilitat en eixos processos, han donat lloc a la aparició de col·leccions de famílies de processos. Estes famílies es formen de un model de procés de negoci i les seues variants, les quals poden comprendre entre cents i milers de diferents formes de dur a terme eixe procés. Modelar la variabilitat dels processos en este context pot resultar molt difícil donat la grandària que aquestes famílies poden aconseguir. Motivats per este desafiament, s'han desenvolupat diverses solucions que permeten la gestió de la variabilitat en els processos de negoci. No obstant, amb aquestes solucions els enginyers que treballen amb PAIS han de crear i gestionar un a un tots els elements de les famílies de processos i assegurar ells mateixos la seua correcció. Això pot resultar tediós i propens a errors especialment quan les famílies es componen de cents o milers de variants. Per exemple, la variabilitat pot no quedar adequadament representada ja que els enginyers han de ser conscients de totes i cadascuna una de les variacions de totes les variants. Per quest motiu, son necessaris nous mètodes que permeten als enginyers de PAIS modelar la variabilitat dels processos de manera més explícita, sobretot a un nivell d'abstracció més alt del proporcionat per les solucions actuals. No obstant, com es representa la variabilitat en aquestos mètodes resulta crític (ex.: quines primitives s'utilitzen per a modelar la variabilitat en els processos). En aquest context, l'ús de patrons de modelatge (solucions reutilitzables a un problema recurrent) resulten un camí prometedor. Per exemple, els patrons han sigut provats com una solució eficaç per modelar i gestionar processos de negoci individuals. L'objectiu d'aquesta tesi 'es millorar el modelatge de la variabilitat en les famílies de processos a través de l'ús de patrons de canvi. En primer lloc, hem dut a terme un estudi sistemàtic per a analitzar les solucions existents per a gestionar la variabilitat en els processos, així com el suport que aquestes proporcionen. D'aquesta manera, som capaços d'identificar i analitzar quin 'es el conjunt bàsic de primitives específiques per a representar la variabilitat. A més, basant-nos en l'evidència empírica obtinguda, hem derivat el marc d'evacuació VIVACE, el qual arreplega les primitives de variabilitat i un conjunt bàsic de característiques que afavoreixen la variabilitat en els processos. Així mateix, VIVACE permet als enginyers de PAIS avaluar les solucions per a gestionar la variabilitat en els processos, així com seleccionar la solució que s'ajusta millor a les seues necessitats. Finalment, VIVACE també pot ajudar als enginyers a gestionar PAISs que donen suport a aquesta variabilitat. En segon lloc, per a facilitar el modelatge de la variabilitat en les famílies de processos, basant-nos en les primitives identificades, hem definit un conjunt de 10 patrons de canvi i hem mostrat com aquestos poden ser implementats. En particular, estos patrons ajuden al modelatge i l'evolució de famílies de processos i garanteixen la correcció de la pròpia família. Per a provar la seua efectivitat i analitzar la seua idoneïtat, hem aplicat els patrons de canvi en un escenari real. En particular, hem dut a terme un cas d'estudi amb un estàndard de seguretat amb un alt nivell de variabilitat. Els resultats de aquest cas demostren que l'aplicació dels nostres patrons de canvi poden reduir l'esforç per al modelatge de famílies de processos en un 34% i per a l'evolució de eixos models en un 40%. A més, hem analitzat com els enginyers de PAIS apliquen els patrons i quines son les seues percepcions d'esta aplicació. Com a resultat, la majoria d'ells va trobar beneficis al aplicar els patrons de canvi. A més, no van percebre un augment en l'esforç mental necessari per a aplicar-los i van estar d'acord en la utilitat i f / Ayora Esteras, C. (2015). Enhancing Variability Modeling in Process-Aware Information Systems through Change Patterns [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/58426 / TESIS

The aim of this study was to investigate the influence of GeoGebra training on teachers and learners in rural geometry classrooms. The conceptual framework that was used in this study was based on the four-level training evaluation framework of Kirkpatrick (1996), focusing on the first three levels only while the fourth level was not considered. The study was conducted in disadvantaged and under-resourced schools situated in the Mpumalanga Province of South Africa. This undertaking was considered as a way of promoting what was perceived as a simple but effective method of teaching and learning with technology. The technology-enhanced teaching strategy was employed with the anticipation of enhancing the development of geometrical concepts that are seen as too abstract by the majority of learners in resource-constrained areas. Hence, the focus of this study was on the teaching and learning of the properties of triangles and the properties of quadrilaterals in Grade 10 using GeoGebra and traditional methods. Within the non-equivalent, quasi-experimental design, both qualitative and quantitative approaches were used. Four purposively sampled Grade 10 teachers from four schools and their classes comprising of 165 learners participated. The data collection involved pre- and post-tests, questionnaires, lesson observations, and interviews. Learners’ achievement was measured by outcomes obtained from marked and recorded achievements tests. The qualitative data collected from the teachers through questionnaires, lesson observations and interviews were coded and categorised into themes. This analysis revealed that most participants had positive training experiences and preferred using GeoGebra in the teaching and learning of geometry despite a lack of resources in their schools. The findings also showed that there was lack of training workshops that focused on appropriate teachers` knowledge and skills that are connected to technological innovations, particularly in GeoGebra. The quantitative data analysis results showed a significant difference in the mean scores for both groups respectively in favour of learners taught with GeoGebra compared to a chalk and talk method. The teachers’ implementation of and enthusiasm about GeoGebra had a positive influence on learner achievement. Based on the results, it was concluded that as a pedagogical tool, GeoGebra can work effectively in rural schools where geometry is hardly taught. / Thesis (PhD)--University of Pretoria, 2020. / Science, Mathematics and Technology Education / PhD / Unrestricted

This dissertation reports an evaluation study which was done with an educational programme for Automotive Service Technicians which was adapted for South African conditions and derived from a programme used internationally, and originally developed in Schweinfurt, Germany in 2005. The programme was designed to answer to particular problems experienced during automotive driveline-component installations. Since the inception of this programme, ZF Germany had been training representatives from their different subsidiaries over the world on the essential elements of automotive driveline installation protocol. The representatives were trained to adapt the core programme in accordance with the particulars of the vehicle populations in each respective country, and the researcher has performed this task The aim of this research was to evaluate the effectiveness of one particular module known as “Guidelines to clutch replacement” with regard to bringing about the desired changes in knowledge, attitude and behaviour within the trainees. Previous anecdotal feedback from the industry had suggested that the programme had been helpful in the reduction of installation errors, but the extent of the successes and failures of the programme had been unknown until this study. The training department at ZF South Africa was tasked to design further training modules based on the findings of the module under study in order to establish the successes and failures of the core concept for improvement of successive programmes. The approach for this programme evaluation was utilization-focused which allowed the researcher to choose from and combine a variety of data collection strategies over the complete range of summative and formative evaluation approaches. However, in keeping with the stated aim of this study, this study had been limited to a summative inquiry by employing a quantitative data collection strategy at the hand of a quasi-experimental research design. This research report presents the findings of a one-day intervention programme that was offered to Automotive Service Technicians in the Gauteng area. The conceptual framework that was adopted for the research was based on the four level evaluation framework of Kirkpatrick (1998) with the first three levels having been empirically tested and the fourth level discussed on the basis of empirical information. Findings suggest that although the levels of knowledge-acquisition could not to be considered as high, behaviour modification had indeed been observed to be in alignment with the clutch-installation-protocol and almost all the respondents had adopted the protocol as their preferred way of executing clutch installations. In addition, most respondents found the programme to be pleasant and of a high utility value. Certain problems with the programme became evident, such as the pace having been too fast; printed hand-outs were not considered to have high utility value, and sensitivity to personal and cultural differences were found to be lacking. The low levels recorded for knowledge acquisition may be language related which possibly relates to the fast pace of the course. The research findings suggest that the course should be spread over two days instead of one day and be augmented with practical demonstrations and re-designed printed hand-outs. In order to effectively measure level four of the Kirkpatrick framework, criteria of concern should be negotiated with participating organisations in order to provide relative data for answering research questions on this level. Procedures for collecting data over the course of several years need to be established and agreed upon by all stakeholders for such data to be reliable and valid in the inclusion of a time-series study. Regarding a relatively simple programme such as the programme under study with programme objectives that have a predominant procedural-knowledge focus, the Kirkpatrick framework has been found to be effective and its procedures may be applied in other industry-based training programmes. An added academic contribution to the previous one is that the Kirkpatrick framework as utilised in this study has shown that the framework offers a high utility value for fast-paced short courses where contact time with trainees are limited and evaluation designs need to fit in with the practical limitations. The high utility value of the Kirkpatrick framework became evident in the findings of this study where transfer of learning had evidently taken place regardless of possible learning problems such as language barriers. / Dissertation (MEd)--University of Pretoria, 2014. / tm2015 / Science, Mathematics and Technology Education / MEd / Unrestricted

There are growing concerns about quality of education in schools in many countries, and education systems implement mechanisms like school inspection, an external education quality assurance measure, to evaluate their education. Realising that effective improvement of education quality may be achieved from within rather than from outside, many education systems are adopting School Self-Evaluation (SSE), an internal evaluation process, to evaluate quality of education. This study attempted to identify the characteristics of effective SSE frameworks in order to develop one for Zimbabwean primary schools. The study utilised exemplary frameworks as facilitators for introducing SSE practices in Zimbabwe and was guided by the following question: What are the characteristics of an effective SSE framework for improving classroom quality in Zimbabwean primary schools? The study espoused design research approach which aims to provide solutions to various education problems. The study comprised three phases, the preliminary phase which included a literature review and a needs analysis with the former aimed to gain insight into the efficacy of SSE in evaluating quality of education. The needs analysis sought to establish how education is evaluated in Zimbabwean primary schools. The second, the prototyping phase, involved developing and formatively evaluating various prototypes. The last phase, a semi-summative evaluation, involved field-testing and appraisal of the intervention. Interviews and questionnaires were used to collect data. Six design principles were generated with the main ones being to engage stakeholders in developing SSE frameworks, to agree on the need for SSE initiative and to define the quality indicators in context. The main characteristics of the SSE framework were that it should have a clear purpose, be context specific, and should focus on what is essential for education. The main conclusion of the study is that there are no clear policy guidelines for Zimbabwean primary schools, coupled with lack of SSE instruments, to engage in self-evaluation of quality of education and therefore, no meaningful SSE takes place. An SSE framework with procedural guidelines developed in this research appears to be relevant, feasible and is expected to be effective for use in Zimbabwean primary schools. Some recommendations were made in order to improve Zimbabwe‟s quality of education. / Thesis (PhD)--University of Pretoria, 2015. / Centre for Evaluation and Assessment (CEA) / University of Pretoria / Science, Mathematics and Technology Education / PhD / Unrestricted

The impacts of climate change have resulted in the need for adaptation tools to provide stakeholders with the ability to respond to a broad range of potential impacts. Geovisualizations serve as powerful engagement tools due to their capacity in communicating complex climate data to various audiences. Studies have shown a preference towards conveying climate data through geo-visual representations, to quickly present ideas rooted in geographical challenges and solutions. However, a rapid pace of technological advancements has paved the way for an abundance of geovisualization products that have eclipsed the necessary theoretical inquiry and knowledge required to establish effective visualization principles. This study addresses this research gap by conducting a structured review of the geovisualization for climate change literature, and creating a conceptual framework that classifies existing geovisualization products into themes relating to visualization features, audiences, and the intended outcome or purpose of the visualization medium. The Climate Visualizations for Adaptation Products (CVAP) framework, is a tool for researchers and practitioners to use as a decision support system to discern an appropriate type of geovisualization product to implement within a specific use case or towards a particular audience. The process of developing a geovisualization software tool for displaying sea ice probability (SIP) in Arctic regions is detailed, in the context of suggested best practices for web development. Challenges and opportunities encountered while adhering to the best practice protocols and guidelines are examined. A usability evaluation is suggested to assess the general user attitude towards a website or service. Finally a summary with conclusions and suggestions for future research are provided. / Graduate