The topic of this thesis is the issue of software testing. The thesis places main emphasis on tools to support test management, manual and automated functional testing and last but not least the tools for defect tracking. The aim of this thesis is introduce readers with software testing, especially with tools that can be used to support testing. The aim is offer an overview of the basic commercial and freely distributed tools for test management, manual testing, automated functional testing and defect tracking. Another aim is design criteria that simplify selection of tool. The second aim of this thesis is practical example of the configuration and description of the basic work with tools IBM Rational - ClearQuest, ClearCase, Manual Tester and Functional Tester. The aims of this thesis were achieved by studying available sources and by own practical experience with the tools to support testing. The contribution of this thesis lies in the characteristics of the selected tools to support testing and especially in design of criteria by which tools can be selected. The last part of thesis provides practical instruction how to configure and work with the tools to support testing of IBM Rational. The thesis is conceived in three main parts. The first part attends to basic terms, which can be found in the area of testing, and to overview of types of tests. There are also described two most famous life-cycle models and methodology RUP. The second part attends to overview of tools to support testing, attention is given to areas: test management, manual testing, defect tracking, and automated functional testing. For each category of tools has been defined criteria according to which tools can be selected. The last part attends to practical example of setting and basic work with the selected tools to support testing of IBM Rational.

The subject of this thesis is web applications quality assurance using automated testing tools. The main goal of this thesis is design and implementation solution for automated regression testing of map web application. In the first chapter are described principles of software quality assurance focused to software testing. After that follows chapter about the possibility of automatic software testing based on analysis tools available to support automated testing of web applications. Next chapters of this thesis are devoted to choosing the ideal tool of automated testing, design and implementation of solutions for automated regression testing of web map application.

I många år har testning varit ett sätt att öka kvalitén på utvecklad programkod. I och med teknikens framsteg har testautomatisering blivit ett hett ämne inom programutveckling för att effektivisera den manuella testprocessen. Detta examensarbete har undersökt möjligheterna att införa automatiska tester hos en avdelning på Handelsbanken, främst integrations- och regressionstester. Utifrån förutsättningarna hos avdelningen togs en prototyp fram för att demonstrera hur detta skulle kunna fungera på deras Microsoft-plattform. Prototypen bestod av en Jenkins-server som utförde tester skrivna i C# med hjälp av MSTest.exe. Testerna använde diverse proprietär och open-source ramverk, där tjänster och filer testades med dessa ramverk. Prototypen bevisade att automatisk testning kunde införas på avdelningen, men underhåll och en tydlig samt omfattande testprocess krävdes. / For several years, testing has been a way to increase the quality of developed program code. As technology advances, automated testing has emerged as a hot topic in system development and has been proclaimed to streamline the previous manual testing process. The purpose of this bachelor thesis was to study the possibilities of implementing automated testing at a department of Handelsbanken, focusing on integration and regression testing. Based on the prerequisites of the department, a prototype focusing on their Microsoft platform was developed to demonstrate a possible solution. The prototype consisted of a Jenkins server executing tests written in C# with the help of MSTest.exe. The tests used both proprietary and open-source frameworks. Services and files were tested using said frameworks. The prototype proved that automatic testing could be implemented at the department, but maintenance and a clear and comprehensive testing procedure was required.

Denna studie syftar till att beskriva prestandatest av feta klienter, ibland också kallade skrivbordsapplikationer. Studien syftar även till att kartlägga testverktyg som kan användas för att utföra prestandatest av feta klienter och att identifiera vilka egenskaper som anses vara viktiga kriterier för dessa testverktyg. Undersökningen är skapad som en fallstudie som undersökningsstrategi där fallets utgångspunkt är Trafikverkets behov men undersökning och dess resultat kan även appliceras på andra verksamheter där testarbete utförs. Både kvalitativ och kvantitativ datainsamling användes i undersökningen genom intervjuer och dokumentstudier samt enkätformulär. Då insamlat data i undersökningen är av både kvalitativ och kvantitativ form så användes också en blandning av en kvalitativ tematisk analys och kvantitativ dataanalys. En del av analysen är en utvärdering av ett testverktygsurval mot sammanställda kriterier, en kriteriebaserad utvärderingsmetod. Tillvägagångssättet för val och utvärdering av testverktyg som tillämpats genom studien är baserat på tidigare befintliga teorier som funnits genom litteraturstudier. Litteraturstudierna har även stått till grund för att definiera undersökningens centrala begrepp och bidrar till resultat genom en jämförelse med insamlat data. Resultatet från undersökningen bidrar med ett beslutsunderlag för verksamheter som står inför ett val av testverktyg för prestandatest av feta klienter och en utvärdering av dessa innan licenser införskaffas. Undersökningen bidrar även med en karakterisering av prestandatest av feta klienter. I just detta fall var de mest passande testverktygen för syftet HP LoadRunner samt två testverktyg från eggPlant i kombination (eggPlant Functional och eggPlant Performance). / The aim of this study is to describe performance testing on thick clients, sometimes also referred to as desktop applications. Another aim with this study is to map out a selection of testing tools that can be used for performance testing of thick clients and to identify what qualities that is considered to be important criteria for these testing tools. The study is based on the research strategy called case study where the case is grounded the needs from Trafikverket but the results from this study could be applied on other business organizations that works with testing. Both qualitative and quantitative data collecting methods where used in this study, in the form och interviews, document studies and questionnaires. Since the collected data in the study where in both qualitative and quantitative form the use of a mix between a qualitative thematical data analysis and a quantitative data analysis had to be done. A part of the analysis was an evaluation on a selection of testing tools towards a compiled list of criteria, as an evaluation method based on criteria. The course of action for choosing and evaluation a testing tool that has been applied throughout the study is based on preexisting theories that has been found through reviews of literature. The reviews of literature have also been the ground for defining the central concepts of the study and contributes to the result by comparing what’s been found in literature to the collected data. The result of the study contributes with a basis for decision for companies and organizations that is in the process of getting a testing tool for performance testing thick clients och how to evaluate these before obtaining the testing tool licenses. The study also contributes with a characterization of performance testing thick clients. In this particular case, the most suitable testing tools came to be HP LoadRunner and also two testing tools from eggPlant combined (eggPlant Functional and eggPlant Performance).

The software industry is expanding at a rapid rate. To keep up with the fast-growing and ever-changing technologies, it has become necessary to produce high-quality software in a short time and at an affordable cost. This research aims to demonstrate to Java developers the use of Automated Test Case Generation (ATCG) tools by presenting the tools that exist today, their usefulness, and their effectiveness. The main focus is on the automated testing tools for the Java industry, which can help developers achieve their goals faster and make better software. Moreover, the discussion covers the availability, features, prerequisites, effectiveness, and limitations of the automated testing tools. Among these tools, the most widely used are Evosuite, JUnit, TestNG, and Selenium. Each tool has its advantages and purpose. Furthermore, these ATCG-tools were compared to provide a clear picture to Java developers, answer the research questions, and show strengths and limitations of each selected tool. Results show that there is no single ultimate tool that can do all kinds of testing independently. It all depends on what the developer aims to achieve. If one tool is good at generating unit test cases for Java classes, another tool is good at testing the code security through penetration testing. Therefore, the Java developers may choose a tool/s based on their requirements. This study has revealed captivating findings regarding the ATCG-tools, which ought to be explored in the future.

Big amounts of test data generated by the current used software testing tools (QA-C/QA-C++ and Cantata) contain a variety of different values. The variances cause enormous challenges in data aggregation and interpretation that directly affect generation of test metrics. Due to the circumstance of data processing, this master thesis introduces a database-centric test management framework for test metrics aims at centrally handling the big data as well as facilitating the generation of test metrics. Each test result will be individually parsed to be a particular format before being stored in a centralized database. A friendly front-end user interface is connected and synchronized with the database that allows authorized users to interact with the stored data. With a granularity tracking mechanism, any stored data will be systematically located and programmatically interpreted by a test metrics generator to create various kinds of high-quality test metrics. The automatization of the framework is driven by Jenkins CI to automatically and periodically performing the sequential operations. The technology greatly and effectively optimizes and reduces effort in the development, as well as enhance the performance of the software testing processes. In this research, the framework is only started at managing the testing processes on software-unit level. However, because of the independence of the database from levels of software testing, it could also be expanded to support software development at any level.

This diploma thesis deals with automated testing of web applications. First of all, it introduces automated testing and compares it with manual testing, then classifies currently available testing tools and describes Selenium testing tools. In further chapter a methodology for automation of testing of web applications is described, providing a systematic manual, how to automate testing, which mistakes to avoid, and also tasks and responsibilities of involved roles. Appendix of this thesis consists of a user manual for Selenium WebDriver, one of the most popular tools for automated functional testing of web application. This manual guides reader from the basics of using Selenium WebDriver tool to its advanced features and provides complete information set needed for writing automated tests. This thesis represents a complex material that can be used for carrying out a process of test automation using a particular testing tool.

Big amounts of test data generated by the current used software testing tools (QA-C/QA-C++ and Cantata) contain a variety of different values. The variances cause enormous challenges in data aggregation and interpretation that directly affect generation of test metrics. Due to the circumstance of data processing, this master thesis introduces a database-centric test management framework for test metrics aims at centrally handling the big data as well as facilitating the generation of test metrics. Each test result will be individually parsed to be a particular format before being stored in a centralized database. A friendly front-end user interface is connected and synchronized with the database that allows authorized users to interact with the stored data. With a granularity tracking mechanism, any stored data will be systematically located and programmatically interpreted by a test metrics generator to create various kinds of high-quality test metrics. The automatization of the framework is driven by Jenkins CI to automatically and periodically performing the sequential operations. The technology greatly and effectively optimizes and reduces effort in the development, as well as enhance the performance of the software testing processes. In this research, the framework is only started at managing the testing processes on software-unit level. However, because of the independence of the database from levels of software testing, it could also be expanded to support software development at any level.

I dagens informationssamhälle pågår en växande trend av molnbaserade tjänster. Vid implementering av molnbaserade tjänster används metoden Virtualisering. Denna metod minskar behovet av antal fysiska datorsystem i ett datacenter. Vilket har en positiv miljöpåverkan eftersom energikonsumtionen minskar när hårdvaruresurser kan utnyttjas till sin fulla kapacitet. Molnbaserade tjänster skapar samhällsnytta då nya aktörer utan teknisk bakgrundskunskap snabbt kan komma igång med verksamhetsberoende tjänster. För tillämpning av Virtualisering används en så kallad Hypervisor vars uppgift är att distribuera molnbaserade tjänster. Efter utvärdering av vetenskapliga studier har vi funnit att det finns skillnader i prestanda och funktionalitet mellan olika Hypervisors. Därför väljer vi att göra en prestanda- samt funktionsanalys av Hypervisors som kommer från de största aktörerna på marknaden. Dessa är Microsoft Hyper-V Core Server 2012, Vmware ESXi 5.1.0 och Citrix XenServer 6.1.0 Free edition. Vår uppdragsgivare är försvarsmakten som bekräftade en stor efterfrågan av vår undersökning. Rapporten innefattar en teoretisk grund som beskriver tekniker bakom virtualisering och applicerbara användningsområden. Genomförandet består av två huvudsakliga metoder, en kvalitativ- respektive kvantitativ del. Grunden till den kvantitativa delen utgörs av ett standardsystem som fastställdes utifrån varje Hypervisors begränsningar. På detta standardsystem utfördes prestandatester i form av dataöverföringar med en serie automatiserade testverktyg. Syftet med testverktygen var att simulera datalaster som avsiktligt påverkade CPU och I/O för att avgöra vilka prestandaskillnader som förekommer mellan Hypervisors. Den kvalitativa undersökningen omfattade en utredning av funktionaliteter och begränsningar som varje Hypervisor tillämpar. Med tillämpning av empirisk analys av de kvantitativa mätresultaten kunde vi fastställa orsaken bakom varje Hypervisors prestanda. Resultaten visade att det fanns en korrelation mellan hur väl en Hypervisor presterat och vilken typ av dataöverföring som den utsätts för. Den Hypervisor som uppvisade goda prestandaresultat i samtliga dataöverföringar är ESXi. Resultaten av den kvalitativa undersökningen visade att den Hypervisor som offererade mest funktionalitet och minst begränsningar är Hyper-V. Slutsatsen blev att ett mindre datacenter som inte planerar en expansion bör lämpligtvis välja ESXi. Ett större datacenter som både har behov av funktioner som gynnar molnbaserade tjänster och mer hårdvaruresurser bör välja Hyper-V vid implementation av molntjänster. / A growing trend of cloud-based services can be witnessed in todays information society. To implement cloud-based services a method called virtualization is used. This method reduces the need of physical computer systems in a datacenter and facilitates a sustainable environmental and economical development. Cloud-based services create societal benefits by allowing new operators to quickly launch business-dependent services. Virtualization is applied by a so-called Hypervisor whose task is to distribute cloud-based services. After evaluation of existing scientific studies, we have found that there exists a discernible difference in performance and functionality between different varieties of Hypervisors. We have chosen to perform a functional and performance analysis of Hypervisors from the manufacturers with the largest market share. These are Microsoft Hyper-V Core Server 2012, Vmware ESXi 5.1.0 and Citrix XenServer 6.1.0 Free edition. Our client, the Swedish armed forces, have expressed a great need of the research which we have conducted. The thesis consists of a theoretical base which describes techniques behind virtualization and its applicable fields. Implementation comprises of two main methods, a qualitative and a quantitative research. The basis of the quantitative investigation consists of a standard test system which has been defined by the limitations of each Hypervisor. The system was used for a series of performance tests, where data transfers were initiated and sampled by automated testing tools. The purpose of the testing tools was to simulate workloads which deliberately affected CPU and I/O to determine the performance differences between Hypervisors. The qualitative method comprised of an assessment of functionalities and limitations for each Hypervisor. By using empirical analysis of the quantitative measurements we were able to determine the cause of each Hypervisors performance. The results revealed that there was a correlation between Hypervisor performance and the specific data transfer it was exposed to. The Hypervisor which exhibited good performance results in all data transfers was ESXi. The findings in the qualitative research revealed that the Hypervisor which offered the most functionality and least amount of constraints was Hyper-V. The conclusion of the overall results uncovered that ESXi is most suitable for smaller datacenters which do not intend to expand their operations. However a larger datacenter which is in need of cloud service oriented functionalities and requires greater hardware resources should choose Hyper-V at implementation of cloud-based services.