With modern computer systems becoming more and more complicated, theimportance of rigorous testing to ensure the quality of the product increases.This, however, means that the cost to perform tests also increases. In orderto address this problem, a lot of research has been conducted during thelast years to find a more automated way of testing software systems. Inthis thesis, different algorithms to automatically explore and test a systemhave been implemented and evaluated. In addition to this, a second setof algorithms have been implemented with the objective to isolate whichinteractions with the system were responsible for a failure. These algorithmswere also evaluated and compared against each other. In the first evaluationtwo explorers, which I called DeBruijn and LStarExplorer, were consideredsuperior to the other. The first used a DeBruijn sequence to brute forcea solution while the second used the L*-algorithm to build an FSM overthe system under test. This FSM could then be used to provide a moreaccurate description for when the failure occurred. The result from thesecond evaluation were two reducers which both tried to recreate a failureby first applying interactions performed just before the failure occurred. Ifthis was not successful, they tried interactions further and further away, untilthe failure was triggered. In addition to this, the thesis contains descriptionsabout the framework used to run the different strategies. / D ̊a v ̊ara moderna datasystem blir allt mer komplicerade,  ̈okar detta st ̈andigtbehovet av rigor ̈osa tester f ̈or att s ̈akerst ̈alla kvaliteten p ̊a den slutgiltiga pro-dukten. Det h ̈ar inneb ̈ar dock att kostnaden f ̈or att utf ̈ora testerna ocks ̊ao  ̈ kar. F ̈or att f ̈ors ̈oka hitta en l ̈osning p ̊a det h ̈ar problemet har forsknin-gen under senare tid arbetat med att ta fram automatiserade metoder atttesta mjukvarusystem. I den h ̈ar uppsatsen har olika algoritmer, f ̈or attutforska och testa ett system, implementerats och utv ̈arderats. D ̈arut ̈overhar ocks ̊a en grupp algoritmer implementerats som ska kunna isolera vilkainteraktioner med ett system som f ̊ar det att fallera.  ̈aven dessa algoritmerhar utv ̈arderats och testats mot varandra. Resultatet fr ̊an det f ̈orsta ex-perimentet var tv ̊a explorers, h ̈ar kallade DeBruijn och LStarExplorer, somvisade sig vara b ̈attre  ̈an de andra. Den f ̈orsta av dessa anv ̈ande en DeBruijn-sekvens f ̈or att hitta felen, medan den andra anv ̈ande en L*-algoritm f ̈or attbygga upp en FSM  ̈over systemet. Den h ̈ar FSM:en kunde sedan anv ̈andasf ̈or att mer precist beskriva n ̈ar felet uppstod. Resultatet fr ̊an det andraexperimentet var tv ̊a reducers, vilka b ̊ada f ̈ors ̈okte  ̊aterskapa fel genom attf ̈orst applicera interaktioner som ursprungligen utf ̈ordes percis innan feletuppstod. Om felet inte kunde  ̊aterskapas p ̊a detta s ̈att, fortsatte de medatt applicera interaktioner l ̈angre bort tills felet kunde  ̊aterskapas. Ut ̈overdetta inneh ̊aller uppsatsen ocks ̊a beskrivningar av ramverken som anv ̈andsf ̈or att k ̈ora de olika strategierna.

No description available.

A reliable embedded real-time system has many requirements to fulfil. It must meet target deadlines in a number of situations, most of them in a situation that puts heavy stress on the system. To meet these demands, numerous tests have been created which test the hardware for any possible errors the developers might think of, in order to maximise system reliability and stability. These tests will take a lot of time to execute, and as system complexity grows, more tests are introduced leading to even longer testing times. In this thesis, a method to reduce the testing time of the software and, to a lesser extent, the hardware is examined. By using the full system simulator Simics, an existing industry system from ABB was integrated and tests were performed. A proof of concept test suite for automatic redundancy tests was also implemented. By looking at the test results, it was concluded that the method shows promise. However, problems with the average latency and performance troubles with Simics shows that more work must be put into this research before the system can be run at full speed.

abstract: A Cyber Physical System consists of a computer monitoring and controlling physical processes usually in a feedback loop. These systems are increasingly becoming part of our daily life ranging from smart buildings to medical devices to automobiles. The controller comprises discrete software which may be operating in one of the many possible operating modes and interacting with a changing physical environment in a feedback loop. The systems with such a mix of discrete and continuous dynamics are usually termed as hybrid systems. In general, these systems are safety critical, hence their correct operation must be verified. Model Based Design (MBD) languages like Simulink are being used extensively for the design and analysis of hybrid systems due to the ease in system design and automatic code generation. It also allows testing and verification of these systems before deployment. One of the main challenges in the verification of these systems is to test all the operating modes of the control software and reduce the amount of user intervention. This research aims to provide an automated framework for the structural analysis and instrumentation of hybrid system models developed in Simulink. The behavior of the components introducing discontinuities in the model are automatically extracted in the form of state transition graphs. The framework is integrated in the S-TaLiRo toolbox to demonstrate the improvement in mode coverage. / Dissertation/Thesis / Masters Thesis Computer Science 2016

Nowadays, Agile software development methods are often used in large multisite organizations that develop large-scale applications. Behavior Driven Development (BDD) is a relatively new Agile software development process where the development process starts with acceptance tests written in a natural language. The premise of BDD is to create a common and effective process of communication between different roles in a software project to ensure that every activity can be mapped to the business goal of the application. This thesis work aims to find an effective and efficient BDD process and to evaluate its usage in a large-scale application in a large multisite organization through a series of interviews, a controlled experiment, and an online survey. Furthermore, by means of the aforementioned experiment, the study measures the impact of an experimental usage of BDD on testing quality. To discover an effective and efficient BDD process, two alternatives with automated tests that run on different architectural layers, namely client layer and web service layer, were examined. Based on the defined metrics, the alternative with automated tests that ran directly on the web service layer was chosen as the more efficient process which was compared against the existing Agile-based baseline that used automated client tests. The results show that an efficient BDD process improves the testing quality significantly which can, in turn, result in a better overall software quality.

Användandet av mobila applikationer har växt radikalt de senaste åren och de samverkar med många system. Därför ställs det högre krav på kvaliteten och att applikationen ska anpassas till många olika enheter, operativsystem samt plattformar. Detta gör att test av mobila applikationer blivit viktigare och större. Detta arbete har bedrivits som en jämförande fallstudie inom området test av mobila applikationer samt testverktyg. Syftet har varit att beskriva hur testning av mobila applikationer sker idag vilket gjorts genom litteraturstudier och intervjuer med IT-företag. Ett annat syfte har varit att utvärdera fyra testverktyg, deras för- och nackdelar samt hur de kan användas vid testning av mobila applikationer och jämföras mot manuell testning utan testverktyg. Detta har gjorts genom att skapa förstahandserfarenheter baserat på användandet av testverktygen. Under arbetet har vi utgått från mobila applikationer som vi fått tillgång till av Triona, som varit vår samarbetspartner.Idag finns många olika testverktyg som kan användas som stöd för testningen men få företag har implementerat något eftersom det kräver både tid och kompetens samt valet av testverktyg kan vara svårt. Testverktygen har olika för- och nackdelar vilket gör att de passar olika bra beroende på typ av projekt och applikation. Fördelar med att använda testverktyg är möjligheten att kunna automatisera, testa på flera enheter samtidigt samt få tillgång till enheter via molnet. Utmaningarna är att det kan vara svårt att installera och lära sig testverktyget samt att licenserna kan vara dyra. Det är därför viktigt att redan innan implementationen veta vilka tester och applikationer testverktygen ska användas till samt vem som ska använda det. Utifrån vår studie kan slutsatsen dras att inget testverktyg är helt komplett men de kan bidra med olika funktioner vilket effektiviserar delar av testningen av mobila applikationer. / The use of mobile applications has grown dramatically in recent years and they interact with many systems. Therefore the requirement on the quality is higher and the application must often be adapted to many devices, operating systems and platforms. This means the testing of mobile applications becomes more and more important. This study has been conducted as a comparative case study in the field testing of mobile applications and testing tools. The aim has been to describe how the testing of mobile applications takes place today which have been made through literature studies and interviews with IT-companies. Another aim was to evaluate four testing tools, their advantages and disadvantages and how they can be used in the testing of mobile applications and compared to manual testing without testing tools. This was done by using and experience the testing tools. During the study, we have used mobile applications that we got access from Triona, who has been our partner.Today there are many different testing tools that can be used to support testing, but few companies have implemented these because it requires both time and expertise as well as the selection of testing tools can be difficult. Testing tools have different advantages and disadvantages which make them fit differently depending on the type of project and application. Advantages of using testing tools is the ability to automate, test on multiple devices simultaneously and get access to physical devices via the cloud. The challenges are that it can be difficult to install and learn the testing tool and that the licenses can be expensive. It is therefore important that even before implementation to know which tests and applications the testing tools will be used in and who will use it. Based on our study we can conclude that no testing tools are complete but they may contribute with different features which streamlines parts of the mobile applications testing.

This Master thesis deals with the problems of introducting test automation in the software development life cycle, selection of a tool for the purposes of test automation and an overview of these tools. The theoretical section of the thesis aims to acquaint readers with the concept of testing, its basic principles, parts of the test process, types, methods and levels of the testing as well as an introduction to the basics of test automation. The practical part of the thesis consists of the methodology design for the introduction of automated testing, where several principles and methods are described in more detail to avoid or minimize the risk of unsuccessful and inefficient test automation. The concept of multicriteria selection of tools for automated testing is introduced in the next section, where also criteria for the particular project are set. Selected tools are then described in detail and evaluated upon these criteria.

The quality is probably the most significant property of a successful software product. As experience with many software projects has already shown, leaving out testing and quality management from software development process can result in vast and critical customer issues, which usually invoke additional expenses for the software production company. In the course of time, software testing as a discipline has therefore seized an important position among other software development activities. And due to the fact that the software, thanks to rising customer demands and growing competing products portfolio, is getting more complex, the more advanced software testing procedures need to be implemented. Test strategy and iteration planning, implementation of multiple test types into the test suite, test automation, evaluation, administration and maintenance: these activities are commonly required within larger software development projects. Formalized software testing is, nevertheless, being introduced also to projects using agile management techniques which, by management decision or target user industry, are supposed to deliver products of highest quality. This initiates the high focus on the software testing discipline. The purpose of this thesis is to design and implement a new system of software testing within a real project in the CertiCon a.s. company, for which software development is the main business activity. Current issues and gaps for possible improvement, gathered both by project management and the author himself, are analyzed in the first major part of this work and transformed into testing system requirements, which should cover both process changes as well as implementation/development of needed software supporting the process. The second part of thesis is covering the design of the new software testing system, focusing mainly on the area of test management and selection of appropriate software management tool. The final part of the thesis is aimed at implementation of the designed solution within a real organization environment and evaluates its benefits against the previously set requirements.

This master's thesis deals with the issue of software tools for automated integrational ECU testing. It is specifically focused on TestAut 2 tool, which is developed by e4t company and used for testing of Skoda cars. Goal of this thesis is comparison of TestAut 2 against similar tools used in automotive industry. This work contains analysis of TestAut 2 tooland description of principles and features of EXAM, MODENA and PROVEtech tools. Set of principles considerd as advantageous is chosen from collected information. Next part of this thesis describes implementation of chosen principles to TestAut 2 tool, verification ofit's functionality and evaluation of it's benefits. In the conclusion author suggests another improvements that can be done.

The goal of the master´s thesis is to design testing unit for small batch production. The background research part introduces testing principles, we are also discussed different ways of realization of testing connectors and choice of control unit. The work also describes the design of the hardware wiring and mechanical design. The result of this thesis is a device implemented according to the proposal described in the work. No significant fault was found during operation of testing unit, which verified its reliability and full functionality. The work also includes a description of the software implementation in Python.