This report discusses the importance of test process evaluation in order to improve a test model and to provide developer- and management feedback. The report results in a test evaluation framework, developed in cooperation with a department at Ericsson Software Technology in Karlsrona. The framework is a result of discussions with the developers regarding performed testing, studying defect types from past projects and by analyzing the result from a small survey answered by some of the developers at Ericsson. The overall project aim was to evaluate performed testing in order to improve the test model. This requires a good insight of the test process, which is provided by the developed test evaluation framework. The test process is visualized by extracting test process data, making it possible to achieve the project aim. The project aim can be divided into the three following areas: Firstly to evaluate if the current test model is followed as expected, for example are all test techniques used according to the test model? Secondly to evaluate how well the test model fulfills predefined expectations, i.e. is a defect detected with the expected test technique and in the expected test phase? Finally to evaluate if there are any problematic defects that should receive extra attention during a project such as if one or several defect types occurs more frequently than others? The framework is based on another framework, Orthogonal Defect Classification [Chillarege92], combined with the research area Test Technique Effectiveness. The aim of this combination was to support the developed framework. Further a specific part of the framework is focusing on developer- and management feedback. / Dan Bengtsson Västra Stationstorget 7 222 37 Lund

Aspect-oriented programming is a relatively new programming paradigm and it builds on the basis of object oriented programming paradigm. It deals with those concerns that cross-cut the modularity of traditional programming mechanisms and it aims at reduction of code and to provide higher cohesion. As with any new technology aspect oriented programming provides some benefits and also there are some costs associated with it. In this thesis we have done a systematic review on aspect oriented software testing in the context of testing challenges. Detailed analysis have been made to show that how effective are the structural test techniques to handle these challenges. We have given the analysis of Aspect-oriented test techniques effectiveness, based on research literature. / Aspekt-orienterad programmering är ett relativt nytt programmering paradigm och det bygger på grundval av objektorienterad programmering paradigm. Det handlar om de farhågor som KORSSKUREN den modularitet av traditionell programmering mekanismer och det syftar till minskning av kod och för att ge högre sammanhållning. Som med all ny teknik aspekt-orienterad programmering ger vissa fördelar och det finns vissa kostnader associerade med den. I denna avhandling har vi gjort en systematisk översyn av aspekt orienterad mjukvara testning i samband med provning utmaningar. Detaljerad analys har gjorts för att visa att hur effektiva är de strukturella provmetoder för hantera dessa utmaningar. Vi har gett en analys av Aspect-oriented testa tekniker effektivitet, baserade på forskningslitteratur. / FOLKPARKSVAGEN 18 Room 03 Ronneby 37240 Sweden Mobile Number Kashif 073-9124604, Amar 073-6574048