None of today’s large scale systems could function without the reliable availability of a varied range of network communications capabilities. Whilst software, hardware and communications technologies have been advancing throughout the past two decades, the methods commonly used by industry for testing large scale systems which incorporate critical communications interfaces have not kept pace. This thesis argues for the need for a specifically tailored framework to achieve effective testing of communications-critical large scale systems (CCLSS). The thesis initially discusses how generic test approaches are leading to inefficient and costly test activities in industry. The thesis then presents the form and features of an alternative CCLSS domain-specific test framework, develops its ideas further into a detailed and structured test approach for one of its layers, and then provides a detailed example of how this framework can be applied using a real-life case study. The thesis concludes with a qualitative as well a simulation-based evaluation of the framework’s benefits observed during the case study and an evaluation by expert external participants considering whether similar benefits can be realised if the framework is adopted for the testing of other comparable systems. Requirements data from a second CCLSS is included in the evaluation by external participants as a second smaller case study.

As integrated circuits and printed circuit boards increase in complexity, testing becomes a major cost factor of the design and production of the complex devices. Testability has to be considered during the design of complex electronic systems, and automatic test systems have to be used in order to facilitate the test. This fact is now widely accepted in industry. Both design for testability and the usage of automatic test systems aim at reducing the cost of production testing or, sometimes, making it possible at all. Many design for testability methods and test systems are available which can be configured into a production test strategy, in order to achieve high quality of the final product. The designer has to select from the various options for creating a test strategy, by maximising the quality and minimising the total cost for the electronic system. This thesis presents a methodology for test strategy generation which is based on consideration of the economics during the life cycle of the electronic system. This methodology is a concurrent engineering approach which takes into account all effects of a test strategy on the electronic system during its life cycle by evaluating its related cost. This objective methodology is used in an original test strategy planning advisory system, which allows for test strategy planning for VLSI circuits as well as for digital electronic systems. The cost models which are used for evaluating the economics of test strategies are described in detail and the test strategy planning system is presented. A methodology for making decisions which are based on estimated costing data is presented. Results of using the cost models and the test strategy planning system for evaluating the economics of test strategies for selected industrial designs are presented.

Testing is a crucial process for organizations to identify any defects, ensure high-quality standards, enhance customer experience, mitigate risks, and comply with regulations. With proactive identification and resolution of problems, efficient testing saves time, money, and effort, ultimately contributing to the organization's overall success. The ABB Robotics Quality Management team for New Product Development projects identified that the current testing is process-oriented which results in overlapping test activities, delays, and increased costs. The lack of a holistic approach was identified as the main problem for the testing processes. Testing for New Product Development in the robotics industry is a time-consuming and costly activity. To deliver high-quality and reliable robot solutions, it is essential to test the right items at the right stage of development. The purpose of this research is to build a Test Strategy for New Product Development projects at ABB Robotics. The major objectives for the generated test strategy include identification of the right test methodologies, early identification of bugs and failures, achieving sufficient test coverage through component, module, integration, and system levels of testing, testing at the right level and stage, early verification of all requirements, better product quality, accelerated time to market, and superior customer experience. This research will focus on the mentioned aspects and won't address certain areas such as how suppliers conduct their testing, how test data is transferred from suppliers to ABB Robotics, processes after new product development projects are completed, and the testing processes in customer service. The research methodology involves a thorough literature review, an analysis of internal documents, international standards, and interviews within ABB Robotics, as well as external interviews and benchmarking with three well-known companies in the industry. With the support of the findings, recognized patterns, and analysis, a test strategy with its three major key strategic themes aligned with ABB Robotics' research objectives was generated with an implementation plan.