Effectiveness of system testing, in specific phases such as design verification, requirements validation, test planning and generation, system integration and system testing are considered. Software as well as hardware test issues are reviewed. Metrics related to system testing are specified. The current system testing processes in a large Turkish military electronic systems manufacturer are reviewed, specific problems are identified and UML-based behavioral testing is proposed as an improved process. The current process and the proposed process are compared in terms of test coverage, test effectiveness and test effort metrics.

The usage of a graphical user interface (GUI) in software often make up for a greatexperience for the user and is often not an issue, until the only way to run a programis through a GUI. Such a dependency will make development of a project very hardas the only way to perform tests is to execute them manually. This is the case for asimulator that the company Creone uses and it is where we will perform our work.Creone works with smart key management systems and cabinets that allow for a safeand convenient way to store and handle keys. Registered users can open the cabinetswith a pin code that is entered on the dial on the cabinet door. Keys are assigned tousers and what keys that a user can take from a cabinet is seen on the display abovethe dialpad. We are to create a new core implementation that will remove the GUIdependency and allow the simulator to perform automated tests to some extent.