Visual programming languages employ visual representation to make programming easier and make programs more reliable and more accessible. Visual program testing becomes increasingly important as more and more visual programming languages and visual programming environments come into real use. In this work, we focus on one important class of visual programming languages: form-based visual programming languages. This class of languages includes electronic spreadsheets and a variety of research systems that have had a substantial impact on end-user computing. Research shows that form-based visual programs often contain faults, but that their creators often have unwarranted confidence in the reliability of their programs. Despite this evidence, we find no discussion in the research literature of techniques for testing or assessing the reliability of form-based visual programs. This lack will hinder the real use of visual programming languages. Our work addresses the lack of testing methodologies for form-based visual programs. In this document, we first examine differences between the form-based and imperative programming paradigms, discuss effects these differences have on methodologies for testing form-based programs, and analyze challenges and opportunities for form-based program testing. We then present several criteria for measuring test adequacy for form-based programs, and illustrate their application. We show that an analogue to the traditional "all-uses" dataflow test adequacy criterion is well suited for testing form-based visual programs: it provides important error-detection ability, and can be applied more easily to form-based programs than to imperative programs. Finally, we present a testing methodology that we have developed for form-based visual programs. To accommodate the evaluation model used with these programs, and the interactive process by which they are created, our methodology is validation-driven and incremental. To accommodate the user base of these languages, we provide an interface to the methodology that does not require an understanding of testing theory. We discuss our implementation of this methodology, its time costs, the mapping from our approach to the user interface, and empirical results achieved in its use. / Graduation date: 1998

Mutation testing and adequacy testing are two major technologies to assure the quality of software. In this thesis, we present the first work that alleviates the high cost of mutation testing and ineffectiveness of adequacy testing for context-aware applications. We also present large-scale multi-subject case studies to evaluate how our work successfully alleviates these problems. Mutation testing incurs a high execution cost if randomly selected test inputs kill a small percentage of remaining live mutants. To address this problem, we formulate the notion of context diversity to measure the context changes inherent in test inputs, and propose three context-aware strategies in the selection of test inputs. The empirical results show that the use of test inputs with higher context diversity can significantly benefit mutation testing in terms of resulting in fewer test runs, fewer test case trials, and smaller resultant test suites that achieve a high mutation score level. The case study also shows that at the test case level, the context diversity of test inputs positively and strongly correlates with multiple types of adequacy metrics, which provide a foundation on why context diversity contributes to the effectiveness of test cases in revealing faults in context-aware applications. In adequacy testing, many strategies randomly select test cases to construct adequate test suites with respect to program-based adequacy criteria. They usually exclude redundant test cases that are unable to improve the coverage of the test requirements of an adequacy criterion achieved by constructing test suites. These strategies have not explored in the diversity in test inputs to improve the test effectiveness of test suites. To address this problem, we propose three context-aware refined strategies to check whether redundant test cases can replace previously selected test cases to achieve the same coverage level but with different context diversity levels. The empirical study shows that context diversity can be significantly injected into adequate test suites, and favoring test cases with higher context diversity can significantly improve the fault detection rates of adequate test suites for testing context-aware applications. In conclusion, this thesis makes the significant contributions to the research in testing context-aware applications: (1) It has formulated context diversity, a novel metric to measure context changes inherent in test inputs. (2) It has proposed three context-aware strategies to select test cases with different levels of context diversity. Compared with the baseline strategy, the strategy CAS-H that uses test cases with higher context diversity can significantly reduce the cost of mutation testing over context-aware applications in terms of less number of test runs, smaller adequate test suites, and less number of test inputs used to construct test suites. (3) It has defined three context-aware refined strategies to construct adequate test suites with different context diversity levels. Compared with the baseline strategy, the strategy CARS-H that favors test cases with higher context diversity can significantly improve the effectiveness of adequacy testing in terms of higher fault detection rates. / published_or_final_version / Computer Science / Doctoral / Doctor of Philosophy

No description available.

Thesis (Ph.D.)--Computing, Georgia Institute of Technology, 2009. / Committee Chair: Smaragdakis, Yannis; Committee Member: Dwyer, Matthew; Committee Member: Orso, Alessandro; Committee Member: Pande, Santosh; Committee Member: Rugaber, Spencer.

Thesis (MA)--University of Stellenbosch, 2000. / ENGLISH ABSTRACT: 'Housing' has been addressed as a basic human right. In South Africa this right has become a challenge, which cannot be met by the government alone. It also requires a vast contribution from the broader non-State (private) sector. This includes large companies who need to provide housing assistance to their employees. The aim of this research was to develop an educational computer programme which can be used by companies in their employee housing assistance programmes. The objectives of the research included establishing the extent to which companies provide employee housing assistance; the viability of an educational computer programme; the requirements of companies; criteria and content of a computer programme; and the development and testing of a pilot demonstration module of an educational computer programme for employee housing assistance. Exploratory research was carried out on a sample of 112 companies by means of both postal and telephonic questionnaires. The results of these surveys indicated that 41 of these companies have already established employee housing assistance, providing general information on housing and housing related issues. Most of these companies, however, are only offering financial assistance to their employees without the necessary education and training which should accompany it. A programme which provides these aspects benefits both the company and the employees and should be implemented by many more institutions throughout the country. The main findings of this research, indicated the viability of an educational computer programme and the surveyed companies were positive about using it as part of their employee housing assistance. Throughout the world, computers have proved to offer high-quality interaction and unique learning opportunities to users of varying levels of understanding. They have also demonstrated that they are convenient to use and assist in promoting effective management of time and finances. On the basis of the responses to the survey, essential elements of an educational computer programme for the use of companies in employee housing assistance were identified. A pilot demonstration module was developed using a holistic and didactically sound approach. The development of this educational computer programme, will allow lower income employees to receive beneficial housing assistance at their own pace and level of comprehension and education through an enjoyable and contemporary medium. The results of the initial (but limited) testing of the pilot demonstration module, suggested that there is justification for the further development of the programme and for research to be carried out to examine its effect in the private sector. This research sheds light on the present trends in the provision of employee housing assistance in the private sector and the positive contribution which companies can provide to the housing crisis in South Africa. / AFRIKAANSE OPSOMMING: 'Behuising' word as 'n basiese reg van die mens beskou. In Suid-Afrika het hierdie reg 'n uitdaging geword wat nie deur die regering alleen aanvaar kan word nie. Dit verg ook 'n groot bydrae van die breër gemeenskap, veral die privaatsektor, en dit sluit groot maatskappye wat behuisingshulp aan hulle werknemers behoort te verskaf, in. Die hoofdoel van hierdie navorsingsprojek was om 'n opvoedkundige rekenaarprogram te ontwikkel wat deur maatskappye as deel van 'n behuisingsondersteuningsprogram aan hulle werknemers gebied kan word. Die doelwitte van die navorsing was onder meer om die mate waartoe maatskappye reeds behuisingsondersteuningsprogramme vir hulle werknemers aanbied, te bepaal. Verder is die lewensvatbaarheid van 'n opvoedkundige rekenaarprogram bepaal, asook die maatskappye se behoefte aan so 'n program. Daar is ook vasgestel wat maatskappye se menings oor die kriteria vir en inhoud van 'n opvoedkundige rekenaarprogram, wat as deel van hulle behuisingsondersteuningsprogram aan werknemers gebied kan word, is. Verkennende navorsing is onderneem met 'n steekproef van 112 maatskappye deur middel van telefoniese- en posvraelyste. Die resultate van hierdie vraelyste het aangedui dat 41 van die maatskappye reeds 'n behuisingsondersteuningsprogram aanbied wat algemene inligting oor behuising en behuisingsverwante aangeleenthede aan die werknemers verskaf. Die meeste van dié maatskappye, wat behuisingsondersteuningsprogramme aanbied, bied egter alleenlik finansiële hulp aan hulle werknemers, sonder die nodige meegaande opvoeding en opleiding. "n Program wat beide finansiële en opvoedkundige hulp aanbied kan maatskappye en werknemers tot voordeel strek en behoort landswyd deur baie meer inrigtings geïmplementeer te word. Die hoofbevindinge van die navorsing het getoon dat die opvoedkundige rekenaarprogram lewensvatbaar is, en die deelnemende maatskappye het bereidwilligheid getoon om so "n program as deel van hulle werknemers se behuisingsondersteuningsprogram in te sluit. Die ontwikkeling van die rekenaarprogram sal dit moontlik maak vir werknemers om op verskillende vlakke van begrip en opvoedingspeil, voordelige behuisingsondersteuning teen hulle eie tempo en deur middel van "n genotvolle en kontemporêre medium te kan ontvang. Dit is wêreldwyd bewys dat rekenaars hoë kwaliteit interaksie en unieke leergeleenthede op alle begripssvlakke kan bied. Daar is ook bewys gelewer dat rekenaars nie net gerieflik is nie, maar ook effektief met die bestuur van tyd en finansies is. Op grond van die vraelys resultate, is noodsaaklike elemente van 'n rekenaargebaseerde behuisingsondersteuningsprogram vir werknemers geïdentifiseer, en "n proefmodule ontwikkel wat gebruik maak van "n holistiese en didakties gesonde benadering. Die uitslae van die eerste (maar beperkte) toetsing van die proefmodule dui daarop dat daar regverdiging is vir die verdere ontwikkeling van die program asook vir navorsing om te bepaal wat die effek van so "n program op die privaatsektor sou wees. Hierdie navorsing het lig gewerp op huidige neigings in die verskaffing van behuisingsondersteuning aan werknemers in die privaatsektor, asook op die positiewe bydrae wat deur maatskappye gelewer kan word tot die oplossing van die behuisingkrisis in Suid-Afrika.

How can rigorous forms of testing be supported in a way that is both compatible with the visual aspect of visual programming languages, and usable by the audiences using those languages - even when the audience has no background in software engineering? Visual programs are likely to contain at least some errors, and supporting a visual form of testing would give users a way to spot those errors early in the program's life. In previous work, we have developed a visual testing methodology known as WYSIWYT, for use in visual spreadsheet languages, and in this work, we show formally that this methodology can be generalized to screen transition diagrams. The algorithms and accompanying proof of the coverage equivalence that they ensure provide the mechanisms needed for the screen transition paradigm to incorporate WYSIWYT testing for both professional and end-user programming audiences. / Graduation date: 2004 / Best scan available for figures. Original is blurry.

The Embedded Computer System Support Improvement Program, or ESIP, was begun by the U.S. Air Force in 1983 to find new cost effective ways of integrating, testing and maintaining the computers embedded in military airborne, spaceborne, and ground electronic systems. A major initiative of this program is the Extendable Integration Support Environment (EISE). The EISE project involves design and development of a high speed network-based hardware and software integration and test environment. The ongoing work is being done jointly by U.S. Air Force civilian engineers at McClellan Air Force Base and TRW in Sacramento, California, in support of embedded avionics computers in the A-10 aircraft. The prototype design will be used to test and integrate various other aircraft and space systems. The author was the EISE project lead system engineer from July 1986 through January 1988.

abstract / toc / Computer Science and Information Systems / Doctoral / Doctor of Philosophy

There is no abstract available for this thesis. / Department of Computer Science

Three studies in the machine assisted proof of recursion implementation are described. The verification system used is Edinburgh LCF (Logic for Computable Functions). Proofs are generated, in LCF, in a goal-oriented fashion by the application of strategies reflecting informal proof plans. LCF is introduced in Chapter 1. We present three case studies in which proof strategies are developed and (except in the third) tested in LCF. Chapter 2 contains an account of the machine generated proofs of three program transformations (from recursive to iterative function schemata). Two of the examples are taken from Manna and Waldinger. In each case, the recursion is implemented by the introduction of a new data type, e.g., a stack or counter. Some progress is made towards the development of a general strategy for producing the equivalence proofs of recursive and iterative function schemata by machine. Chapter 3 is concerned with the machine generated proof of the correctness of a compiling algorithm. The formulation, borrowed from Russell, includes a simple imperative language with a while and conditional construct, and a low level language of labelled statements, including jumps. We have, in LCF, formalised his denotational descriptions of the two languages and performed a proof of the preservation of the semantics under compilation. In Chapter 4, we express and informally prove the correctness of a compiling algorithm for a language containing declarations and calls of recursive procedures. We present a low level language whose semantics model a standard activation stack implementation. Certain theoretical difficulties (connected with recursively defined relations) are discussed, and a proposed proof in LCF is outlined. The emphasis in this work is less on proving original theorems, or even automatically finding proofs of known theorems, than on (i) exhibiting and analysing the underlying structure of proofs, and of machine proof attempts, and (ii) investigating the nature of the interaction (between a user and a computer system) required to generate proofs mechanically; that is, the transition from informal proof plans to behaviours which cause formal proofs to be performed.