Back to search

Georgia Institute of Technology

Improving in-house testing using field execution data

Abstract

dc:description.abstract

Software testing is today the most widely used approach for assessing and improving software quality. Despite its popularity, however, software testing has a number of inherent limitations. First, due to resource limitations, in-house tests necessarily exercise only a tiny fraction of all the possible behaviors of a software system. Second, testers typically select this fraction of behaviors to be tested based either on some (more or less rigorous) selection criteria or on their assumptions, intuition, and experience. As a result, in-house tests are typically not representative of the software behavior exercised by real users, which ultimately results in the software behaving incorrectly and failing in the field, after it has been released. The overarching goal of my dissertation is to address this problem and improve the effectiveness of in-house testing. To this end, I proposed a set of techniques for measuring and bridging the gap between in-house tests and field executions. My first technique allows for quantifying and analyzing the differences between behaviors exercised in-house and in the field. My second approach leverages the differences identified by my first technique to generate, using a guided symbolic analysis, test inputs that mimic field behaviors and can be added to existing in-house test suites. Finally, my third approach leverages the executions observed in the field to improve symbolic input generation and make test generation more effective. The evaluation shows that my techniques can effectively generate test inputs using field execution data and make in-house testing more representative of field executions.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wang, Qianqian
Advisor dc:contributor.advisor
  • Orso, Alessandro
Committee members dc:contributor.committeemember
  • Sarkar, Vivek
  • Rugaber, Spencer
  • Zhang, Qirun
  • Brun, Yuriy

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1853/62267

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Wang, Qianqian. Improving in-house testing using field execution data. Doctoral thesis, Georgia Institute of Technology, 2019. http://hdl.handle.net/1853/62267