Leveraging Test Case Generation in the Testing Process - An Integration of Human Oracles with Derived Oracles

摘要

In the testing process humans examine the behavior of an application under test to determine what would constitute a failure. By specifying--for a given input and result--whether or not this combination leads to desired behavior, they essentially constitute to what is called the test oracle. To automate oracle generation, techniques were introduced to derive the oracle from models, specification, or by reusing artifacts. In the end, to complete the oracle, a human must be involved. Automated Test Case Generation (ATCG) on the other hand, already derives all feasible test cases from the program itself - baring judgment about which cases correspond to faults. This paper introduces a tool that derives the oracle by using ATCG as input for a human oracle. By combining ATCG with human oracles, we aim to reduce costs associated with the testing process.