Model-based mutation testing via symbolic refinement checking

• Published in: Science of computer programming 2015-01, Vol.97, p.383-404
• Main Authors: Aichernig, Bernhard K., Jöbstl, Elisabeth, Tiran, Stefan
• Format: Article
• Language: English
• Subjects: Action systems; Constraint solving; Model-based testing; Mutation testing; Refinement
• ISSN: 0167-6423; 1872-7964
• DOI: 10.1016/j.scico.2014.05.004

In model-based mutation testing, a test model is mutated for test case generation. The resulting test cases are able to detect whether the faults in the mutated models have been implemented in the system under test. For this purpose, a conformance check between the original and the mutated model is required. The generated counterexamples serve as basis for the test cases. Unfortunately, conformance checking is a hard problem and requires sophisticated verification techniques. Previous attempts using an explicit conformance checker suffered state space explosion. In this paper, we present several optimisations of a symbolic conformance checker using constraint solving techniques. The tool efficiently checks the refinement between non-deterministic test models. Compared to previous implementations, we could reduce our runtimes by 97%. In a new industrial case study, our optimisations can reduce the runtime from over 6 hours to less than 3 minutes. •We deal with model- and mutation-based test case generation.•The main focus lies on optimisations of the underlying conformance check.•We explain the construction of test cases based on the conformance check.•We allow for non-determinism in the test models.•We demonstrate the effectiveness of our optimisations on industrial case studies.