CAMP: A tool to amplify software configuration tests

As software systems become more dynamic, it is critical to ensure that they can withstand changes in their execution environment. To this end, we developed CAMP, an open-source tool that tests software systems in multiple environments. Provided with a template deployment and a description of what ca...

Full description

Saved in:
Bibliographic Details
Published in:Software impacts 2020-02, Vol.3, p.100013, Article 100013
Main Authors: Chauvel, Franck, Morin, Brice, Garcia-Ceja, Enrique
Format: Article
Language:English
Subjects:
Configuration testing
Software engineering
Software testing
Test amplification
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:As software systems become more dynamic, it is critical to ensure that they can withstand changes in their execution environment. To this end, we developed CAMP, an open-source tool that tests software systems in multiple environments. Provided with a template deployment and a description of what can change in the execution environment, CAMP automatically builds, deploys and tests the system against many alternative environments. In practice, CAMP helped spot unexpected configuration issues in the Sphinx and Atom open-source projects as well as for several European companies. CAMP has been developed in the European H2020 STAMP project and paves the way for further research on configuration testing. •CAMP computes covering arrays to test all features with the least configurations.•CAMP amplifies configuration tests by changing the execution environment.•CAMP has been used to spot undocumented issues in big open-source projects.•Developers can specify points of variation via a variation model.•CAMP has been developed with support of the H2020 STAMP-project.
ISSN:2665-9638
2665-9638
DOI:10.1016/j.simpa.2019.100013