Dynamic random testing with test case clustering and distance-based parameter adjustment

• Published in: Information and software technology 2021-03, Vol.131, p.106470, Article 106470
• Main Authors: Pei, Hanyu, Yin, Beibei, Xie, Min, Cai, Kai-Yuan
• Format: Article
• Language: English
• Subjects: Dynamic random testing; Software cybernetics; Test case clustering; Testing profile
• ISSN: 0950-5849; 1873-6025
• DOI: 10.1016/j.infsof.2020.106470

Software testing is essential in software engineering to improve software reliability. One goal of software testing strategies is to detect faults faster. Dynamic Random Testing (DRT) strategy uses the testing results to guide the selection of test cases, which has shown to be effective in the fault detection process. Previous studies have demonstrated that DRT is greatly affected by the test case classification and the process of adjusting the testing profile. In this paper, we propose Distance-based DRT (D-DRT) strategies, aiming at enhancing the fault detection effectiveness of DRT. D-DRT strategies utilize distance information of inputs into the test case classification and the testing profile adjustment process. The test cases are vectorized based on the input parameters and classified into disjoint subdomains through certain clustering methods. And the distance information of subdomains, along with testing results, are used to adjust the testing profile, such that test cases that are closer to failure-causing subdomains are more likely to be selected. We conduct empirical studies to evaluate the performance of the proposed algorithms using 12 versions of 4 open-source programs. The experimental results show that, compared with Random Testing (RT), Random Partition Testing (RPT), DRT and Adaptive Testing (AT), our strategies achieve greater fault detection effectiveness with a low computational cost. Moreover, the distance-based testing profile adjustment method is the dominant factor in the improvement of the D-DRT strategy. D-DRT strategies are effective testing strategies, and the distance-based testing profile adjustment method plays a crucial role.