How to judge testing progress

It is usual to base the assessment of software testing progress on a coverage measure such as code coverage or specification coverage, or on the percentage of the input domain exercised. In this paper it is argued that these characteristics do not provide good indications of the degree to which the...

Full description

Saved in:
Bibliographic Details
Published in:Information and software technology 2004-04, Vol.46 (5), p.323-328
Main Author: Weyuker, Elaine J.
Format: Article
Language:English
Subjects:
Computer programming
Distributed processing
Operational distribution
Software
Software testing
Studies
Test data adequacy
Test progress
Testing
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:It is usual to base the assessment of software testing progress on a coverage measure such as code coverage or specification coverage, or on the percentage of the input domain exercised. In this paper it is argued that these characteristics do not provide good indications of the degree to which the software has been tested. Instead we propose that the assessment of testing progress be based on the total percentage of the probability mass that corresponds to the test cases selected and run. To do this, it is necessary to collect data that profiles how the software will be used once it is operational in the field. By so doing, we are able to accurately determine how much testing has been done, and whether it has met the standards of completeness for the product under consideration.
ISSN:0950-5849
1873-6025
DOI:10.1016/j.infsof.2003.09.008