Testing, Verification, and Validation of Expert Systems

This paper discusses how an expert system can be tested, verified, and validated. A prototype expert system, the Hazardous Location Analyst (HLA), which analyzes high-accident locations, is used to illustrate the evaluation process and to examine the various aspects of testing, verification, and val...

Full description

Saved in:
Bibliographic Details
Published in:Journal of transportation engineering 1991-05, Vol.117 (3), p.350-360
Main Authors: Spring, Gary S, Collura, John, Shuldiner, Paul W, Watson, James
Format: Article
Language:English
Subjects:
Applied sciences
Exact sciences and technology
Ground, air and sea transportation, marine construction
Road transportation and traffic
TECHNICAL PAPERS
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper discusses how an expert system can be tested, verified, and validated. A prototype expert system, the Hazardous Location Analyst (HLA), which analyzes high-accident locations, is used to illustrate the evaluation process and to examine the various aspects of testing, verification, and validation. Identified were several key issues that must be addressed when evaluating an expert system: problem complexity, no "correct answers," the problem of defining expert-level performance, and considerations in knowledge-base refinement. The paper also suggests ways in which to make comparisons between expert-system and human-expert inferences so that ease of use, knowledge-base adequacy, and completeness may be examined. The paper further suggests that although some quantitative performance measures are useful for the evaluation process, a qualitative evaluation is perhaps also appropriate for many aspects of these kinds of systems.
ISSN:0733-947X
1943-5436
DOI:10.1061/(ASCE)0733-947X(1991)117:3(350)