Human performance metrics for the nuclear domain: A tool for evaluating measures of workload, situation awareness and teamwork

• Published in: International journal of industrial ergonomics 2019-01, Vol.69, p.217-227
• Main Authors: Reinerman-Jones, Lauren E., Hughes, Niav, D'Agostino, Amy, Matthews, Gerald
• Format: Article
• Language: English
• Subjects: Automation; Cognition; Decision making; Decision-making tool; Domains; Human engineering; Human factors; Human factors engineering; Human factors research; Human performance; Metric system; Nuclear energy; Nuclear power; Nuclear power plants; Performance evaluation; Performance measurement; Psychometrics; Situation awareness; Situational awareness; Teamwork; Working conditions; Workload; Workloads
• ISSN: 0169-8141; 1872-8219
• DOI: 10.1016/j.ergon.2018.12.001

The Nuclear Regulatory Commission (NRC) has developed a tool to support the understanding and evaluation of workload (WL), situation awareness (SA), and teamwork (TW) metrics used in human factors engineering (HFE) programs for commercial nuclear power plants (NPPs). This article summarizes the NRC report on the tool, and discusses its potential application to other industries. The operational relevance of WL, SA and TW to the NPP domain is reviewed, and challenges associated with the development of valid metrics for these constructs are identified. The Generic Metrics Catalog (GMC) is a database that compiles information about WL, SA, and TW metrics in a readily accessible and easy to use format. It provides information about the psychometric properties of a metric and the soundness of the methods used to investigate these properties. In the evaluation of a proposed HFE in an NPP license application, the Decision Making Wizard (DMW) uses reviewer input and information found in the GMC to identify areas of concern in applications. Tools of this kind may be especially valuable in other domains for managing challenges of novel technologies such as automation, human-robot teaming and augmented cognition. •We review metrics for human factors evaluations of nuclear power plant operations.•Metrics include those for workload, situation awareness, and teamwork.•Psychometric challenges in evaluating suitability of metrics are discussed.•A database and decision-making tool to support evaluation of metrics are outlined.•Application of the present approach to other industrial contexts is described.