Probabilistic vs deterministic forecasts--interpreting skill statistics for the benefit of users

Owing to probabilistic uncertainties associated with seasonal forecasts, especially over areas such as southern Africa where forecast skill is limited, non-climatologists and users of such forecasts frequently prefer them to be presented or distributed in terms of the likelihood (expressed as a prob...

Full description

Saved in:
Bibliographic Details
Published in:Water S. A. 2023-07, Vol.49 (3), p.192-198
Main Authors: Landman, Willem A, Tadross, Mark, Archer, Emma, Johnston, Peter
Format: Article
Language:English
Subjects:
Anomalies
Atmosphere
Climate
Correlation coefficient
Correlation coefficients
Data analysis
Familiarity
Mathematical analysis
Probability
Rain
Rainfall
Scientists
Seasons
Statistical methods
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Owing to probabilistic uncertainties associated with seasonal forecasts, especially over areas such as southern Africa where forecast skill is limited, non-climatologists and users of such forecasts frequently prefer them to be presented or distributed in terms of the likelihood (expressed as a probability) of certain categories occurring or thresholds being exceeded. Probabilistic forecast verification is needed to verify such forecasts. Whilst the resulting verification statistics can provide clear insights into forecast attributes, they are often difficult to understand, which might hinder forecast uptake and use. This problem can be addressed by issuing forecasts with some understandable evidence of skill, with the purpose of reflecting how similar forecasts may have performed in the past. In this paper, we present a range of different probabilistic forecast verification scores, and determine if these statistics can be readily compared to more commonly known and understood 'ordinary' correlations between forecasts and their associated observations - assuming that ordinary correlations are more intuitively understood and informative to seasonal forecast users. Of the range of scores considered, the relative operating characteristics (ROC) was found to be the most intrinsically similar to correlation. KEYWORDS forecast verification forecast skill forecast users relative operating characteristics
ISSN:0378-4738
DOI:10.17159/wsa/2023.v49.i3.4058